Nov 03 19:58:04.336317 ip-10-0-140-181 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Nov 03 19:58:04.336331 ip-10-0-140-181 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Nov 03 19:58:04.336339 ip-10-0-140-181 systemd[1]: kubelet.service: Failed with result 'resources'. Nov 03 19:58:04.336666 ip-10-0-140-181 systemd[1]: Failed to start Kubernetes Kubelet. Nov 03 19:58:14.362786 ip-10-0-140-181 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Nov 03 19:58:14.362803 ip-10-0-140-181 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 78a55a2eac344873ae49586768f24217 -- Nov 03 20:00:15.652841 ip-10-0-140-181 systemd[1]: Starting Kubernetes Kubelet... Nov 03 20:00:16.017084 ip-10-0-140-181 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 03 20:00:16.017084 ip-10-0-140-181 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Nov 03 20:00:16.017084 ip-10-0-140-181 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 03 20:00:16.017084 ip-10-0-140-181 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 03 20:00:16.020697 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020623 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 20:00:16.020697 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020696 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 20:00:16.020765 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020701 2576 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 20:00:16.020765 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020705 2576 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 20:00:16.020765 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020708 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 20:00:16.020765 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020710 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 20:00:16.020765 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020714 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 20:00:16.020765 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020718 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 20:00:16.020765 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020721 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 20:00:16.020765 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020724 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 20:00:16.020765 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020727 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 20:00:16.020765 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020730 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 20:00:16.020765 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020732 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 20:00:16.020765 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020735 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 20:00:16.020765 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020737 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 20:00:16.020765 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020741 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 20:00:16.020765 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020745 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 20:00:16.020765 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020748 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 20:00:16.020765 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020751 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 20:00:16.020765 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020760 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 20:00:16.020765 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020764 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 20:00:16.021193 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020766 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 20:00:16.021193 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020769 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 20:00:16.021193 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020772 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 20:00:16.021193 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020775 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 20:00:16.021193 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020778 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 20:00:16.021193 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020780 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 20:00:16.021193 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020783 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 20:00:16.021193 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020785 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 20:00:16.021193 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020788 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 20:00:16.021193 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020790 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 20:00:16.021193 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020793 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 20:00:16.021193 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020796 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 20:00:16.021193 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020798 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 20:00:16.021193 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020801 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 20:00:16.021193 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020803 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 20:00:16.021193 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020806 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 20:00:16.021193 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020808 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 20:00:16.021193 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020810 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 20:00:16.021193 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020813 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 20:00:16.021659 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020815 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 20:00:16.021659 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020818 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 20:00:16.021659 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020820 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 20:00:16.021659 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020823 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 20:00:16.021659 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020825 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 20:00:16.021659 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020827 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 20:00:16.021659 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020830 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 20:00:16.021659 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020833 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 20:00:16.021659 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020836 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 20:00:16.021659 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020838 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 20:00:16.021659 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020842 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 20:00:16.021659 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020845 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 20:00:16.021659 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020848 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 20:00:16.021659 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020850 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 20:00:16.021659 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020853 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 20:00:16.021659 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020856 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 20:00:16.021659 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020858 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 20:00:16.021659 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020861 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 20:00:16.021659 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020863 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 20:00:16.021659 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020866 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 20:00:16.022215 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020869 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 20:00:16.022215 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020871 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 20:00:16.022215 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020874 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 20:00:16.022215 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020876 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 20:00:16.022215 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020879 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 20:00:16.022215 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020881 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 20:00:16.022215 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020883 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 20:00:16.022215 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020886 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 20:00:16.022215 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020888 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 20:00:16.022215 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020891 2576 feature_gate.go:386] unrecognized feature gate: Example Nov 03 20:00:16.022215 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020893 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 20:00:16.022215 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020895 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 20:00:16.022215 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020906 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 20:00:16.022215 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020909 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 20:00:16.022215 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020912 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 20:00:16.022215 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020914 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 20:00:16.022215 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020917 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 20:00:16.022215 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020919 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 20:00:16.022215 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020922 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 20:00:16.022215 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020924 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 20:00:16.022733 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020927 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 20:00:16.022733 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020929 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 20:00:16.022733 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020932 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 20:00:16.022733 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020935 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 20:00:16.022733 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020937 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 20:00:16.022733 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020940 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 20:00:16.022733 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020943 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 20:00:16.022733 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020946 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 20:00:16.022733 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020948 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 20:00:16.022733 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020951 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 20:00:16.022733 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020953 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 20:00:16.022733 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020956 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 20:00:16.022733 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020958 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 20:00:16.022733 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020960 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 20:00:16.022733 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020963 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 20:00:16.022733 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020965 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 20:00:16.022733 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020969 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 20:00:16.022733 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020971 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 20:00:16.022733 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020974 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 20:00:16.022733 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020976 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 20:00:16.023257 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020979 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 20:00:16.023257 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020981 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 20:00:16.023257 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020984 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 20:00:16.023257 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020986 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 20:00:16.023257 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020989 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 20:00:16.023257 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.020996 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 20:00:16.023257 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021763 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 20:00:16.023257 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021770 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 20:00:16.023257 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021773 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 20:00:16.023257 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021776 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 20:00:16.023257 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021779 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 20:00:16.023257 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021782 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 20:00:16.023257 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021784 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 20:00:16.023257 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021787 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 20:00:16.023257 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021790 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 20:00:16.023257 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021792 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 20:00:16.023257 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021795 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 20:00:16.023257 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021798 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 20:00:16.023257 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021801 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 20:00:16.023737 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021803 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 20:00:16.023737 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021806 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 20:00:16.023737 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021808 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 20:00:16.023737 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021810 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 20:00:16.023737 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021813 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 20:00:16.023737 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021816 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 20:00:16.023737 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021818 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 20:00:16.023737 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021821 2576 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 20:00:16.023737 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021823 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 20:00:16.023737 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021825 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 20:00:16.023737 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021828 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 20:00:16.023737 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021831 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 20:00:16.023737 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021833 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 20:00:16.023737 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021836 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 20:00:16.023737 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021838 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 20:00:16.023737 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021841 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 20:00:16.023737 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021843 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 20:00:16.023737 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021845 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 20:00:16.023737 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021848 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 20:00:16.023737 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021856 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 20:00:16.024210 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021858 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 20:00:16.024210 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021861 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 20:00:16.024210 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021865 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 20:00:16.024210 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021868 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 20:00:16.024210 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021870 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 20:00:16.024210 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021873 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 20:00:16.024210 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021875 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 20:00:16.024210 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021878 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 20:00:16.024210 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021880 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 20:00:16.024210 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021883 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 20:00:16.024210 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021887 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 20:00:16.024210 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021890 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 20:00:16.024210 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021893 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 20:00:16.024210 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021896 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 20:00:16.024210 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021899 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 20:00:16.024210 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021901 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 20:00:16.024210 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021904 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 20:00:16.024210 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021906 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 20:00:16.024210 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021909 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 20:00:16.024662 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021912 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 20:00:16.024662 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021915 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 20:00:16.024662 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021918 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 20:00:16.024662 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021920 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 20:00:16.024662 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021923 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 20:00:16.024662 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021925 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 20:00:16.024662 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021928 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 20:00:16.024662 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021930 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 20:00:16.024662 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021933 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 20:00:16.024662 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021935 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 20:00:16.024662 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021938 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 20:00:16.024662 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021940 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 20:00:16.024662 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021942 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 20:00:16.024662 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021950 2576 feature_gate.go:386] unrecognized feature gate: Example Nov 03 20:00:16.024662 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021953 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 20:00:16.024662 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021959 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 20:00:16.024662 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021961 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 20:00:16.024662 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021964 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 20:00:16.024662 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021966 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 20:00:16.024662 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021969 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 20:00:16.025129 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021971 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 20:00:16.025129 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021974 2576 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 20:00:16.025129 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021976 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 20:00:16.025129 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021979 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 20:00:16.025129 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021988 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 20:00:16.025129 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021991 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 20:00:16.025129 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021993 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 20:00:16.025129 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021996 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 20:00:16.025129 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.021998 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 20:00:16.025129 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022001 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 20:00:16.025129 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022003 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 20:00:16.025129 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022006 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 20:00:16.025129 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022008 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 20:00:16.025129 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022010 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 20:00:16.025129 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022013 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 20:00:16.025129 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022015 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 20:00:16.025129 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022018 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 20:00:16.025129 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022020 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 20:00:16.025129 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022023 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 20:00:16.025574 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022026 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 20:00:16.025574 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022028 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 20:00:16.025574 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022031 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 20:00:16.025574 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022033 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 20:00:16.025574 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022044 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 20:00:16.025574 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022048 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 20:00:16.025574 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022052 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 20:00:16.025574 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022055 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 20:00:16.025574 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022059 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 20:00:16.025574 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022062 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 20:00:16.025574 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022064 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 20:00:16.025574 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022067 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 20:00:16.025574 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022069 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 20:00:16.025574 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022072 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 20:00:16.025574 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022075 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 20:00:16.025574 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022528 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 20:00:16.025574 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022533 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 20:00:16.025574 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022536 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 20:00:16.025574 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022539 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 20:00:16.026012 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022542 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 20:00:16.026012 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022544 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 20:00:16.026012 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022547 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 20:00:16.026012 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022549 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 20:00:16.026012 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022552 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 20:00:16.026012 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022554 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 20:00:16.026012 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022557 2576 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 20:00:16.026012 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022575 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 20:00:16.026012 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022578 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 20:00:16.026012 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022580 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 20:00:16.026012 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022583 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 20:00:16.026012 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022586 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 20:00:16.026012 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022588 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 20:00:16.026012 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022590 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 20:00:16.026012 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022593 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 20:00:16.026012 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022595 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 20:00:16.026012 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022598 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 20:00:16.026012 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022600 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 20:00:16.026012 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022603 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 20:00:16.026012 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022605 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 20:00:16.026491 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022608 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 20:00:16.026491 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022613 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 20:00:16.026491 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022615 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 20:00:16.026491 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022618 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 20:00:16.026491 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022620 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 20:00:16.026491 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022623 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 20:00:16.026491 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022625 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 20:00:16.026491 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022627 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 20:00:16.026491 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022630 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 20:00:16.026491 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022632 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 20:00:16.026491 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022635 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 20:00:16.026491 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022637 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 20:00:16.026491 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022640 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 20:00:16.026491 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022642 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 20:00:16.026491 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022645 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 20:00:16.026491 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022647 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 20:00:16.026491 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022650 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 20:00:16.026491 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022652 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 20:00:16.026491 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022655 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 20:00:16.026965 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022658 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 20:00:16.026965 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022660 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 20:00:16.026965 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022663 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 20:00:16.026965 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022665 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 20:00:16.026965 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022667 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 20:00:16.026965 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022670 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 20:00:16.026965 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022672 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 20:00:16.026965 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022674 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 20:00:16.026965 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022677 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 20:00:16.026965 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022679 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 20:00:16.026965 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022682 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 20:00:16.026965 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022684 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 20:00:16.026965 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022686 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 20:00:16.026965 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022689 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 20:00:16.026965 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022697 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 20:00:16.026965 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022708 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 20:00:16.026965 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022712 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 20:00:16.026965 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022715 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 20:00:16.026965 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022717 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 20:00:16.027421 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022720 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 20:00:16.027421 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022722 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 20:00:16.027421 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022725 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 20:00:16.027421 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022728 2576 feature_gate.go:386] unrecognized feature gate: Example Nov 03 20:00:16.027421 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022730 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 20:00:16.027421 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022733 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 20:00:16.027421 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022754 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 20:00:16.027421 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022757 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 20:00:16.027421 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022760 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 20:00:16.027421 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022763 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 20:00:16.027421 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022766 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 20:00:16.027421 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022768 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 20:00:16.027421 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022770 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 20:00:16.027421 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022773 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 20:00:16.027421 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022776 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 20:00:16.027421 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022778 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 20:00:16.027421 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022782 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 20:00:16.027421 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022784 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 20:00:16.027421 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022787 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 20:00:16.027421 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022789 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 20:00:16.027953 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022792 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 20:00:16.027953 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022794 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 20:00:16.027953 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022797 2576 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 20:00:16.027953 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022799 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 20:00:16.027953 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022802 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 20:00:16.027953 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022805 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 20:00:16.027953 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022807 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 20:00:16.027953 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022812 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 20:00:16.027953 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022815 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 20:00:16.027953 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022818 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 20:00:16.027953 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022820 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 20:00:16.027953 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022823 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 20:00:16.027953 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022825 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 20:00:16.027953 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022828 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 20:00:16.027953 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022830 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 20:00:16.027953 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022833 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 20:00:16.027953 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022836 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 20:00:16.027953 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022838 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 20:00:16.027953 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022842 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 20:00:16.028382 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022846 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 20:00:16.028382 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022848 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 20:00:16.028382 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022851 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 20:00:16.028382 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022854 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 20:00:16.028382 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.022857 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 20:00:16.028382 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023604 2576 flags.go:64] FLAG: --address="0.0.0.0" Nov 03 20:00:16.028382 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023613 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Nov 03 20:00:16.028382 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023620 2576 flags.go:64] FLAG: --anonymous-auth="true" Nov 03 20:00:16.028382 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023625 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Nov 03 20:00:16.028382 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023629 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Nov 03 20:00:16.028382 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023632 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Nov 03 20:00:16.028382 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023636 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Nov 03 20:00:16.028382 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023640 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Nov 03 20:00:16.028382 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023644 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Nov 03 20:00:16.028382 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023647 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Nov 03 20:00:16.028382 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023650 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Nov 03 20:00:16.028382 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023653 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Nov 03 20:00:16.028382 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023656 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Nov 03 20:00:16.028382 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023659 2576 flags.go:64] FLAG: --cgroup-root="" Nov 03 20:00:16.028382 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023662 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Nov 03 20:00:16.028382 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023666 2576 flags.go:64] FLAG: --client-ca-file="" Nov 03 20:00:16.028382 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023669 2576 flags.go:64] FLAG: --cloud-provider="external" Nov 03 20:00:16.028382 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023673 2576 flags.go:64] FLAG: --cluster-dns="[]" Nov 03 20:00:16.028925 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023676 2576 flags.go:64] FLAG: --cluster-domain="" Nov 03 20:00:16.028925 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023679 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Nov 03 20:00:16.028925 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023682 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Nov 03 20:00:16.028925 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023686 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Nov 03 20:00:16.028925 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023689 2576 flags.go:64] FLAG: --container-log-max-files="5" Nov 03 20:00:16.028925 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023693 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Nov 03 20:00:16.028925 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023696 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Nov 03 20:00:16.028925 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023699 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Nov 03 20:00:16.028925 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023702 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Nov 03 20:00:16.028925 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023705 2576 flags.go:64] FLAG: --contention-profiling="false" Nov 03 20:00:16.028925 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023708 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Nov 03 20:00:16.028925 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023711 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Nov 03 20:00:16.028925 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023714 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Nov 03 20:00:16.028925 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023716 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Nov 03 20:00:16.028925 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023721 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Nov 03 20:00:16.028925 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023724 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Nov 03 20:00:16.028925 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023726 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Nov 03 20:00:16.028925 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023730 2576 flags.go:64] FLAG: --enable-load-reader="false" Nov 03 20:00:16.028925 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023733 2576 flags.go:64] FLAG: --enable-server="true" Nov 03 20:00:16.028925 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023736 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Nov 03 20:00:16.028925 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023740 2576 flags.go:64] FLAG: --event-burst="100" Nov 03 20:00:16.028925 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023744 2576 flags.go:64] FLAG: --event-qps="50" Nov 03 20:00:16.028925 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023747 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Nov 03 20:00:16.028925 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023750 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Nov 03 20:00:16.029597 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023753 2576 flags.go:64] FLAG: --eviction-hard="" Nov 03 20:00:16.029597 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023758 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Nov 03 20:00:16.029597 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023761 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Nov 03 20:00:16.029597 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023764 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Nov 03 20:00:16.029597 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023767 2576 flags.go:64] FLAG: --eviction-soft="" Nov 03 20:00:16.029597 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023770 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Nov 03 20:00:16.029597 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023773 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Nov 03 20:00:16.029597 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023776 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Nov 03 20:00:16.029597 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023780 2576 flags.go:64] FLAG: --experimental-mounter-path="" Nov 03 20:00:16.029597 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023783 2576 flags.go:64] FLAG: --fail-cgroupv1="true" Nov 03 20:00:16.029597 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023786 2576 flags.go:64] FLAG: --fail-swap-on="true" Nov 03 20:00:16.029597 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023788 2576 flags.go:64] FLAG: --feature-gates="" Nov 03 20:00:16.029597 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023792 2576 flags.go:64] FLAG: --file-check-frequency="20s" Nov 03 20:00:16.029597 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023795 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Nov 03 20:00:16.029597 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023799 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Nov 03 20:00:16.029597 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023802 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Nov 03 20:00:16.029597 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023805 2576 flags.go:64] FLAG: --healthz-port="10248" Nov 03 20:00:16.029597 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023808 2576 flags.go:64] FLAG: --help="false" Nov 03 20:00:16.029597 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023810 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:00:16.029597 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023813 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Nov 03 20:00:16.029597 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023816 2576 flags.go:64] FLAG: --http-check-frequency="20s" Nov 03 20:00:16.029597 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023819 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Nov 03 20:00:16.029597 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023823 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Nov 03 20:00:16.030137 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023826 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Nov 03 20:00:16.030137 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023829 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Nov 03 20:00:16.030137 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023832 2576 flags.go:64] FLAG: --image-service-endpoint="" Nov 03 20:00:16.030137 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023834 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Nov 03 20:00:16.030137 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023837 2576 flags.go:64] FLAG: --kube-api-burst="100" Nov 03 20:00:16.030137 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023853 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Nov 03 20:00:16.030137 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023856 2576 flags.go:64] FLAG: --kube-api-qps="50" Nov 03 20:00:16.030137 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023858 2576 flags.go:64] FLAG: --kube-reserved="" Nov 03 20:00:16.030137 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023861 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Nov 03 20:00:16.030137 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023864 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Nov 03 20:00:16.030137 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023867 2576 flags.go:64] FLAG: --kubelet-cgroups="" Nov 03 20:00:16.030137 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023870 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Nov 03 20:00:16.030137 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023872 2576 flags.go:64] FLAG: --lock-file="" Nov 03 20:00:16.030137 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023875 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Nov 03 20:00:16.030137 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023878 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Nov 03 20:00:16.030137 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023881 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Nov 03 20:00:16.030137 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023886 2576 flags.go:64] FLAG: --log-json-split-stream="false" Nov 03 20:00:16.030137 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023888 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Nov 03 20:00:16.030137 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023892 2576 flags.go:64] FLAG: --log-text-split-stream="false" Nov 03 20:00:16.030137 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023895 2576 flags.go:64] FLAG: --logging-format="text" Nov 03 20:00:16.030137 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023897 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Nov 03 20:00:16.030137 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023900 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Nov 03 20:00:16.030137 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023903 2576 flags.go:64] FLAG: --manifest-url="" Nov 03 20:00:16.030137 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023906 2576 flags.go:64] FLAG: --manifest-url-header="" Nov 03 20:00:16.030137 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023911 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Nov 03 20:00:16.030762 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023913 2576 flags.go:64] FLAG: --max-open-files="1000000" Nov 03 20:00:16.030762 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023917 2576 flags.go:64] FLAG: --max-pods="110" Nov 03 20:00:16.030762 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023920 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Nov 03 20:00:16.030762 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023923 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Nov 03 20:00:16.030762 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023925 2576 flags.go:64] FLAG: --memory-manager-policy="None" Nov 03 20:00:16.030762 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023928 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Nov 03 20:00:16.030762 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023931 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Nov 03 20:00:16.030762 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023934 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Nov 03 20:00:16.030762 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023937 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Nov 03 20:00:16.030762 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023943 2576 flags.go:64] FLAG: --node-status-max-images="50" Nov 03 20:00:16.030762 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023946 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Nov 03 20:00:16.030762 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023949 2576 flags.go:64] FLAG: --oom-score-adj="-999" Nov 03 20:00:16.030762 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023952 2576 flags.go:64] FLAG: --pod-cidr="" Nov 03 20:00:16.030762 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023955 2576 flags.go:64] FLAG: --pod-manifest-path="" Nov 03 20:00:16.030762 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023957 2576 flags.go:64] FLAG: --pod-max-pids="-1" Nov 03 20:00:16.030762 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023960 2576 flags.go:64] FLAG: --pods-per-core="0" Nov 03 20:00:16.030762 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023963 2576 flags.go:64] FLAG: --port="10250" Nov 03 20:00:16.030762 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023966 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Nov 03 20:00:16.030762 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023970 2576 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-047ba3ae6a22c1166" Nov 03 20:00:16.030762 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023973 2576 flags.go:64] FLAG: --qos-reserved="" Nov 03 20:00:16.030762 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023976 2576 flags.go:64] FLAG: --read-only-port="10255" Nov 03 20:00:16.030762 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023979 2576 flags.go:64] FLAG: --register-node="true" Nov 03 20:00:16.030762 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023982 2576 flags.go:64] FLAG: --register-with-taints="" Nov 03 20:00:16.030762 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023986 2576 flags.go:64] FLAG: --registry-burst="10" Nov 03 20:00:16.030762 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023988 2576 flags.go:64] FLAG: --registry-qps="5" Nov 03 20:00:16.030762 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023991 2576 flags.go:64] FLAG: --reserved-cpus="" Nov 03 20:00:16.031381 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.023998 2576 flags.go:64] FLAG: --reserved-memory="" Nov 03 20:00:16.031381 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.024006 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Nov 03 20:00:16.031381 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.024009 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Nov 03 20:00:16.031381 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.024012 2576 flags.go:64] FLAG: --rotate-certificates="false" Nov 03 20:00:16.031381 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.024015 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Nov 03 20:00:16.031381 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.024018 2576 flags.go:64] FLAG: --runonce="false" Nov 03 20:00:16.031381 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.024021 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Nov 03 20:00:16.031381 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.024024 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Nov 03 20:00:16.031381 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.024026 2576 flags.go:64] FLAG: --seccomp-default="false" Nov 03 20:00:16.031381 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.024029 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Nov 03 20:00:16.031381 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.024032 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Nov 03 20:00:16.031381 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.024036 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Nov 03 20:00:16.031381 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.024039 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Nov 03 20:00:16.031381 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.024042 2576 flags.go:64] FLAG: --storage-driver-password="root" Nov 03 20:00:16.031381 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.024045 2576 flags.go:64] FLAG: --storage-driver-secure="false" Nov 03 20:00:16.031381 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.024048 2576 flags.go:64] FLAG: --storage-driver-table="stats" Nov 03 20:00:16.031381 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.024050 2576 flags.go:64] FLAG: --storage-driver-user="root" Nov 03 20:00:16.031381 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.024053 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Nov 03 20:00:16.031381 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.024056 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Nov 03 20:00:16.031381 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.024059 2576 flags.go:64] FLAG: --system-cgroups="" Nov 03 20:00:16.031381 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.024062 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Nov 03 20:00:16.031381 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.024067 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Nov 03 20:00:16.031381 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.024069 2576 flags.go:64] FLAG: --tls-cert-file="" Nov 03 20:00:16.031381 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.024072 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Nov 03 20:00:16.031381 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.024077 2576 flags.go:64] FLAG: --tls-min-version="" Nov 03 20:00:16.031993 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.024079 2576 flags.go:64] FLAG: --tls-private-key-file="" Nov 03 20:00:16.031993 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.024083 2576 flags.go:64] FLAG: --topology-manager-policy="none" Nov 03 20:00:16.031993 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.024085 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Nov 03 20:00:16.031993 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.024088 2576 flags.go:64] FLAG: --topology-manager-scope="container" Nov 03 20:00:16.031993 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.024091 2576 flags.go:64] FLAG: --v="2" Nov 03 20:00:16.031993 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.024096 2576 flags.go:64] FLAG: --version="false" Nov 03 20:00:16.031993 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.024099 2576 flags.go:64] FLAG: --vmodule="" Nov 03 20:00:16.031993 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.024103 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Nov 03 20:00:16.031993 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.024107 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Nov 03 20:00:16.031993 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024232 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 20:00:16.031993 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024236 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 20:00:16.031993 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024240 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 20:00:16.031993 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024242 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 20:00:16.031993 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024245 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 20:00:16.031993 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024248 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 20:00:16.031993 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024250 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 20:00:16.031993 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024253 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 20:00:16.031993 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024255 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 20:00:16.031993 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024259 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 20:00:16.031993 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024262 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 20:00:16.031993 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024265 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 20:00:16.031993 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024267 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 20:00:16.032492 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024270 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 20:00:16.032492 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024274 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 20:00:16.032492 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024277 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 20:00:16.032492 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024280 2576 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 20:00:16.032492 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024283 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 20:00:16.032492 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024286 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 20:00:16.032492 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024288 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 20:00:16.032492 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024290 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 20:00:16.032492 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024293 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 20:00:16.032492 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024296 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 20:00:16.032492 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024299 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 20:00:16.032492 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024303 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 20:00:16.032492 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024306 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 20:00:16.032492 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024308 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 20:00:16.032492 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024311 2576 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 20:00:16.032492 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024313 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 20:00:16.032492 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024316 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 20:00:16.032492 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024318 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 20:00:16.032492 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024321 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 20:00:16.032989 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024324 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 20:00:16.032989 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024326 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 20:00:16.032989 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024329 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 20:00:16.032989 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024332 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 20:00:16.032989 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024334 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 20:00:16.032989 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024336 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 20:00:16.032989 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024339 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 20:00:16.032989 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024341 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 20:00:16.032989 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024344 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 20:00:16.032989 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024347 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 20:00:16.032989 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024350 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 20:00:16.032989 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024352 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 20:00:16.032989 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024355 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 20:00:16.032989 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024357 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 20:00:16.032989 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024360 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 20:00:16.032989 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024362 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 20:00:16.032989 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024364 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 20:00:16.032989 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024367 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 20:00:16.032989 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024369 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 20:00:16.033426 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024372 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 20:00:16.033426 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024374 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 20:00:16.033426 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024377 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 20:00:16.033426 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024380 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 20:00:16.033426 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024383 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 20:00:16.033426 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024385 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 20:00:16.033426 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024388 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 20:00:16.033426 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024390 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 20:00:16.033426 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024393 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 20:00:16.033426 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024395 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 20:00:16.033426 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024398 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 20:00:16.033426 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024401 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 20:00:16.033426 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024403 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 20:00:16.033426 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024406 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 20:00:16.033426 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024409 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 20:00:16.033426 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024411 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 20:00:16.033426 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024414 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 20:00:16.033426 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024416 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 20:00:16.033426 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024419 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 20:00:16.033426 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024421 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 20:00:16.033924 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024424 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 20:00:16.033924 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024426 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 20:00:16.033924 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024430 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 20:00:16.033924 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024432 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 20:00:16.033924 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024434 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 20:00:16.033924 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024437 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 20:00:16.033924 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024439 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 20:00:16.033924 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024442 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 20:00:16.033924 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024445 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 20:00:16.033924 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024447 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 20:00:16.033924 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024449 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 20:00:16.033924 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024452 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 20:00:16.033924 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024454 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 20:00:16.033924 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024457 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 20:00:16.033924 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024459 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 20:00:16.033924 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024464 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 20:00:16.033924 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024467 2576 feature_gate.go:386] unrecognized feature gate: Example Nov 03 20:00:16.033924 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024469 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 20:00:16.033924 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024471 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 20:00:16.033924 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024474 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 20:00:16.034648 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024477 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 20:00:16.034648 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024479 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 20:00:16.034648 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024482 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 20:00:16.034648 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024484 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 20:00:16.034648 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024486 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 20:00:16.034648 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024489 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 20:00:16.034648 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024491 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 20:00:16.034648 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024494 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 20:00:16.034648 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024496 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 20:00:16.034648 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024499 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 20:00:16.034648 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024501 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 20:00:16.034648 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024504 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 20:00:16.034648 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024506 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 20:00:16.034648 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024509 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 20:00:16.034648 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024512 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 20:00:16.034648 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.024538 2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 03 20:00:16.035209 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024590 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 20:00:16.035209 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024595 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 20:00:16.035209 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024598 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 20:00:16.035209 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024601 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 20:00:16.035209 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024603 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 20:00:16.035209 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024606 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 20:00:16.035209 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024608 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 20:00:16.035209 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024611 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 20:00:16.035209 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024613 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 20:00:16.035209 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024616 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 20:00:16.035209 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024618 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 20:00:16.035209 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024621 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 20:00:16.035209 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024624 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 20:00:16.035209 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024628 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 20:00:16.035209 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024632 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 20:00:16.035209 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024635 2576 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 20:00:16.035209 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024637 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 20:00:16.035209 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024640 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 20:00:16.035209 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024642 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 20:00:16.035696 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024645 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 20:00:16.035696 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024647 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 20:00:16.035696 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024649 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 20:00:16.035696 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024652 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 20:00:16.035696 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024657 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 20:00:16.035696 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024661 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 20:00:16.035696 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024664 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 20:00:16.035696 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024667 2576 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 20:00:16.035696 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024670 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 20:00:16.035696 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024672 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 20:00:16.035696 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024675 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 20:00:16.035696 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024679 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 20:00:16.035696 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024681 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 20:00:16.035696 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024684 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 20:00:16.035696 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024686 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 20:00:16.035696 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024689 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 20:00:16.035696 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024691 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 20:00:16.035696 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024694 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 20:00:16.035696 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024696 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 20:00:16.036162 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024699 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 20:00:16.036162 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024701 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 20:00:16.036162 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024704 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 20:00:16.036162 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024707 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 20:00:16.036162 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024709 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 20:00:16.036162 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024712 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 20:00:16.036162 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024716 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 20:00:16.036162 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024718 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 20:00:16.036162 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024720 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 20:00:16.036162 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024723 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 20:00:16.036162 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024725 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 20:00:16.036162 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024728 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 20:00:16.036162 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024731 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 20:00:16.036162 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024733 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 20:00:16.036162 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024736 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 20:00:16.036162 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024738 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 20:00:16.036162 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024741 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 20:00:16.036162 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024743 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 20:00:16.036162 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024746 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 20:00:16.036614 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024748 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 20:00:16.036614 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024751 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 20:00:16.036614 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024753 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 20:00:16.036614 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024756 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 20:00:16.036614 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024759 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 20:00:16.036614 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024762 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 20:00:16.036614 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024765 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 20:00:16.036614 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024767 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 20:00:16.036614 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024769 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 20:00:16.036614 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024772 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 20:00:16.036614 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024774 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 20:00:16.036614 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024777 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 20:00:16.036614 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024779 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 20:00:16.036614 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024782 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 20:00:16.036614 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024784 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 20:00:16.036614 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024786 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 20:00:16.036614 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024789 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 20:00:16.036614 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024791 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 20:00:16.036614 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024794 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 20:00:16.036614 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024797 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 20:00:16.037061 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024800 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 20:00:16.037061 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024802 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 20:00:16.037061 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024805 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 20:00:16.037061 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024808 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 20:00:16.037061 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024810 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 20:00:16.037061 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024813 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 20:00:16.037061 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024815 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 20:00:16.037061 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024818 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 20:00:16.037061 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024820 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 20:00:16.037061 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024823 2576 feature_gate.go:386] unrecognized feature gate: Example Nov 03 20:00:16.037061 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024825 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 20:00:16.037061 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024828 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 20:00:16.037061 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024830 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 20:00:16.037061 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024833 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 20:00:16.037061 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024836 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 20:00:16.037061 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024838 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 20:00:16.037061 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024840 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 20:00:16.037061 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024844 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 20:00:16.037061 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024847 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 20:00:16.037061 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024849 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 20:00:16.037521 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024851 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 20:00:16.037521 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024854 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 20:00:16.037521 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024856 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 20:00:16.037521 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024858 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 20:00:16.037521 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024861 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 20:00:16.037521 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024863 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 20:00:16.037521 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024866 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 20:00:16.037521 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024868 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 20:00:16.037521 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.024871 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 20:00:16.037521 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.031064 2576 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Nov 03 20:00:16.037521 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.031083 2576 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Nov 03 20:00:16.037521 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.031527 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Nov 03 20:00:16.037521 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.031534 2576 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Nov 03 20:00:16.037521 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031609 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 20:00:16.037521 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031615 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 20:00:16.037521 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031619 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 20:00:16.037521 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031622 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 20:00:16.037521 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031626 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 20:00:16.037521 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031629 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 20:00:16.037521 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031632 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 20:00:16.037989 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031635 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 20:00:16.037989 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031638 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 20:00:16.037989 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031640 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 20:00:16.037989 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031643 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 20:00:16.037989 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031645 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 20:00:16.037989 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031649 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 20:00:16.037989 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031651 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 20:00:16.037989 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031654 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 20:00:16.037989 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031657 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 20:00:16.037989 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031659 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 20:00:16.037989 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031662 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 20:00:16.037989 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031664 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 20:00:16.037989 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031667 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 20:00:16.037989 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031670 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 20:00:16.037989 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031672 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 20:00:16.037989 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031675 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 20:00:16.037989 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031677 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 20:00:16.037989 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031680 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 20:00:16.037989 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031682 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 20:00:16.037989 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031685 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 20:00:16.038517 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031688 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 20:00:16.038517 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031691 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 20:00:16.038517 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031695 2576 feature_gate.go:386] unrecognized feature gate: Example Nov 03 20:00:16.038517 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031698 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 20:00:16.038517 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031700 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 20:00:16.038517 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031703 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 20:00:16.038517 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031706 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 20:00:16.038517 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031708 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 20:00:16.038517 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031711 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 20:00:16.038517 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031714 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 20:00:16.038517 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031716 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 20:00:16.038517 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031719 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 20:00:16.038517 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031722 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 20:00:16.038517 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031724 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 20:00:16.038517 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031727 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 20:00:16.038517 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031729 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 20:00:16.038517 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031731 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 20:00:16.038517 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031734 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 20:00:16.038517 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031737 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 20:00:16.038517 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031740 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 20:00:16.039057 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031742 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 20:00:16.039057 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031745 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 20:00:16.039057 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031747 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 20:00:16.039057 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031750 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 20:00:16.039057 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031752 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 20:00:16.039057 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031755 2576 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 20:00:16.039057 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031758 2576 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 20:00:16.039057 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031761 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 20:00:16.039057 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031763 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 20:00:16.039057 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031766 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 20:00:16.039057 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031768 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 20:00:16.039057 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031771 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 20:00:16.039057 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031774 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 20:00:16.039057 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031777 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 20:00:16.039057 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031781 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 20:00:16.039057 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031784 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 20:00:16.039057 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031787 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 20:00:16.039057 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031790 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 20:00:16.039057 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031792 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 20:00:16.039057 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031795 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 20:00:16.039654 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031798 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 20:00:16.039654 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031801 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 20:00:16.039654 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031803 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 20:00:16.039654 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031806 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 20:00:16.039654 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031808 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 20:00:16.039654 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031811 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 20:00:16.039654 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031813 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 20:00:16.039654 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031816 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 20:00:16.039654 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031819 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 20:00:16.039654 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031821 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 20:00:16.039654 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031824 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 20:00:16.039654 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031826 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 20:00:16.039654 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031831 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 20:00:16.039654 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031835 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 20:00:16.039654 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031839 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 20:00:16.039654 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031855 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 20:00:16.039654 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031858 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 20:00:16.039654 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031861 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 20:00:16.039654 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031864 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 20:00:16.040100 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031867 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 20:00:16.040100 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031870 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 20:00:16.040100 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031872 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 20:00:16.040100 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031874 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 20:00:16.040100 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031879 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 20:00:16.040100 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031882 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 20:00:16.040100 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031885 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 20:00:16.040100 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031888 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 20:00:16.040100 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031891 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 20:00:16.040100 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031894 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 20:00:16.040100 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031897 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 20:00:16.040100 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031900 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 20:00:16.040100 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031902 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 20:00:16.040100 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031905 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 20:00:16.040100 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031907 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 20:00:16.040100 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031910 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 20:00:16.040100 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031912 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 20:00:16.040100 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031914 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 20:00:16.040100 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031917 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 20:00:16.040535 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.031919 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 20:00:16.040535 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.031946 2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 03 20:00:16.040535 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032079 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 20:00:16.040535 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032083 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 20:00:16.040535 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032085 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 20:00:16.040535 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032088 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 20:00:16.040535 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032090 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 20:00:16.040535 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032093 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 20:00:16.040535 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032095 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 20:00:16.040535 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032098 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 20:00:16.040535 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032100 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 20:00:16.040535 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032103 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 20:00:16.040535 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032106 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 20:00:16.040535 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032108 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 20:00:16.040535 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032111 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 20:00:16.040535 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032113 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 20:00:16.040916 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032115 2576 feature_gate.go:386] unrecognized feature gate: Example Nov 03 20:00:16.040916 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032118 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 20:00:16.040916 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032120 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 20:00:16.040916 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032123 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 20:00:16.040916 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032126 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 20:00:16.040916 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032128 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 20:00:16.040916 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032130 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 20:00:16.040916 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032133 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 20:00:16.040916 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032136 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 20:00:16.040916 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032138 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 20:00:16.040916 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032141 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 20:00:16.040916 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032143 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 20:00:16.040916 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032146 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 20:00:16.040916 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032148 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 20:00:16.040916 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032151 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 20:00:16.040916 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032153 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 20:00:16.040916 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032155 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 20:00:16.040916 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032158 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 20:00:16.040916 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032160 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 20:00:16.040916 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032163 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 20:00:16.041379 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032165 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 20:00:16.041379 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032168 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 20:00:16.041379 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032170 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 20:00:16.041379 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032173 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 20:00:16.041379 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032175 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 20:00:16.041379 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032178 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 20:00:16.041379 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032180 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 20:00:16.041379 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032182 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 20:00:16.041379 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032185 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 20:00:16.041379 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032188 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 20:00:16.041379 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032190 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 20:00:16.041379 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032192 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 20:00:16.041379 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032195 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 20:00:16.041379 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032197 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 20:00:16.041379 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032200 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 20:00:16.041379 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032202 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 20:00:16.041379 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032205 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 20:00:16.041379 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032207 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 20:00:16.041379 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032210 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 20:00:16.041379 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032212 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 20:00:16.041886 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032215 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 20:00:16.041886 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032218 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 20:00:16.041886 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032220 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 20:00:16.041886 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032223 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 20:00:16.041886 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032226 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 20:00:16.041886 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032228 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 20:00:16.041886 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032231 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 20:00:16.041886 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032233 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 20:00:16.041886 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032235 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 20:00:16.041886 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032238 2576 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 20:00:16.041886 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032240 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 20:00:16.041886 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032243 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 20:00:16.041886 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032245 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 20:00:16.041886 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032247 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 20:00:16.041886 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032250 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 20:00:16.041886 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032252 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 20:00:16.041886 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032255 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 20:00:16.041886 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032257 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 20:00:16.041886 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032259 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 20:00:16.042327 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032262 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 20:00:16.042327 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032264 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 20:00:16.042327 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032267 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 20:00:16.042327 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032269 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 20:00:16.042327 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032272 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 20:00:16.042327 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032274 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 20:00:16.042327 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032277 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 20:00:16.042327 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032279 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 20:00:16.042327 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032282 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 20:00:16.042327 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032285 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 20:00:16.042327 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032287 2576 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 20:00:16.042327 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032289 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 20:00:16.042327 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032292 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 20:00:16.042327 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032294 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 20:00:16.042327 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032297 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 20:00:16.042327 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032300 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 20:00:16.042327 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032302 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 20:00:16.042327 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032305 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 20:00:16.042327 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032307 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 20:00:16.042908 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032309 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 20:00:16.042908 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032312 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 20:00:16.042908 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032314 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 20:00:16.042908 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032317 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 20:00:16.042908 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032320 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 20:00:16.042908 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032323 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 20:00:16.042908 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032326 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 20:00:16.042908 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032329 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 20:00:16.042908 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032331 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 20:00:16.042908 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032334 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 20:00:16.042908 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032336 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 20:00:16.042908 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032340 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 20:00:16.042908 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032344 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 20:00:16.042908 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032347 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 20:00:16.042908 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.032370 2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 03 20:00:16.047496 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032400 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 20:00:16.047496 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032404 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 20:00:16.047496 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032407 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 20:00:16.047496 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032409 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 20:00:16.047496 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032411 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 20:00:16.047496 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032414 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 20:00:16.047496 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032416 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 20:00:16.047496 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032419 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 20:00:16.047496 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032421 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 20:00:16.047496 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032423 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 20:00:16.047496 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032426 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 20:00:16.047496 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032428 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 20:00:16.047496 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032430 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 20:00:16.047496 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032434 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 20:00:16.047496 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032436 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 20:00:16.047496 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032439 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 20:00:16.047496 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032442 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 20:00:16.047496 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032444 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 20:00:16.047496 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032447 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 20:00:16.047496 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032449 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 20:00:16.048045 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032451 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 20:00:16.048045 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032454 2576 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 20:00:16.048045 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032456 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 20:00:16.048045 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032459 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 20:00:16.048045 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032461 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 20:00:16.048045 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032463 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 20:00:16.048045 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032466 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 20:00:16.048045 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032468 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 20:00:16.048045 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032471 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 20:00:16.048045 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032473 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 20:00:16.048045 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032476 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 20:00:16.048045 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032478 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 20:00:16.048045 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032481 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 20:00:16.048045 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032483 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 20:00:16.048045 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032486 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 20:00:16.048045 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032489 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 20:00:16.048045 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032491 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 20:00:16.048045 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032493 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 20:00:16.048045 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032496 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 20:00:16.048509 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032498 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 20:00:16.048509 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032501 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 20:00:16.048509 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032504 2576 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 20:00:16.048509 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032506 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 20:00:16.048509 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032509 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 20:00:16.048509 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032512 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 20:00:16.048509 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032514 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 20:00:16.048509 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032517 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 20:00:16.048509 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032519 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 20:00:16.048509 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032522 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 20:00:16.048509 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032524 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 20:00:16.048509 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032526 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 20:00:16.048509 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032529 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 20:00:16.048509 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032531 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 20:00:16.048509 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032534 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 20:00:16.048509 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032536 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 20:00:16.048509 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032540 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 20:00:16.048509 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032544 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 20:00:16.048509 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032546 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 20:00:16.049010 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032549 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 20:00:16.049010 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032551 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 20:00:16.049010 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032554 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 20:00:16.049010 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032576 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 20:00:16.049010 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032581 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 20:00:16.049010 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032585 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 20:00:16.049010 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032588 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 20:00:16.049010 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032591 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 20:00:16.049010 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032594 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 20:00:16.049010 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032596 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 20:00:16.049010 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032599 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 20:00:16.049010 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032601 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 20:00:16.049010 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032604 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 20:00:16.049010 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032607 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 20:00:16.049010 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032610 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 20:00:16.049010 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032613 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 20:00:16.049010 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032615 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 20:00:16.049010 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032618 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 20:00:16.049010 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032620 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 20:00:16.049498 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032623 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 20:00:16.049498 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032625 2576 feature_gate.go:386] unrecognized feature gate: Example Nov 03 20:00:16.049498 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032628 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 20:00:16.049498 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032631 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 20:00:16.049498 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032633 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 20:00:16.049498 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032636 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 20:00:16.049498 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032639 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 20:00:16.049498 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032641 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 20:00:16.049498 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032644 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 20:00:16.049498 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032646 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 20:00:16.049498 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032649 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 20:00:16.049498 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032651 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 20:00:16.049498 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032653 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 20:00:16.049498 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032656 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 20:00:16.049498 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032658 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 20:00:16.049498 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032661 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 20:00:16.049498 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032665 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 20:00:16.049498 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032668 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 20:00:16.049498 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032670 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 20:00:16.049498 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032673 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 20:00:16.050058 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032676 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 20:00:16.050058 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032678 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 20:00:16.050058 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032681 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 20:00:16.050058 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032683 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 20:00:16.050058 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032686 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 20:00:16.050058 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032688 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 20:00:16.050058 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032691 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 20:00:16.050058 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032693 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 20:00:16.050058 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:16.032696 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 20:00:16.050058 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.032754 2576 server.go:957] "Client rotation is on, will bootstrap in background" Nov 03 20:00:16.050058 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.035546 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Nov 03 20:00:16.050058 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.036347 2576 server.go:1014] "Starting client certificate rotation" Nov 03 20:00:16.050058 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.036434 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 03 20:00:16.050058 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.037230 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 03 20:00:16.050058 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.038223 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 03 20:00:16.050058 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.039391 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 03 20:00:16.050058 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.049483 2576 log.go:25] "Validated CRI v1 runtime API" Nov 03 20:00:16.052980 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.052966 2576 log.go:25] "Validated CRI v1 image API" Nov 03 20:00:16.053809 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.053790 2576 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Nov 03 20:00:16.056192 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.056175 2576 fs.go:135] Filesystem UUIDs: map[0b185b55-70d0-4102-9780-420d17256b2f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 dd108ab3-dc06-45e9-a3ab-f8d530283a8e:/dev/nvme0n1p4] Nov 03 20:00:16.056234 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.056193 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}] Nov 03 20:00:16.061969 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.061866 2576 manager.go:217] Machine: {Timestamp:2026-11-03 20:00:16.060613087 +0000 UTC m=+0.302479872 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3135817 MemoryCapacity:32812015616 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec245ddc95d37a0f4360bcdf65533234 SystemUUID:ec245ddc-95d3-7a0f-4360-bcdf65533234 BootID:78a55a2e-ac34-4873-ae49-586768f24217 Filesystems:[{Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406007808 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:03:44:1e:84:67 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:03:44:1e:84:67 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:ee:2f:70:dc:af Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812015616 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Nov 03 20:00:16.061969 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.061970 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Nov 03 20:00:16.062071 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.062042 2576 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Nov 03 20:00:16.063992 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.063966 2576 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Nov 03 20:00:16.064118 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.063994 2576 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-181.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Nov 03 20:00:16.064158 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.064120 2576 topology_manager.go:143] "Creating topology manager with none policy" Nov 03 20:00:16.064158 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.064128 2576 container_manager_linux.go:311] "Creating device plugin manager" Nov 03 20:00:16.064158 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.064149 2576 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 03 20:00:16.064230 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.064162 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 03 20:00:16.064801 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.064792 2576 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Nov 03 20:00:16.068264 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.068252 2576 state_mem.go:41] "Initialized" logger="CPUManager state memory" Nov 03 20:00:16.068391 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.068382 2576 server.go:1235] "Using root directory" path="/var/lib/kubelet" Nov 03 20:00:16.068965 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.068955 2576 kubelet.go:493] "Attempting to sync node with API server" Nov 03 20:00:16.068995 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.068968 2576 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Nov 03 20:00:16.068995 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.068977 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Nov 03 20:00:16.068995 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.068986 2576 kubelet.go:405] "Adding apiserver pod source" Nov 03 20:00:16.068995 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.068994 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Nov 03 20:00:16.069388 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.069355 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 03 20:00:16.071384 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.071352 2576 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Nov 03 20:00:16.077449 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.077430 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 03 20:00:16.078187 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.078174 2576 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Nov 03 20:00:16.078230 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.078204 2576 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Nov 03 20:00:16.078356 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.078347 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Nov 03 20:00:16.078391 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.078361 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Nov 03 20:00:16.078391 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.078367 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Nov 03 20:00:16.078391 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.078373 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Nov 03 20:00:16.078391 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.078378 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Nov 03 20:00:16.078391 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.078385 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Nov 03 20:00:16.079298 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.079289 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Nov 03 20:00:16.079298 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.079299 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Nov 03 20:00:16.079359 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.079306 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Nov 03 20:00:16.079359 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.079312 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Nov 03 20:00:16.079359 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.079320 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Nov 03 20:00:16.079359 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.079329 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Nov 03 20:00:16.080597 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.080588 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Nov 03 20:00:16.080597 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.080597 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Nov 03 20:00:16.084225 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.084214 2576 server.go:1263] "Started kubelet" Nov 03 20:00:16.084338 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.084292 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Nov 03 20:00:16.084389 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.084360 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Nov 03 20:00:16.084438 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.084313 2576 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Nov 03 20:00:16.084926 ip-10-0-140-181 systemd[1]: Started Kubernetes Kubelet. Nov 03 20:00:16.085629 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.085470 2576 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Nov 03 20:00:16.086693 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.086677 2576 server.go:317] "Adding debug handlers to kubelet server" Nov 03 20:00:16.090670 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:16.090652 2576 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Nov 03 20:00:16.092079 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.092061 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Nov 03 20:00:16.092635 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.092622 2576 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Nov 03 20:00:16.092734 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:16.092717 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-181.us-west-1.compute.internal\" not found" Nov 03 20:00:16.093308 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.093286 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Nov 03 20:00:16.093308 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.093286 2576 volume_manager.go:309] "The desired_state_of_world populator starts" Nov 03 20:00:16.093430 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.093318 2576 volume_manager.go:311] "Starting Kubelet Volume Manager" Nov 03 20:00:16.093430 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.093372 2576 factory.go:55] Registering systemd factory Nov 03 20:00:16.093430 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.093385 2576 factory.go:223] Registration of the systemd container factory successfully Nov 03 20:00:16.093581 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.093450 2576 reconstruct.go:97] "Volume reconstruction finished" Nov 03 20:00:16.093581 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.093488 2576 reconciler.go:29] "Reconciler: start to sync state" Nov 03 20:00:16.093664 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.093603 2576 factory.go:153] Registering CRI-O factory Nov 03 20:00:16.093664 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.093612 2576 factory.go:223] Registration of the crio container factory successfully Nov 03 20:00:16.093664 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.093656 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Nov 03 20:00:16.093758 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.093689 2576 factory.go:103] Registering Raw factory Nov 03 20:00:16.093758 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.093709 2576 manager.go:1199] Started watching for new ooms in manager Nov 03 20:00:16.094661 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.094641 2576 manager.go:319] Starting recovery of all containers Nov 03 20:00:16.102886 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.102843 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Nov 03 20:00:16.105037 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.104936 2576 manager.go:324] Recovery completed Nov 03 20:00:16.111308 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.111292 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 20:00:16.112883 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.112859 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-181.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 20:00:16.112960 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.112899 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-181.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 20:00:16.112960 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.112914 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-181.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 20:00:16.113445 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.113433 2576 cpu_manager.go:226] "Starting" policy="none" Nov 03 20:00:16.113445 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.113444 2576 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Nov 03 20:00:16.113546 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.113459 2576 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Nov 03 20:00:16.113546 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.113437 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 20:00:16.114212 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.114195 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-181.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 20:00:16.114290 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.114224 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-181.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 20:00:16.114290 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.114234 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-181.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 20:00:16.115653 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.115641 2576 policy_none.go:50] "Start" Nov 03 20:00:16.115700 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.115657 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Nov 03 20:00:16.115700 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.115667 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Nov 03 20:00:16.117605 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.117595 2576 policy_none.go:44] "Start" Nov 03 20:00:16.178824 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.164213 2576 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Nov 03 20:00:16.178824 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.169950 2576 manager.go:341] "Starting Device Plugin manager" Nov 03 20:00:16.178824 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:16.170485 2576 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Nov 03 20:00:16.178824 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.170503 2576 server.go:87] "Starting device plugin registration server" Nov 03 20:00:16.178824 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.170777 2576 eviction_manager.go:194] "Eviction manager: starting control loop" Nov 03 20:00:16.178824 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.170788 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Nov 03 20:00:16.178824 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.171012 2576 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Nov 03 20:00:16.178824 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.171120 2576 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Nov 03 20:00:16.178824 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.171129 2576 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Nov 03 20:00:16.178824 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:16.171783 2576 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Nov 03 20:00:16.178824 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:16.171836 2576 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-181.us-west-1.compute.internal\" not found" Nov 03 20:00:16.178824 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.173525 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Nov 03 20:00:16.178824 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.173547 2576 status_manager.go:249] "Starting to sync pod status with apiserver" Nov 03 20:00:16.178824 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.173586 2576 kubelet.go:2521] "Starting kubelet main sync loop" Nov 03 20:00:16.178824 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:16.173621 2576 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Nov 03 20:00:16.234379 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:16.234348 2576 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-181.us-west-1.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Nov 03 20:00:16.235428 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:16.234330 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-181.us-west-1.compute.internal.18e4a1672b85b63f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-181.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-181.us-west-1.compute.internal,},FirstTimestamp:2026-11-03 20:00:16.084186687 +0000 UTC m=+0.326053469,LastTimestamp:2026-11-03 20:00:16.084186687 +0000 UTC m=+0.326053469,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-181.us-west-1.compute.internal,}" Nov 03 20:00:16.270912 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.270853 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 20:00:16.271828 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.271812 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-181.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 20:00:16.271918 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.271853 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-181.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 20:00:16.271918 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.271864 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-181.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 20:00:16.271918 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.271889 2576 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:00:16.275172 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.275138 2576 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-181.us-west-1.compute.internal"] Nov 03 20:00:16.275315 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.275218 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 20:00:16.276085 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.276070 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-181.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 20:00:16.276153 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.276097 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-181.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 20:00:16.276153 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.276109 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-181.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 20:00:16.278295 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.278282 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 20:00:16.278448 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.278435 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:00:16.278491 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.278461 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 20:00:16.279103 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.279079 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-181.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 20:00:16.279185 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.279108 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-181.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 20:00:16.279185 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.279111 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-181.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 20:00:16.279185 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.279124 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-181.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 20:00:16.279185 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.279139 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-181.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 20:00:16.279185 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.279152 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-181.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 20:00:16.281199 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.281183 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:00:16.281276 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.281212 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 20:00:16.282037 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.282015 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-181.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 20:00:16.282106 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.282041 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-181.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 20:00:16.282106 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.282053 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-181.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 20:00:16.282717 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.282689 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-181.us-west-1.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Nov 03 20:00:16.324200 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:16.324183 2576 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-181.us-west-1.compute.internal\" not found" node="ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:00:16.326909 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:16.326892 2576 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-181.us-west-1.compute.internal\" not found" node="ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:00:16.331972 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:16.331883 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-181.us-west-1.compute.internal.18e4a1672d3b9516 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-181.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-181.us-west-1.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-181.us-west-1.compute.internal,},FirstTimestamp:2026-11-03 20:00:16.112882966 +0000 UTC m=+0.354749749,LastTimestamp:2026-11-03 20:00:16.112882966 +0000 UTC m=+0.354749749,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-181.us-west-1.compute.internal,}" Nov 03 20:00:16.332268 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:16.332247 2576 reflector.go:204] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" Nov 03 20:00:16.332312 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:16.332247 2576 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-181.us-west-1.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node" Nov 03 20:00:16.359471 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.359452 2576 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Nov 03 20:00:16.359537 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.359515 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pdkzb" Nov 03 20:00:16.393990 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.393957 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d77c2e2c27eea566b26a98b807b65f3e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal\" (UID: \"d77c2e2c27eea566b26a98b807b65f3e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:00:16.394070 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.393994 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d77c2e2c27eea566b26a98b807b65f3e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal\" (UID: \"d77c2e2c27eea566b26a98b807b65f3e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:00:16.394070 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:16.393959 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-181.us-west-1.compute.internal.18e4a1672d3bee80 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-181.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-181.us-west-1.compute.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-181.us-west-1.compute.internal,},FirstTimestamp:2026-11-03 20:00:16.112905856 +0000 UTC m=+0.354772637,LastTimestamp:2026-11-03 20:00:16.112905856 +0000 UTC m=+0.354772637,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-181.us-west-1.compute.internal,}" Nov 03 20:00:16.394070 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.394038 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7433a56a703a69a62fac958fa017ce29-config\") pod \"kube-apiserver-proxy-ip-10-0-140-181.us-west-1.compute.internal\" (UID: \"7433a56a703a69a62fac958fa017ce29\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:00:16.394201 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:16.394101 2576 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" Nov 03 20:00:16.394201 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:16.394160 2576 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" Nov 03 20:00:16.394293 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:16.394279 2576 kubelet_node_status.go:115] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-140-181.us-west-1.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:00:16.495109 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.495086 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d77c2e2c27eea566b26a98b807b65f3e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal\" (UID: \"d77c2e2c27eea566b26a98b807b65f3e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:00:16.495198 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.495112 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d77c2e2c27eea566b26a98b807b65f3e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal\" (UID: \"d77c2e2c27eea566b26a98b807b65f3e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:00:16.495198 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.495129 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7433a56a703a69a62fac958fa017ce29-config\") pod \"kube-apiserver-proxy-ip-10-0-140-181.us-west-1.compute.internal\" (UID: \"7433a56a703a69a62fac958fa017ce29\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:00:16.495198 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.495173 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7433a56a703a69a62fac958fa017ce29-config\") pod \"kube-apiserver-proxy-ip-10-0-140-181.us-west-1.compute.internal\" (UID: \"7433a56a703a69a62fac958fa017ce29\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:00:16.495198 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.495183 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d77c2e2c27eea566b26a98b807b65f3e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal\" (UID: \"d77c2e2c27eea566b26a98b807b65f3e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:00:16.495336 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.495205 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d77c2e2c27eea566b26a98b807b65f3e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal\" (UID: \"d77c2e2c27eea566b26a98b807b65f3e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:00:16.542119 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:16.542074 2576 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-181.us-west-1.compute.internal\" not found" node="ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:00:16.594929 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.594911 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 20:00:16.595886 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.595871 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-181.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 20:00:16.595952 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.595912 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-181.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 20:00:16.595952 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.595927 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-181.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 20:00:16.596013 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.595977 2576 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:00:16.627607 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.627555 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:00:16.633104 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.632455 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:00:16.651217 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:16.651202 2576 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:00:16.651294 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:16.651223 2576 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-181.us-west-1.compute.internal\": node \"ip-10-0-140-181.us-west-1.compute.internal\" not found" Nov 03 20:00:16.769814 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:16.769777 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-181.us-west-1.compute.internal\" not found" Nov 03 20:00:16.870875 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:16.870803 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-181.us-west-1.compute.internal\" not found" Nov 03 20:00:16.971892 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:16.971862 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-181.us-west-1.compute.internal\" not found" Nov 03 20:00:17.036173 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:17.036149 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Nov 03 20:00:17.036749 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:17.036290 2576 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://a295bc2c6542f4b488dcdf284527d8bd-cfb3317acbd8a81f.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-140-181.us-west-1.compute.internal.18e4a1672d3c26f3\": read tcp 10.0.140.181:47002->3.14.178.171:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-140-181.us-west-1.compute.internal.18e4a1672d3c26f3 default 5199 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-181.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-181.us-west-1.compute.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-181.us-west-1.compute.internal,},FirstTimestamp:2026-11-03 20:00:16 +0000 UTC,LastTimestamp:2026-11-03 20:00:16.271868502 +0000 UTC m=+0.513735283,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-181.us-west-1.compute.internal,}" Nov 03 20:00:17.072629 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:17.072609 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-181.us-west-1.compute.internal\" not found" Nov 03 20:00:17.173333 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:17.173255 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-181.us-west-1.compute.internal\" not found" Nov 03 20:00:17.273688 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:17.273651 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-181.us-west-1.compute.internal\" not found" Nov 03 20:00:17.346709 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:17.346676 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 20:00:17.347748 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:17.347734 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-181.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 20:00:17.347841 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:17.347762 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-181.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 20:00:17.347841 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:17.347772 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-181.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 20:00:17.365412 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:17.365350 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-02 19:55:17 +0000 UTC" deadline="2028-08-08 08:17:41.811696764 +0000 UTC" Nov 03 20:00:17.365412 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:17.365409 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15444h17m24.44629528s" Nov 03 20:00:17.374073 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:17.374053 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-181.us-west-1.compute.internal\" not found" Nov 03 20:00:17.447183 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:17.447120 2576 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 20:00:17.448149 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:17.448133 2576 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 20:00:17.474903 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:17.474873 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-181.us-west-1.compute.internal\" not found" Nov 03 20:00:17.575957 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:17.575934 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-181.us-west-1.compute.internal\" not found" Nov 03 20:00:17.677035 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:17.676993 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-181.us-west-1.compute.internal\" not found" Nov 03 20:00:17.730275 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:17.730238 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd77c2e2c27eea566b26a98b807b65f3e.slice/crio-2f19ee96e0cda5bba4e76a755fc521e9115b493710767b7674583d6b887d66c4 WatchSource:0}: Error finding container 2f19ee96e0cda5bba4e76a755fc521e9115b493710767b7674583d6b887d66c4: Status 404 returned error can't find the container with id 2f19ee96e0cda5bba4e76a755fc521e9115b493710767b7674583d6b887d66c4 Nov 03 20:00:17.730579 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:17.730546 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7433a56a703a69a62fac958fa017ce29.slice/crio-7adef30e25b1d1a6858159dabdbd1786206e26ef92977685375acffd3caa2053 WatchSource:0}: Error finding container 7adef30e25b1d1a6858159dabdbd1786206e26ef92977685375acffd3caa2053: Status 404 returned error can't find the container with id 7adef30e25b1d1a6858159dabdbd1786206e26ef92977685375acffd3caa2053 Nov 03 20:00:17.736073 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:17.736057 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 03 20:00:17.777753 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:17.777715 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-181.us-west-1.compute.internal\" not found" Nov 03 20:00:17.878054 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:17.878023 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-181.us-west-1.compute.internal\" not found" Nov 03 20:00:17.885936 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:17.885913 2576 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 20:00:17.934662 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:17.934641 2576 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 20:00:17.993823 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:17.993766 2576 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:00:18.057053 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.057032 2576 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 03 20:00:18.057975 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.057959 2576 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:00:18.070184 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.070167 2576 apiserver.go:52] "Watching apiserver" Nov 03 20:00:18.093170 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.093137 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Nov 03 20:00:18.117373 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.117356 2576 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 03 20:00:18.177876 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.177859 2576 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Nov 03 20:00:18.178332 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.178305 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-v224g","openshift-network-diagnostics/network-check-target-x5gxd","kube-system/global-pull-secret-syncer-wz99q","kube-system/konnectivity-agent-xgdct","openshift-image-registry/node-ca-ts79p","openshift-multus/multus-additional-cni-plugins-t5q7f","openshift-ovn-kubernetes/ovnkube-node-7246c","kube-system/kube-apiserver-proxy-ip-10-0-140-181.us-west-1.compute.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9","openshift-dns/node-resolver-8t9mw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal","openshift-multus/multus-sjn97","openshift-multus/network-metrics-daemon-pslv9","openshift-network-operator/iptables-alerter-crqkf"] Nov 03 20:00:18.182662 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.182635 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.184959 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.184942 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:00:18.185043 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:18.185011 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pslv9" podUID="aae6331f-1f9f-43c8-9610-f554ddebf2e3" Nov 03 20:00:18.187478 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.187463 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:00:18.187559 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:18.187509 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wz99q" podUID="30329c02-c760-48d5-86f7-dd265325adb0" Nov 03 20:00:18.190152 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.190134 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xgdct" Nov 03 20:00:18.192428 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.192413 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ts79p" Nov 03 20:00:18.194928 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.194908 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:00:18.197232 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.197212 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:00:18.199666 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.199651 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.202042 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.202021 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:00:18.202138 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:18.202082 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5gxd" podUID="5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2" Nov 03 20:00:18.204471 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.204455 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8t9mw" Nov 03 20:00:18.205480 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.205461 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-var-lib-openvswitch\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.205572 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.205489 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-cni-bin\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.205572 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.205541 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-ovnkube-config\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.205572 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.205567 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwhj2\" (UniqueName: \"kubernetes.io/projected/aae6331f-1f9f-43c8-9610-f554ddebf2e3-kube-api-access-nwhj2\") pod \"network-metrics-daemon-pslv9\" (UID: \"aae6331f-1f9f-43c8-9610-f554ddebf2e3\") " pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:00:18.205727 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.205610 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-kubelet\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.205727 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.205705 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/98448491-e429-4d6f-a50a-7cb104997edf-konnectivity-ca\") pod \"konnectivity-agent-xgdct\" (UID: \"98448491-e429-4d6f-a50a-7cb104997edf\") " pod="kube-system/konnectivity-agent-xgdct" Nov 03 20:00:18.205824 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.205733 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a445b335-dfaf-41a2-afb5-e9ee45ec471f-cni-binary-copy\") pod \"multus-additional-cni-plugins-t5q7f\" (UID: \"a445b335-dfaf-41a2-afb5-e9ee45ec471f\") " pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:00:18.205824 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.205755 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a445b335-dfaf-41a2-afb5-e9ee45ec471f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t5q7f\" (UID: \"a445b335-dfaf-41a2-afb5-e9ee45ec471f\") " pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:00:18.205824 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.205799 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7rwr\" (UniqueName: \"kubernetes.io/projected/a445b335-dfaf-41a2-afb5-e9ee45ec471f-kube-api-access-t7rwr\") pod \"multus-additional-cni-plugins-t5q7f\" (UID: \"a445b335-dfaf-41a2-afb5-e9ee45ec471f\") " pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:00:18.205951 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.205831 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-slash\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.205951 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.205855 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-run-netns\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.205951 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.205889 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/98448491-e429-4d6f-a50a-7cb104997edf-agent-certs\") pod \"konnectivity-agent-xgdct\" (UID: \"98448491-e429-4d6f-a50a-7cb104997edf\") " pod="kube-system/konnectivity-agent-xgdct" Nov 03 20:00:18.205951 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.205919 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a445b335-dfaf-41a2-afb5-e9ee45ec471f-system-cni-dir\") pod \"multus-additional-cni-plugins-t5q7f\" (UID: \"a445b335-dfaf-41a2-afb5-e9ee45ec471f\") " pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:00:18.205951 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.205947 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a445b335-dfaf-41a2-afb5-e9ee45ec471f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t5q7f\" (UID: \"a445b335-dfaf-41a2-afb5-e9ee45ec471f\") " pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:00:18.206170 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.205997 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/30329c02-c760-48d5-86f7-dd265325adb0-kubelet-config\") pod \"global-pull-secret-syncer-wz99q\" (UID: \"30329c02-c760-48d5-86f7-dd265325adb0\") " pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:00:18.206170 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.206026 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-node-log\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.206170 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.206058 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-log-socket\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.206170 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.206080 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-cni-netd\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.206170 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.206149 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a445b335-dfaf-41a2-afb5-e9ee45ec471f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t5q7f\" (UID: \"a445b335-dfaf-41a2-afb5-e9ee45ec471f\") " pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:00:18.206419 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.206189 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-systemd-units\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.206419 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.206221 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-env-overrides\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.206419 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.206267 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-ovn-node-metrics-cert\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.206419 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.206314 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsxkj\" (UniqueName: \"kubernetes.io/projected/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-kube-api-access-fsxkj\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.206419 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.206342 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3-serviceca\") pod \"node-ca-ts79p\" (UID: \"2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3\") " pod="openshift-image-registry/node-ca-ts79p" Nov 03 20:00:18.206419 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.206365 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-run-systemd\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.206419 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.206393 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-etc-openvswitch\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.206714 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.206452 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-run-openvswitch\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.206714 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.206501 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-run-ovn-kubernetes\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.206714 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.206541 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.206714 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.206571 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-ovnkube-script-lib\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.206714 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.206623 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aae6331f-1f9f-43c8-9610-f554ddebf2e3-metrics-certs\") pod \"network-metrics-daemon-pslv9\" (UID: \"aae6331f-1f9f-43c8-9610-f554ddebf2e3\") " pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:00:18.206714 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.206646 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/30329c02-c760-48d5-86f7-dd265325adb0-dbus\") pod \"global-pull-secret-syncer-wz99q\" (UID: \"30329c02-c760-48d5-86f7-dd265325adb0\") " pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:00:18.206714 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.206688 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-run-ovn\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.206992 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.206723 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30329c02-c760-48d5-86f7-dd265325adb0-original-pull-secret\") pod \"global-pull-secret-syncer-wz99q\" (UID: \"30329c02-c760-48d5-86f7-dd265325adb0\") " pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:00:18.206992 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.206748 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3-host\") pod \"node-ca-ts79p\" (UID: \"2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3\") " pod="openshift-image-registry/node-ca-ts79p" Nov 03 20:00:18.206992 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.206796 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p6cc\" (UniqueName: \"kubernetes.io/projected/2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3-kube-api-access-9p6cc\") pod \"node-ca-ts79p\" (UID: \"2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3\") " pod="openshift-image-registry/node-ca-ts79p" Nov 03 20:00:18.206992 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.206832 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a445b335-dfaf-41a2-afb5-e9ee45ec471f-cnibin\") pod \"multus-additional-cni-plugins-t5q7f\" (UID: \"a445b335-dfaf-41a2-afb5-e9ee45ec471f\") " pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:00:18.206992 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.206953 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-crqkf" Nov 03 20:00:18.209471 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.209422 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-181.us-west-1.compute.internal" event={"ID":"7433a56a703a69a62fac958fa017ce29","Type":"ContainerStarted","Data":"7adef30e25b1d1a6858159dabdbd1786206e26ef92977685375acffd3caa2053"} Nov 03 20:00:18.209550 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.209486 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal" event={"ID":"d77c2e2c27eea566b26a98b807b65f3e","Type":"ContainerStarted","Data":"2f19ee96e0cda5bba4e76a755fc521e9115b493710767b7674583d6b887d66c4"} Nov 03 20:00:18.209550 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.209525 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.240864 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.240837 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Nov 03 20:00:18.240974 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.240938 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Nov 03 20:00:18.240974 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.240962 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Nov 03 20:00:18.241070 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.241054 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Nov 03 20:00:18.241187 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.241086 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Nov 03 20:00:18.241187 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.241131 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-nw9hw\"" Nov 03 20:00:18.241270 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.241221 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Nov 03 20:00:18.247848 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.247800 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-h5q7m\"" Nov 03 20:00:18.247848 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.247803 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Nov 03 20:00:18.247848 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.247832 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Nov 03 20:00:18.249806 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.249791 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Nov 03 20:00:18.250080 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.250066 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fddp8\"" Nov 03 20:00:18.250080 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.250074 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Nov 03 20:00:18.250184 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.250172 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Nov 03 20:00:18.252157 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.252144 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Nov 03 20:00:18.252525 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.252510 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Nov 03 20:00:18.252567 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.252532 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Nov 03 20:00:18.252567 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.252556 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lnw8t\"" Nov 03 20:00:18.252758 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.252744 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Nov 03 20:00:18.252807 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.252749 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Nov 03 20:00:18.254703 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.254690 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Nov 03 20:00:18.254826 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.254814 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Nov 03 20:00:18.254903 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.254888 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-q62cb\"" Nov 03 20:00:18.254903 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.254894 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Nov 03 20:00:18.257059 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.257047 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Nov 03 20:00:18.257395 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.257382 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zzr9t\"" Nov 03 20:00:18.257438 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.257414 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Nov 03 20:00:18.294306 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.294277 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Nov 03 20:00:18.308101 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.308075 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-systemd-units\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.308211 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.308107 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-env-overrides\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.308211 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.308136 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-ovn-node-metrics-cert\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.308211 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.308163 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsxkj\" (UniqueName: \"kubernetes.io/projected/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-kube-api-access-fsxkj\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.308211 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.308196 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/84404c7a-cc47-4e08-861b-a3b417f17e18-sys-fs\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:00:18.308211 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.308197 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-systemd-units\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.308450 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.308254 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-multus-conf-dir\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.308450 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.308273 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-etc-kubernetes\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.308450 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.308290 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-run-systemd\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.308450 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.308310 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-etc-openvswitch\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.308450 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.308334 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-run-ovn-kubernetes\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.308450 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.308387 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aae6331f-1f9f-43c8-9610-f554ddebf2e3-metrics-certs\") pod \"network-metrics-daemon-pslv9\" (UID: \"aae6331f-1f9f-43c8-9610-f554ddebf2e3\") " pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:00:18.308450 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.308398 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-run-ovn-kubernetes\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.308792 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.308465 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-etc-openvswitch\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.308792 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.308482 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3-host\") pod \"node-ca-ts79p\" (UID: \"2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3\") " pod="openshift-image-registry/node-ca-ts79p" Nov 03 20:00:18.308792 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.308486 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-run-systemd\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.308792 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:18.308496 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 20:00:18.308792 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.308531 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3-host\") pod \"node-ca-ts79p\" (UID: \"2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3\") " pod="openshift-image-registry/node-ca-ts79p" Nov 03 20:00:18.308792 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.308522 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879-iptables-alerter-script\") pod \"iptables-alerter-crqkf\" (UID: \"b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879\") " pod="openshift-network-operator/iptables-alerter-crqkf" Nov 03 20:00:18.308792 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:18.308576 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aae6331f-1f9f-43c8-9610-f554ddebf2e3-metrics-certs podName:aae6331f-1f9f-43c8-9610-f554ddebf2e3 nodeName:}" failed. No retries permitted until 2026-11-03 20:00:18.808553852 +0000 UTC m=+3.050420642 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aae6331f-1f9f-43c8-9610-f554ddebf2e3-metrics-certs") pod "network-metrics-daemon-pslv9" (UID: "aae6331f-1f9f-43c8-9610-f554ddebf2e3") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 20:00:18.308792 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.308620 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-tuned\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.308792 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.308576 2576 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Nov 03 20:00:18.308792 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.308644 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a445b335-dfaf-41a2-afb5-e9ee45ec471f-cnibin\") pod \"multus-additional-cni-plugins-t5q7f\" (UID: \"a445b335-dfaf-41a2-afb5-e9ee45ec471f\") " pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:00:18.308792 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.308674 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/84404c7a-cc47-4e08-861b-a3b417f17e18-device-dir\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:00:18.308792 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.308692 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-ovnkube-config\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.308792 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.308720 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwhj2\" (UniqueName: \"kubernetes.io/projected/aae6331f-1f9f-43c8-9610-f554ddebf2e3-kube-api-access-nwhj2\") pod \"network-metrics-daemon-pslv9\" (UID: \"aae6331f-1f9f-43c8-9610-f554ddebf2e3\") " pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:00:18.308792 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.308729 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-env-overrides\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.308792 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.308738 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-cnibin\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.308792 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.308745 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a445b335-dfaf-41a2-afb5-e9ee45ec471f-cnibin\") pod \"multus-additional-cni-plugins-t5q7f\" (UID: \"a445b335-dfaf-41a2-afb5-e9ee45ec471f\") " pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:00:18.308792 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.308764 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a445b335-dfaf-41a2-afb5-e9ee45ec471f-cni-binary-copy\") pod \"multus-additional-cni-plugins-t5q7f\" (UID: \"a445b335-dfaf-41a2-afb5-e9ee45ec471f\") " pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:00:18.309539 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.308792 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-sysconfig\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.309539 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.308879 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-systemd\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.309539 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.308904 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-host-run-netns\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.309539 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.308930 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-host-var-lib-cni-bin\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.309539 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.308962 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/19f9860c-9efc-4678-8c1e-393c723b4611-multus-daemon-config\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.309539 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.309055 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-slash\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.309539 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.309092 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-slash\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.309539 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.309093 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9272\" (UniqueName: \"kubernetes.io/projected/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-kube-api-access-d9272\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.309539 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.309135 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-system-cni-dir\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.309539 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.309167 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a445b335-dfaf-41a2-afb5-e9ee45ec471f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t5q7f\" (UID: \"a445b335-dfaf-41a2-afb5-e9ee45ec471f\") " pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:00:18.309539 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.309206 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ccbc5713-cd4c-455b-9162-f4ecfedde1f7-hosts-file\") pod \"node-resolver-8t9mw\" (UID: \"ccbc5713-cd4c-455b-9162-f4ecfedde1f7\") " pod="openshift-dns/node-resolver-8t9mw" Nov 03 20:00:18.309539 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.309223 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpcs7\" (UniqueName: \"kubernetes.io/projected/84404c7a-cc47-4e08-861b-a3b417f17e18-kube-api-access-jpcs7\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:00:18.309539 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.309248 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/30329c02-c760-48d5-86f7-dd265325adb0-kubelet-config\") pod \"global-pull-secret-syncer-wz99q\" (UID: \"30329c02-c760-48d5-86f7-dd265325adb0\") " pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:00:18.309539 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.309250 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-ovnkube-config\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.309539 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.309273 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-node-log\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.309539 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.309304 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a445b335-dfaf-41a2-afb5-e9ee45ec471f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t5q7f\" (UID: \"a445b335-dfaf-41a2-afb5-e9ee45ec471f\") " pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:00:18.309539 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.309306 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/30329c02-c760-48d5-86f7-dd265325adb0-kubelet-config\") pod \"global-pull-secret-syncer-wz99q\" (UID: \"30329c02-c760-48d5-86f7-dd265325adb0\") " pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:00:18.310226 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.309334 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-host-run-k8s-cni-cncf-io\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.310226 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.309351 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a445b335-dfaf-41a2-afb5-e9ee45ec471f-cni-binary-copy\") pod \"multus-additional-cni-plugins-t5q7f\" (UID: \"a445b335-dfaf-41a2-afb5-e9ee45ec471f\") " pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:00:18.310226 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.309362 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-node-log\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.310226 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.309365 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3-serviceca\") pod \"node-ca-ts79p\" (UID: \"2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3\") " pod="openshift-image-registry/node-ca-ts79p" Nov 03 20:00:18.310226 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.309385 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a445b335-dfaf-41a2-afb5-e9ee45ec471f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t5q7f\" (UID: \"a445b335-dfaf-41a2-afb5-e9ee45ec471f\") " pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:00:18.310226 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.309404 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-sys\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.310226 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.309481 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-host-var-lib-kubelet\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.310226 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.309509 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/84404c7a-cc47-4e08-861b-a3b417f17e18-kubelet-dir\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:00:18.310226 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.309551 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-run-openvswitch\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.310226 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.309588 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.310226 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.309634 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.310226 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.309634 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-ovnkube-script-lib\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.310226 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.309670 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/30329c02-c760-48d5-86f7-dd265325adb0-dbus\") pod \"global-pull-secret-syncer-wz99q\" (UID: \"30329c02-c760-48d5-86f7-dd265325adb0\") " pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:00:18.310226 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.309702 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879-host-slash\") pod \"iptables-alerter-crqkf\" (UID: \"b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879\") " pod="openshift-network-operator/iptables-alerter-crqkf" Nov 03 20:00:18.310226 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.309728 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-kubernetes\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.310226 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.309754 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-var-lib-kubelet\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.310226 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.309776 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a445b335-dfaf-41a2-afb5-e9ee45ec471f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t5q7f\" (UID: \"a445b335-dfaf-41a2-afb5-e9ee45ec471f\") " pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:00:18.310842 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.309811 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3-serviceca\") pod \"node-ca-ts79p\" (UID: \"2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3\") " pod="openshift-image-registry/node-ca-ts79p" Nov 03 20:00:18.310842 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.309792 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-run-openvswitch\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.310842 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.309861 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/30329c02-c760-48d5-86f7-dd265325adb0-dbus\") pod \"global-pull-secret-syncer-wz99q\" (UID: \"30329c02-c760-48d5-86f7-dd265325adb0\") " pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:00:18.310842 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.309862 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-run-ovn\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.310842 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.309887 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-run-ovn\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.310842 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.309901 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30329c02-c760-48d5-86f7-dd265325adb0-original-pull-secret\") pod \"global-pull-secret-syncer-wz99q\" (UID: \"30329c02-c760-48d5-86f7-dd265325adb0\") " pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:00:18.310842 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.309926 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p6cc\" (UniqueName: \"kubernetes.io/projected/2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3-kube-api-access-9p6cc\") pod \"node-ca-ts79p\" (UID: \"2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3\") " pod="openshift-image-registry/node-ca-ts79p" Nov 03 20:00:18.310842 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.309964 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsbqv\" (UniqueName: \"kubernetes.io/projected/5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2-kube-api-access-rsbqv\") pod \"network-check-target-x5gxd\" (UID: \"5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2\") " pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:00:18.310842 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:18.309977 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 03 20:00:18.310842 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:18.310026 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30329c02-c760-48d5-86f7-dd265325adb0-original-pull-secret podName:30329c02-c760-48d5-86f7-dd265325adb0 nodeName:}" failed. No retries permitted until 2026-11-03 20:00:18.810010188 +0000 UTC m=+3.051876973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/30329c02-c760-48d5-86f7-dd265325adb0-original-pull-secret") pod "global-pull-secret-syncer-wz99q" (UID: "30329c02-c760-48d5-86f7-dd265325adb0") : object "kube-system"/"original-pull-secret" not registered Nov 03 20:00:18.310842 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.310020 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/84404c7a-cc47-4e08-861b-a3b417f17e18-registration-dir\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:00:18.310842 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.310191 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-run\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.310842 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.310108 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-ovnkube-script-lib\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.310842 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.310216 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-host-run-multus-certs\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.310842 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.310266 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc8z5\" (UniqueName: \"kubernetes.io/projected/19f9860c-9efc-4678-8c1e-393c723b4611-kube-api-access-wc8z5\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.310842 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.310293 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-var-lib-openvswitch\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.310842 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.310316 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-cni-bin\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.311445 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.310337 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-sysctl-d\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.311445 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.310351 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-sysctl-conf\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.311445 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.310372 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-host\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.311445 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.310381 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-var-lib-openvswitch\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.311445 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.310393 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-multus-cni-dir\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.311445 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.310403 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-cni-bin\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.311445 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.310433 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-multus-socket-dir-parent\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.311445 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.310449 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-hostroot\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.311445 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.310481 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-kubelet\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.311445 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.310514 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/98448491-e429-4d6f-a50a-7cb104997edf-konnectivity-ca\") pod \"konnectivity-agent-xgdct\" (UID: \"98448491-e429-4d6f-a50a-7cb104997edf\") " pod="kube-system/konnectivity-agent-xgdct" Nov 03 20:00:18.311445 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.310547 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a445b335-dfaf-41a2-afb5-e9ee45ec471f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t5q7f\" (UID: \"a445b335-dfaf-41a2-afb5-e9ee45ec471f\") " pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:00:18.311445 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.310551 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-kubelet\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.311445 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.310592 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7rwr\" (UniqueName: \"kubernetes.io/projected/a445b335-dfaf-41a2-afb5-e9ee45ec471f-kube-api-access-t7rwr\") pod \"multus-additional-cni-plugins-t5q7f\" (UID: \"a445b335-dfaf-41a2-afb5-e9ee45ec471f\") " pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:00:18.311445 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.310682 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/84404c7a-cc47-4e08-861b-a3b417f17e18-etc-selinux\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:00:18.311445 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.310753 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-host-var-lib-cni-multus\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.311445 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.310779 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-run-netns\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.311445 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.310801 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlv6z\" (UniqueName: \"kubernetes.io/projected/b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879-kube-api-access-dlv6z\") pod \"iptables-alerter-crqkf\" (UID: \"b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879\") " pod="openshift-network-operator/iptables-alerter-crqkf" Nov 03 20:00:18.312019 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.310865 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/84404c7a-cc47-4e08-861b-a3b417f17e18-socket-dir\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:00:18.312019 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.310883 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-run-netns\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.312019 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.310899 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-modprobe-d\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.312019 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.310925 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-lib-modules\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.312019 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.310951 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-tmp\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.312019 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.310983 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/98448491-e429-4d6f-a50a-7cb104997edf-agent-certs\") pod \"konnectivity-agent-xgdct\" (UID: \"98448491-e429-4d6f-a50a-7cb104997edf\") " pod="kube-system/konnectivity-agent-xgdct" Nov 03 20:00:18.312019 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.311010 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a445b335-dfaf-41a2-afb5-e9ee45ec471f-system-cni-dir\") pod \"multus-additional-cni-plugins-t5q7f\" (UID: \"a445b335-dfaf-41a2-afb5-e9ee45ec471f\") " pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:00:18.312019 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.311033 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/98448491-e429-4d6f-a50a-7cb104997edf-konnectivity-ca\") pod \"konnectivity-agent-xgdct\" (UID: \"98448491-e429-4d6f-a50a-7cb104997edf\") " pod="kube-system/konnectivity-agent-xgdct" Nov 03 20:00:18.312019 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.311038 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddnm7\" (UniqueName: \"kubernetes.io/projected/ccbc5713-cd4c-455b-9162-f4ecfedde1f7-kube-api-access-ddnm7\") pod \"node-resolver-8t9mw\" (UID: \"ccbc5713-cd4c-455b-9162-f4ecfedde1f7\") " pod="openshift-dns/node-resolver-8t9mw" Nov 03 20:00:18.312019 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.311033 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a445b335-dfaf-41a2-afb5-e9ee45ec471f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t5q7f\" (UID: \"a445b335-dfaf-41a2-afb5-e9ee45ec471f\") " pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:00:18.312019 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.311065 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a445b335-dfaf-41a2-afb5-e9ee45ec471f-system-cni-dir\") pod \"multus-additional-cni-plugins-t5q7f\" (UID: \"a445b335-dfaf-41a2-afb5-e9ee45ec471f\") " pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:00:18.312019 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.311073 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/19f9860c-9efc-4678-8c1e-393c723b4611-cni-binary-copy\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.312019 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.311113 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-log-socket\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.312019 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.311141 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-log-socket\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.312019 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.311158 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-cni-netd\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.312019 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.311181 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-cni-netd\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.312019 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.311198 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ccbc5713-cd4c-455b-9162-f4ecfedde1f7-tmp-dir\") pod \"node-resolver-8t9mw\" (UID: \"ccbc5713-cd4c-455b-9162-f4ecfedde1f7\") " pod="openshift-dns/node-resolver-8t9mw" Nov 03 20:00:18.312736 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.312719 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-ovn-node-metrics-cert\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.313348 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.313331 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/98448491-e429-4d6f-a50a-7cb104997edf-agent-certs\") pod \"konnectivity-agent-xgdct\" (UID: \"98448491-e429-4d6f-a50a-7cb104997edf\") " pod="kube-system/konnectivity-agent-xgdct" Nov 03 20:00:18.345445 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.345421 2576 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Nov 03 20:00:18.345500 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.345477 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rmn49" Nov 03 20:00:18.349657 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.349632 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-gh2n7\"" Nov 03 20:00:18.349742 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.349658 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Nov 03 20:00:18.350827 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.350803 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Nov 03 20:00:18.350928 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.350843 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Nov 03 20:00:18.350928 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.350849 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Nov 03 20:00:18.350928 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.350868 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Nov 03 20:00:18.350928 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.350872 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7694h\"" Nov 03 20:00:18.351048 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.350941 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lbpb4\"" Nov 03 20:00:18.351048 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.350971 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Nov 03 20:00:18.398254 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.398192 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7rwr\" (UniqueName: \"kubernetes.io/projected/a445b335-dfaf-41a2-afb5-e9ee45ec471f-kube-api-access-t7rwr\") pod \"multus-additional-cni-plugins-t5q7f\" (UID: \"a445b335-dfaf-41a2-afb5-e9ee45ec471f\") " pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:00:18.398949 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.398925 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsxkj\" (UniqueName: \"kubernetes.io/projected/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-kube-api-access-fsxkj\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.399203 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.399186 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p6cc\" (UniqueName: \"kubernetes.io/projected/2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3-kube-api-access-9p6cc\") pod \"node-ca-ts79p\" (UID: \"2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3\") " pod="openshift-image-registry/node-ca-ts79p" Nov 03 20:00:18.409959 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.409942 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwhj2\" (UniqueName: \"kubernetes.io/projected/aae6331f-1f9f-43c8-9610-f554ddebf2e3-kube-api-access-nwhj2\") pod \"network-metrics-daemon-pslv9\" (UID: \"aae6331f-1f9f-43c8-9610-f554ddebf2e3\") " pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:00:18.411856 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.411839 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/84404c7a-cc47-4e08-861b-a3b417f17e18-kubelet-dir\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:00:18.411912 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.411864 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879-host-slash\") pod \"iptables-alerter-crqkf\" (UID: \"b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879\") " pod="openshift-network-operator/iptables-alerter-crqkf" Nov 03 20:00:18.411912 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.411893 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-kubernetes\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.411990 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.411932 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/84404c7a-cc47-4e08-861b-a3b417f17e18-kubelet-dir\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:00:18.411990 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.411965 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-kubernetes\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.411990 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.411965 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879-host-slash\") pod \"iptables-alerter-crqkf\" (UID: \"b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879\") " pod="openshift-network-operator/iptables-alerter-crqkf" Nov 03 20:00:18.412127 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.412001 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-var-lib-kubelet\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.412127 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.412030 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsbqv\" (UniqueName: \"kubernetes.io/projected/5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2-kube-api-access-rsbqv\") pod \"network-check-target-x5gxd\" (UID: \"5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2\") " pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:00:18.412127 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.412046 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/84404c7a-cc47-4e08-861b-a3b417f17e18-registration-dir\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:00:18.412127 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.412064 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-run\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.412127 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.412070 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-var-lib-kubelet\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.412127 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.412123 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-host-run-multus-certs\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.412404 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.412183 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc8z5\" (UniqueName: \"kubernetes.io/projected/19f9860c-9efc-4678-8c1e-393c723b4611-kube-api-access-wc8z5\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.412404 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.412200 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-host-run-multus-certs\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.412404 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.412209 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/84404c7a-cc47-4e08-861b-a3b417f17e18-registration-dir\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:00:18.412404 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.412233 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-sysctl-d\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.412404 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.412217 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-run\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.412404 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.412296 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-sysctl-conf\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.412404 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.412330 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-host\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.412404 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.412352 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-multus-cni-dir\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.412404 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.412397 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-host\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.412774 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.412393 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-multus-socket-dir-parent\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.412774 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.412450 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-sysctl-conf\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.412774 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.412512 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-sysctl-d\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.412774 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.412520 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-multus-socket-dir-parent\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.412774 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.412548 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-multus-cni-dir\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.412774 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.412580 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-hostroot\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.412774 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.412615 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-hostroot\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.412774 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.412625 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/84404c7a-cc47-4e08-861b-a3b417f17e18-etc-selinux\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:00:18.412774 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.412649 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-host-var-lib-cni-multus\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.412774 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.412666 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlv6z\" (UniqueName: \"kubernetes.io/projected/b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879-kube-api-access-dlv6z\") pod \"iptables-alerter-crqkf\" (UID: \"b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879\") " pod="openshift-network-operator/iptables-alerter-crqkf" Nov 03 20:00:18.412774 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.412680 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/84404c7a-cc47-4e08-861b-a3b417f17e18-socket-dir\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:00:18.412774 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.412695 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-modprobe-d\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.412774 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.412709 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-lib-modules\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.412774 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.412731 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-tmp\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.412774 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.412751 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/84404c7a-cc47-4e08-861b-a3b417f17e18-etc-selinux\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:00:18.413491 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.412776 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-host-var-lib-cni-multus\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.413491 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.412764 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddnm7\" (UniqueName: \"kubernetes.io/projected/ccbc5713-cd4c-455b-9162-f4ecfedde1f7-kube-api-access-ddnm7\") pod \"node-resolver-8t9mw\" (UID: \"ccbc5713-cd4c-455b-9162-f4ecfedde1f7\") " pod="openshift-dns/node-resolver-8t9mw" Nov 03 20:00:18.413491 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.412838 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-modprobe-d\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.413491 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.412856 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/19f9860c-9efc-4678-8c1e-393c723b4611-cni-binary-copy\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.413491 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.412894 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ccbc5713-cd4c-455b-9162-f4ecfedde1f7-tmp-dir\") pod \"node-resolver-8t9mw\" (UID: \"ccbc5713-cd4c-455b-9162-f4ecfedde1f7\") " pod="openshift-dns/node-resolver-8t9mw" Nov 03 20:00:18.413491 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.412902 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-lib-modules\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.413491 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.412947 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/84404c7a-cc47-4e08-861b-a3b417f17e18-sys-fs\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:00:18.413491 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.412988 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-multus-conf-dir\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.413491 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.413050 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/84404c7a-cc47-4e08-861b-a3b417f17e18-socket-dir\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:00:18.413491 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.413059 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-etc-kubernetes\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.413491 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.413085 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/84404c7a-cc47-4e08-861b-a3b417f17e18-sys-fs\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:00:18.413491 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.413135 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-multus-conf-dir\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.413491 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.413145 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879-iptables-alerter-script\") pod \"iptables-alerter-crqkf\" (UID: \"b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879\") " pod="openshift-network-operator/iptables-alerter-crqkf" Nov 03 20:00:18.413491 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.413174 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-tuned\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.413491 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.413203 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/84404c7a-cc47-4e08-861b-a3b417f17e18-device-dir\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:00:18.413491 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.413233 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-cnibin\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.413491 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.413256 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ccbc5713-cd4c-455b-9162-f4ecfedde1f7-tmp-dir\") pod \"node-resolver-8t9mw\" (UID: \"ccbc5713-cd4c-455b-9162-f4ecfedde1f7\") " pod="openshift-dns/node-resolver-8t9mw" Nov 03 20:00:18.413491 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.413259 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-sysconfig\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.414392 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.413310 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-systemd\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.414392 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.413313 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/84404c7a-cc47-4e08-861b-a3b417f17e18-device-dir\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:00:18.414392 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.413149 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-etc-kubernetes\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.414392 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.413343 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-cnibin\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.414392 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.413379 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-host-run-netns\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.414392 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.413428 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/19f9860c-9efc-4678-8c1e-393c723b4611-cni-binary-copy\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.414392 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.413421 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-systemd\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.414392 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.413540 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-sysconfig\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.414392 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.413547 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-host-var-lib-cni-bin\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.414392 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.413585 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-host-run-netns\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.414392 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.413604 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-host-var-lib-cni-bin\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.414392 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.413782 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/19f9860c-9efc-4678-8c1e-393c723b4611-multus-daemon-config\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.414392 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.413814 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9272\" (UniqueName: \"kubernetes.io/projected/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-kube-api-access-d9272\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.414392 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.413836 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879-iptables-alerter-script\") pod \"iptables-alerter-crqkf\" (UID: \"b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879\") " pod="openshift-network-operator/iptables-alerter-crqkf" Nov 03 20:00:18.414392 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.413864 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-system-cni-dir\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.414392 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.413892 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ccbc5713-cd4c-455b-9162-f4ecfedde1f7-hosts-file\") pod \"node-resolver-8t9mw\" (UID: \"ccbc5713-cd4c-455b-9162-f4ecfedde1f7\") " pod="openshift-dns/node-resolver-8t9mw" Nov 03 20:00:18.414392 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.413917 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpcs7\" (UniqueName: \"kubernetes.io/projected/84404c7a-cc47-4e08-861b-a3b417f17e18-kube-api-access-jpcs7\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:00:18.414392 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.413947 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-host-run-k8s-cni-cncf-io\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.414957 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.413989 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-sys\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.414957 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.414014 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-host-var-lib-kubelet\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.414957 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.414108 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-host-var-lib-kubelet\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.414957 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.414326 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/19f9860c-9efc-4678-8c1e-393c723b4611-multus-daemon-config\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.414957 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.414343 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-system-cni-dir\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.414957 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.414412 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ccbc5713-cd4c-455b-9162-f4ecfedde1f7-hosts-file\") pod \"node-resolver-8t9mw\" (UID: \"ccbc5713-cd4c-455b-9162-f4ecfedde1f7\") " pod="openshift-dns/node-resolver-8t9mw" Nov 03 20:00:18.414957 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.414447 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-host-run-k8s-cni-cncf-io\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.414957 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.414473 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-sys\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.415312 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.415293 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-tmp\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.415381 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.415362 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-tuned\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.477538 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:18.477518 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 03 20:00:18.477538 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:18.477538 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 03 20:00:18.477648 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:18.477562 2576 projected.go:196] Error preparing data for projected volume kube-api-access-rsbqv for pod openshift-network-diagnostics/network-check-target-x5gxd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 20:00:18.477648 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:18.477629 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2-kube-api-access-rsbqv podName:5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2 nodeName:}" failed. No retries permitted until 2026-11-03 20:00:18.97761578 +0000 UTC m=+3.219482593 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rsbqv" (UniqueName: "kubernetes.io/projected/5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2-kube-api-access-rsbqv") pod "network-check-target-x5gxd" (UID: "5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 20:00:18.480261 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.480237 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlv6z\" (UniqueName: \"kubernetes.io/projected/b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879-kube-api-access-dlv6z\") pod \"iptables-alerter-crqkf\" (UID: \"b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879\") " pod="openshift-network-operator/iptables-alerter-crqkf" Nov 03 20:00:18.480261 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.480255 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc8z5\" (UniqueName: \"kubernetes.io/projected/19f9860c-9efc-4678-8c1e-393c723b4611-kube-api-access-wc8z5\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.480433 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.480309 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddnm7\" (UniqueName: \"kubernetes.io/projected/ccbc5713-cd4c-455b-9162-f4ecfedde1f7-kube-api-access-ddnm7\") pod \"node-resolver-8t9mw\" (UID: \"ccbc5713-cd4c-455b-9162-f4ecfedde1f7\") " pod="openshift-dns/node-resolver-8t9mw" Nov 03 20:00:18.481496 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.481477 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9272\" (UniqueName: \"kubernetes.io/projected/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-kube-api-access-d9272\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.481656 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.481623 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpcs7\" (UniqueName: \"kubernetes.io/projected/84404c7a-cc47-4e08-861b-a3b417f17e18-kube-api-access-jpcs7\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:00:18.508334 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.508275 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xgdct" Nov 03 20:00:18.511671 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.511654 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ts79p" Nov 03 20:00:18.517111 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.517090 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:18.519347 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:18.519327 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98448491_e429_4d6f_a50a_7cb104997edf.slice/crio-0f0a289384e847e54564988a7badfa37668e875ad3d223b7c6f82a463975189f WatchSource:0}: Error finding container 0f0a289384e847e54564988a7badfa37668e875ad3d223b7c6f82a463975189f: Status 404 returned error can't find the container with id 0f0a289384e847e54564988a7badfa37668e875ad3d223b7c6f82a463975189f Nov 03 20:00:18.521595 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:18.521555 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ae13e8f_66b1_4be0_a0fe_dd414d2ee6d3.slice/crio-d458e523b958bfc654cb0d4513a78242e0f96447453153b462882c3b477ee3f3 WatchSource:0}: Error finding container d458e523b958bfc654cb0d4513a78242e0f96447453153b462882c3b477ee3f3: Status 404 returned error can't find the container with id d458e523b958bfc654cb0d4513a78242e0f96447453153b462882c3b477ee3f3 Nov 03 20:00:18.528002 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:18.527984 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3699cbee_ee43_4504_bc3b_c4b3a7efbcbb.slice/crio-a64e3913a245391683e541997e9ccd6fce59cc1d433f712fe9760c80e43c6b24 WatchSource:0}: Error finding container a64e3913a245391683e541997e9ccd6fce59cc1d433f712fe9760c80e43c6b24: Status 404 returned error can't find the container with id a64e3913a245391683e541997e9ccd6fce59cc1d433f712fe9760c80e43c6b24 Nov 03 20:00:18.531470 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.531455 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:00:18.533687 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.533671 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:00:18.538770 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.538752 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8t9mw" Nov 03 20:00:18.540946 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.540930 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-crqkf" Nov 03 20:00:18.543540 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:18.543520 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecfe1b48_bc22_471d_8a9e_f7f9cbc227d1.slice/crio-5211912ccb52f4f196fdd65fa401fdc542bcad6a7adb99d31eafd74adf215def WatchSource:0}: Error finding container 5211912ccb52f4f196fdd65fa401fdc542bcad6a7adb99d31eafd74adf215def: Status 404 returned error can't find the container with id 5211912ccb52f4f196fdd65fa401fdc542bcad6a7adb99d31eafd74adf215def Nov 03 20:00:18.544546 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.544530 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:00:18.544820 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:18.544798 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84404c7a_cc47_4e08_861b_a3b417f17e18.slice/crio-a9289d02c31995256882e2a388053ffdd6432b45cd4ad2186b61eedcd7853105 WatchSource:0}: Error finding container a9289d02c31995256882e2a388053ffdd6432b45cd4ad2186b61eedcd7853105: Status 404 returned error can't find the container with id a9289d02c31995256882e2a388053ffdd6432b45cd4ad2186b61eedcd7853105 Nov 03 20:00:18.546858 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.546841 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sjn97" Nov 03 20:00:18.551316 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:18.551231 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccbc5713_cd4c_455b_9162_f4ecfedde1f7.slice/crio-0ae94da46971ce3c29e7ed8d62153bb16c9a5a0d14353bfcef6a7eb1c62b5d33 WatchSource:0}: Error finding container 0ae94da46971ce3c29e7ed8d62153bb16c9a5a0d14353bfcef6a7eb1c62b5d33: Status 404 returned error can't find the container with id 0ae94da46971ce3c29e7ed8d62153bb16c9a5a0d14353bfcef6a7eb1c62b5d33 Nov 03 20:00:18.555189 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:18.555169 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7f8ead7_9bb3_4ac5_abaa_e92ee0e1a879.slice/crio-e1f881937bcaa543868f89113eb36d94c46458b2359d92515242d24ed9a35c17 WatchSource:0}: Error finding container e1f881937bcaa543868f89113eb36d94c46458b2359d92515242d24ed9a35c17: Status 404 returned error can't find the container with id e1f881937bcaa543868f89113eb36d94c46458b2359d92515242d24ed9a35c17 Nov 03 20:00:18.558878 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:18.558858 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda445b335_dfaf_41a2_afb5_e9ee45ec471f.slice/crio-9e2aa1c197055a6648b15a76bb70227f6f64f6edfd0b33c3dd7293eeca740aa6 WatchSource:0}: Error finding container 9e2aa1c197055a6648b15a76bb70227f6f64f6edfd0b33c3dd7293eeca740aa6: Status 404 returned error can't find the container with id 9e2aa1c197055a6648b15a76bb70227f6f64f6edfd0b33c3dd7293eeca740aa6 Nov 03 20:00:18.559517 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:00:18.559496 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19f9860c_9efc_4678_8c1e_393c723b4611.slice/crio-bd6d9915d98b8ce879c7cc7cd16af82e1e828908695d1c5f96202a84267efc28 WatchSource:0}: Error finding container bd6d9915d98b8ce879c7cc7cd16af82e1e828908695d1c5f96202a84267efc28: Status 404 returned error can't find the container with id bd6d9915d98b8ce879c7cc7cd16af82e1e828908695d1c5f96202a84267efc28 Nov 03 20:00:18.817934 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.817860 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aae6331f-1f9f-43c8-9610-f554ddebf2e3-metrics-certs\") pod \"network-metrics-daemon-pslv9\" (UID: \"aae6331f-1f9f-43c8-9610-f554ddebf2e3\") " pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:00:18.817934 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:18.817908 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30329c02-c760-48d5-86f7-dd265325adb0-original-pull-secret\") pod \"global-pull-secret-syncer-wz99q\" (UID: \"30329c02-c760-48d5-86f7-dd265325adb0\") " pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:00:18.818175 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:18.818058 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 03 20:00:18.818175 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:18.818105 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30329c02-c760-48d5-86f7-dd265325adb0-original-pull-secret podName:30329c02-c760-48d5-86f7-dd265325adb0 nodeName:}" failed. No retries permitted until 2026-11-03 20:00:19.818092686 +0000 UTC m=+4.059959457 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/30329c02-c760-48d5-86f7-dd265325adb0-original-pull-secret") pod "global-pull-secret-syncer-wz99q" (UID: "30329c02-c760-48d5-86f7-dd265325adb0") : object "kube-system"/"original-pull-secret" not registered Nov 03 20:00:18.818175 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:18.818159 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 20:00:18.818342 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:18.818181 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aae6331f-1f9f-43c8-9610-f554ddebf2e3-metrics-certs podName:aae6331f-1f9f-43c8-9610-f554ddebf2e3 nodeName:}" failed. No retries permitted until 2026-11-03 20:00:19.818173044 +0000 UTC m=+4.060039816 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aae6331f-1f9f-43c8-9610-f554ddebf2e3-metrics-certs") pod "network-metrics-daemon-pslv9" (UID: "aae6331f-1f9f-43c8-9610-f554ddebf2e3") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 20:00:19.020001 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:19.019960 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsbqv\" (UniqueName: \"kubernetes.io/projected/5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2-kube-api-access-rsbqv\") pod \"network-check-target-x5gxd\" (UID: \"5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2\") " pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:00:19.020285 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:19.020263 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 03 20:00:19.020355 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:19.020330 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 03 20:00:19.020355 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:19.020344 2576 projected.go:196] Error preparing data for projected volume kube-api-access-rsbqv for pod openshift-network-diagnostics/network-check-target-x5gxd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 20:00:19.020471 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:19.020428 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2-kube-api-access-rsbqv podName:5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2 nodeName:}" failed. No retries permitted until 2026-11-03 20:00:20.020410483 +0000 UTC m=+4.262277254 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rsbqv" (UniqueName: "kubernetes.io/projected/5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2-kube-api-access-rsbqv") pod "network-check-target-x5gxd" (UID: "5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 20:00:19.184217 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:19.184114 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7246c" event={"ID":"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb","Type":"ContainerStarted","Data":"a64e3913a245391683e541997e9ccd6fce59cc1d433f712fe9760c80e43c6b24"} Nov 03 20:00:19.186195 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:19.186162 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sjn97" event={"ID":"19f9860c-9efc-4678-8c1e-393c723b4611","Type":"ContainerStarted","Data":"bd6d9915d98b8ce879c7cc7cd16af82e1e828908695d1c5f96202a84267efc28"} Nov 03 20:00:19.188348 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:19.188269 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" event={"ID":"84404c7a-cc47-4e08-861b-a3b417f17e18","Type":"ContainerStarted","Data":"a9289d02c31995256882e2a388053ffdd6432b45cd4ad2186b61eedcd7853105"} Nov 03 20:00:19.190765 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:19.190736 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ts79p" event={"ID":"2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3","Type":"ContainerStarted","Data":"d458e523b958bfc654cb0d4513a78242e0f96447453153b462882c3b477ee3f3"} Nov 03 20:00:19.192909 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:19.192885 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xgdct" event={"ID":"98448491-e429-4d6f-a50a-7cb104997edf","Type":"ContainerStarted","Data":"0f0a289384e847e54564988a7badfa37668e875ad3d223b7c6f82a463975189f"} Nov 03 20:00:19.194760 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:19.194732 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t5q7f" event={"ID":"a445b335-dfaf-41a2-afb5-e9ee45ec471f","Type":"ContainerStarted","Data":"9e2aa1c197055a6648b15a76bb70227f6f64f6edfd0b33c3dd7293eeca740aa6"} Nov 03 20:00:19.196744 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:19.196720 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-crqkf" event={"ID":"b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879","Type":"ContainerStarted","Data":"e1f881937bcaa543868f89113eb36d94c46458b2359d92515242d24ed9a35c17"} Nov 03 20:00:19.198476 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:19.198450 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8t9mw" event={"ID":"ccbc5713-cd4c-455b-9162-f4ecfedde1f7","Type":"ContainerStarted","Data":"0ae94da46971ce3c29e7ed8d62153bb16c9a5a0d14353bfcef6a7eb1c62b5d33"} Nov 03 20:00:19.200106 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:19.200070 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v224g" event={"ID":"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1","Type":"ContainerStarted","Data":"5211912ccb52f4f196fdd65fa401fdc542bcad6a7adb99d31eafd74adf215def"} Nov 03 20:00:19.350341 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:19.350298 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-02 19:55:19 +0000 UTC" deadline="2028-05-01 10:51:14.662660158 +0000 UTC" Nov 03 20:00:19.350341 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:19.350332 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13070h50m55.312332238s" Nov 03 20:00:19.827949 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:19.827906 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30329c02-c760-48d5-86f7-dd265325adb0-original-pull-secret\") pod \"global-pull-secret-syncer-wz99q\" (UID: \"30329c02-c760-48d5-86f7-dd265325adb0\") " pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:00:19.828152 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:19.828017 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aae6331f-1f9f-43c8-9610-f554ddebf2e3-metrics-certs\") pod \"network-metrics-daemon-pslv9\" (UID: \"aae6331f-1f9f-43c8-9610-f554ddebf2e3\") " pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:00:19.828234 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:19.828212 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 20:00:19.828324 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:19.828306 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aae6331f-1f9f-43c8-9610-f554ddebf2e3-metrics-certs podName:aae6331f-1f9f-43c8-9610-f554ddebf2e3 nodeName:}" failed. No retries permitted until 2026-11-03 20:00:21.828285367 +0000 UTC m=+6.070152160 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aae6331f-1f9f-43c8-9610-f554ddebf2e3-metrics-certs") pod "network-metrics-daemon-pslv9" (UID: "aae6331f-1f9f-43c8-9610-f554ddebf2e3") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 20:00:19.828394 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:19.828387 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 03 20:00:19.828449 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:19.828426 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30329c02-c760-48d5-86f7-dd265325adb0-original-pull-secret podName:30329c02-c760-48d5-86f7-dd265325adb0 nodeName:}" failed. No retries permitted until 2026-11-03 20:00:21.82841346 +0000 UTC m=+6.070280245 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/30329c02-c760-48d5-86f7-dd265325adb0-original-pull-secret") pod "global-pull-secret-syncer-wz99q" (UID: "30329c02-c760-48d5-86f7-dd265325adb0") : object "kube-system"/"original-pull-secret" not registered Nov 03 20:00:20.030123 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:20.030068 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsbqv\" (UniqueName: \"kubernetes.io/projected/5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2-kube-api-access-rsbqv\") pod \"network-check-target-x5gxd\" (UID: \"5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2\") " pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:00:20.030317 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:20.030270 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 03 20:00:20.030317 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:20.030294 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 03 20:00:20.030317 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:20.030308 2576 projected.go:196] Error preparing data for projected volume kube-api-access-rsbqv for pod openshift-network-diagnostics/network-check-target-x5gxd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 20:00:20.030486 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:20.030373 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2-kube-api-access-rsbqv podName:5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2 nodeName:}" failed. No retries permitted until 2026-11-03 20:00:22.030354384 +0000 UTC m=+6.272221194 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rsbqv" (UniqueName: "kubernetes.io/projected/5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2-kube-api-access-rsbqv") pod "network-check-target-x5gxd" (UID: "5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 20:00:20.184863 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:20.184785 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:00:20.185312 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:20.184937 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pslv9" podUID="aae6331f-1f9f-43c8-9610-f554ddebf2e3" Nov 03 20:00:20.185312 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:20.185024 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:00:20.185312 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:20.185097 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5gxd" podUID="5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2" Nov 03 20:00:20.185312 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:20.185289 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:00:20.185514 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:20.185379 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wz99q" podUID="30329c02-c760-48d5-86f7-dd265325adb0" Nov 03 20:00:20.352666 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:20.351122 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-02 19:55:19 +0000 UTC" deadline="2028-07-24 19:40:21.521072012 +0000 UTC" Nov 03 20:00:20.352666 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:20.351185 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15095h40m1.169891432s" Nov 03 20:00:21.848441 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:21.848084 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30329c02-c760-48d5-86f7-dd265325adb0-original-pull-secret\") pod \"global-pull-secret-syncer-wz99q\" (UID: \"30329c02-c760-48d5-86f7-dd265325adb0\") " pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:00:21.848441 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:21.848421 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aae6331f-1f9f-43c8-9610-f554ddebf2e3-metrics-certs\") pod \"network-metrics-daemon-pslv9\" (UID: \"aae6331f-1f9f-43c8-9610-f554ddebf2e3\") " pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:00:21.849057 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:21.848563 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 20:00:21.849057 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:21.848649 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aae6331f-1f9f-43c8-9610-f554ddebf2e3-metrics-certs podName:aae6331f-1f9f-43c8-9610-f554ddebf2e3 nodeName:}" failed. No retries permitted until 2026-11-03 20:00:25.848608764 +0000 UTC m=+10.090475541 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aae6331f-1f9f-43c8-9610-f554ddebf2e3-metrics-certs") pod "network-metrics-daemon-pslv9" (UID: "aae6331f-1f9f-43c8-9610-f554ddebf2e3") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 20:00:21.849057 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:21.848726 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 03 20:00:21.849057 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:21.848763 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30329c02-c760-48d5-86f7-dd265325adb0-original-pull-secret podName:30329c02-c760-48d5-86f7-dd265325adb0 nodeName:}" failed. No retries permitted until 2026-11-03 20:00:25.848751269 +0000 UTC m=+10.090618046 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/30329c02-c760-48d5-86f7-dd265325adb0-original-pull-secret") pod "global-pull-secret-syncer-wz99q" (UID: "30329c02-c760-48d5-86f7-dd265325adb0") : object "kube-system"/"original-pull-secret" not registered Nov 03 20:00:22.050195 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:22.050152 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsbqv\" (UniqueName: \"kubernetes.io/projected/5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2-kube-api-access-rsbqv\") pod \"network-check-target-x5gxd\" (UID: \"5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2\") " pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:00:22.050388 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:22.050363 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 03 20:00:22.050454 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:22.050398 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 03 20:00:22.050454 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:22.050414 2576 projected.go:196] Error preparing data for projected volume kube-api-access-rsbqv for pod openshift-network-diagnostics/network-check-target-x5gxd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 20:00:22.050563 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:22.050481 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2-kube-api-access-rsbqv podName:5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2 nodeName:}" failed. No retries permitted until 2026-11-03 20:00:26.050463948 +0000 UTC m=+10.292330736 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rsbqv" (UniqueName: "kubernetes.io/projected/5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2-kube-api-access-rsbqv") pod "network-check-target-x5gxd" (UID: "5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 20:00:22.174391 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:22.174316 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:00:22.174549 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:22.174460 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pslv9" podUID="aae6331f-1f9f-43c8-9610-f554ddebf2e3" Nov 03 20:00:22.174549 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:22.174531 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:00:22.174679 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:22.174626 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5gxd" podUID="5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2" Nov 03 20:00:22.174809 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:22.174791 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:00:22.174914 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:22.174888 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wz99q" podUID="30329c02-c760-48d5-86f7-dd265325adb0" Nov 03 20:00:22.229059 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:22.228995 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-181.us-west-1.compute.internal" event={"ID":"7433a56a703a69a62fac958fa017ce29","Type":"ContainerStarted","Data":"5b98c5d2396c078eb5969a59936fd77b091874697aeaad2034e1b2a929d7188b"} Nov 03 20:00:22.355001 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:22.354919 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-181.us-west-1.compute.internal" podStartSLOduration=4.354897604 podStartE2EDuration="4.354897604s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 20:00:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:00:22.354231221 +0000 UTC m=+6.596098017" watchObservedRunningTime="2026-11-03 20:00:22.354897604 +0000 UTC m=+6.596764401" Nov 03 20:00:23.239616 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:23.238655 2576 generic.go:356] "Generic (PLEG): container finished" podID="d77c2e2c27eea566b26a98b807b65f3e" containerID="37d262e7e18b72993167637adb2b8c69a0ba69d126cf19fbd2b394cfba7d7c18" exitCode=0 Nov 03 20:00:23.239616 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:23.238759 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal" event={"ID":"d77c2e2c27eea566b26a98b807b65f3e","Type":"ContainerDied","Data":"37d262e7e18b72993167637adb2b8c69a0ba69d126cf19fbd2b394cfba7d7c18"} Nov 03 20:00:23.247594 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:23.247290 2576 generic.go:356] "Generic (PLEG): container finished" podID="a445b335-dfaf-41a2-afb5-e9ee45ec471f" containerID="b92425ebe7689e857b7b6642858b9bc75e563f78d92839ef4369ba8bba75643c" exitCode=0 Nov 03 20:00:23.248260 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:23.247769 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t5q7f" event={"ID":"a445b335-dfaf-41a2-afb5-e9ee45ec471f","Type":"ContainerDied","Data":"b92425ebe7689e857b7b6642858b9bc75e563f78d92839ef4369ba8bba75643c"} Nov 03 20:00:24.176119 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:24.176082 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:00:24.176263 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:24.176212 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wz99q" podUID="30329c02-c760-48d5-86f7-dd265325adb0" Nov 03 20:00:24.176299 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:24.176290 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:00:24.176408 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:24.176385 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pslv9" podUID="aae6331f-1f9f-43c8-9610-f554ddebf2e3" Nov 03 20:00:24.176472 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:24.176457 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:00:24.176554 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:24.176535 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5gxd" podUID="5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2" Nov 03 20:00:24.276657 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:24.276624 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal" event={"ID":"d77c2e2c27eea566b26a98b807b65f3e","Type":"ContainerStarted","Data":"9c0dfcc893e87e0a644512d435c275eb2f6e6ec0757f7904231071320075b517"} Nov 03 20:00:24.283074 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:24.283032 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xgdct" event={"ID":"98448491-e429-4d6f-a50a-7cb104997edf","Type":"ContainerStarted","Data":"a3567b4136a5aa13098afc2cc452543655eff23490510c8be9153133d71389fd"} Nov 03 20:00:24.404562 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:24.403764 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal" podStartSLOduration=6.403741749 podStartE2EDuration="6.403741749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 20:00:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:00:24.403283869 +0000 UTC m=+8.645150665" watchObservedRunningTime="2026-11-03 20:00:24.403741749 +0000 UTC m=+8.645608546" Nov 03 20:00:25.289626 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:25.289590 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ts79p" event={"ID":"2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3","Type":"ContainerStarted","Data":"fa92f9242fd7a25b6775de3902ce00b42b0715d3bbd50c27f5f3760b38d59392"} Nov 03 20:00:25.415213 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:25.415148 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xgdct" podStartSLOduration=3.384208765 podStartE2EDuration="8.415127325s" totalImagesPullingTime="5.03091856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:00:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:00:24.531470538 +0000 UTC m=+8.773337331" watchObservedRunningTime="2026-11-03 20:00:25.415127325 +0000 UTC m=+9.656994121" Nov 03 20:00:25.415402 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:25.415277 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ts79p" podStartSLOduration=2.489397989 podStartE2EDuration="8.415270878s" totalImagesPullingTime="5.925872889s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 20:00:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:00:25.414977282 +0000 UTC m=+9.656844077" watchObservedRunningTime="2026-11-03 20:00:25.415270878 +0000 UTC m=+9.657137674" Nov 03 20:00:25.883538 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:25.882612 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aae6331f-1f9f-43c8-9610-f554ddebf2e3-metrics-certs\") pod \"network-metrics-daemon-pslv9\" (UID: \"aae6331f-1f9f-43c8-9610-f554ddebf2e3\") " pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:00:25.883538 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:25.882697 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30329c02-c760-48d5-86f7-dd265325adb0-original-pull-secret\") pod \"global-pull-secret-syncer-wz99q\" (UID: \"30329c02-c760-48d5-86f7-dd265325adb0\") " pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:00:25.883538 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:25.882863 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 03 20:00:25.883538 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:25.882930 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30329c02-c760-48d5-86f7-dd265325adb0-original-pull-secret podName:30329c02-c760-48d5-86f7-dd265325adb0 nodeName:}" failed. No retries permitted until 2026-11-03 20:00:33.882912353 +0000 UTC m=+18.124779143 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/30329c02-c760-48d5-86f7-dd265325adb0-original-pull-secret") pod "global-pull-secret-syncer-wz99q" (UID: "30329c02-c760-48d5-86f7-dd265325adb0") : object "kube-system"/"original-pull-secret" not registered Nov 03 20:00:25.883538 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:25.883357 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 20:00:25.883538 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:25.883410 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aae6331f-1f9f-43c8-9610-f554ddebf2e3-metrics-certs podName:aae6331f-1f9f-43c8-9610-f554ddebf2e3 nodeName:}" failed. No retries permitted until 2026-11-03 20:00:33.883395024 +0000 UTC m=+18.125261808 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aae6331f-1f9f-43c8-9610-f554ddebf2e3-metrics-certs") pod "network-metrics-daemon-pslv9" (UID: "aae6331f-1f9f-43c8-9610-f554ddebf2e3") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 20:00:26.084090 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:26.084053 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsbqv\" (UniqueName: \"kubernetes.io/projected/5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2-kube-api-access-rsbqv\") pod \"network-check-target-x5gxd\" (UID: \"5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2\") " pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:00:26.084263 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:26.084211 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 03 20:00:26.084263 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:26.084232 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 03 20:00:26.084263 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:26.084243 2576 projected.go:196] Error preparing data for projected volume kube-api-access-rsbqv for pod openshift-network-diagnostics/network-check-target-x5gxd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 20:00:26.084432 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:26.084307 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2-kube-api-access-rsbqv podName:5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2 nodeName:}" failed. No retries permitted until 2026-11-03 20:00:34.084285218 +0000 UTC m=+18.326152008 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rsbqv" (UniqueName: "kubernetes.io/projected/5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2-kube-api-access-rsbqv") pod "network-check-target-x5gxd" (UID: "5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 20:00:26.177676 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:26.176687 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:00:26.177676 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:26.176832 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wz99q" podUID="30329c02-c760-48d5-86f7-dd265325adb0" Nov 03 20:00:26.178761 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:26.178730 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:00:26.178996 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:26.178797 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:00:26.179175 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:26.179146 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pslv9" podUID="aae6331f-1f9f-43c8-9610-f554ddebf2e3" Nov 03 20:00:26.179440 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:26.179378 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5gxd" podUID="5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2" Nov 03 20:00:26.293729 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:26.293685 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" event={"ID":"84404c7a-cc47-4e08-861b-a3b417f17e18","Type":"ContainerStarted","Data":"9a78ab0d4e036851d6fe32220328015db2e4365b2d43c823d3e984fceb104b6c"} Nov 03 20:00:27.831507 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:27.831398 2576 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Nov 03 20:00:28.104297 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:28.104272 2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xgdct" Nov 03 20:00:28.104786 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:28.104764 2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xgdct" Nov 03 20:00:28.174696 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:28.174418 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:00:28.174862 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:28.174446 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:00:28.174862 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:28.174811 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wz99q" podUID="30329c02-c760-48d5-86f7-dd265325adb0" Nov 03 20:00:28.175103 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:28.174931 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pslv9" podUID="aae6331f-1f9f-43c8-9610-f554ddebf2e3" Nov 03 20:00:28.175103 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:28.174488 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:00:28.175103 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:28.175021 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5gxd" podUID="5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2" Nov 03 20:00:28.195408 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:28.195299 2576 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-03T20:00:27.83141356Z","UUID":"08a8dd26-fc3c-4397-8ac3-6868389badad","Handler":null,"Name":"","Endpoint":""} Nov 03 20:00:28.197806 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:28.197410 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Nov 03 20:00:28.197806 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:28.197442 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Nov 03 20:00:28.303243 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:28.303204 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t5q7f" event={"ID":"a445b335-dfaf-41a2-afb5-e9ee45ec471f","Type":"ContainerStarted","Data":"97726df57cee8efff26d2269eb8411780b736536d5c1958310ca3a36c0b236ef"} Nov 03 20:00:28.305872 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:28.305834 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8t9mw" event={"ID":"ccbc5713-cd4c-455b-9162-f4ecfedde1f7","Type":"ContainerStarted","Data":"2c658d8990f9c226a185ae630e67e3925c8b7187407754748610a6520627d3e9"} Nov 03 20:00:28.308621 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:28.308178 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sjn97" event={"ID":"19f9860c-9efc-4678-8c1e-393c723b4611","Type":"ContainerStarted","Data":"e3455cf18d9037c63927db52d6a2aa8c52989cf8414852034b65080ac66f1955"} Nov 03 20:00:28.311213 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:28.311190 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" event={"ID":"84404c7a-cc47-4e08-861b-a3b417f17e18","Type":"ContainerStarted","Data":"cd8720e5c9b6c28ca2224014492f97d64d293be197778ce80b81fdd1593d9580"} Nov 03 20:00:28.311337 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:28.311235 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xgdct" Nov 03 20:00:28.311668 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:28.311649 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xgdct" Nov 03 20:00:28.567445 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:28.566828 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-8t9mw" podStartSLOduration=2.76034811 podStartE2EDuration="11.566805829s" totalImagesPullingTime="8.806457719s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 20:00:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:00:28.566337917 +0000 UTC m=+12.808204712" watchObservedRunningTime="2026-11-03 20:00:28.566805829 +0000 UTC m=+12.808672624" Nov 03 20:00:28.696007 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:28.695902 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-sjn97" podStartSLOduration=2.768097264 podStartE2EDuration="11.695881778s" totalImagesPullingTime="8.927784514s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 20:00:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:00:28.695094828 +0000 UTC m=+12.936961624" watchObservedRunningTime="2026-11-03 20:00:28.695881778 +0000 UTC m=+12.937748575" Nov 03 20:00:29.315340 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:29.315295 2576 generic.go:356] "Generic (PLEG): container finished" podID="a445b335-dfaf-41a2-afb5-e9ee45ec471f" containerID="97726df57cee8efff26d2269eb8411780b736536d5c1958310ca3a36c0b236ef" exitCode=0 Nov 03 20:00:29.316513 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:29.316462 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t5q7f" event={"ID":"a445b335-dfaf-41a2-afb5-e9ee45ec471f","Type":"ContainerDied","Data":"97726df57cee8efff26d2269eb8411780b736536d5c1958310ca3a36c0b236ef"} Nov 03 20:00:30.174367 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:30.174339 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:00:30.174470 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:30.174401 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:00:30.174470 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:30.174418 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:00:30.174674 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:30.174517 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wz99q" podUID="30329c02-c760-48d5-86f7-dd265325adb0" Nov 03 20:00:30.174674 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:30.174617 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pslv9" podUID="aae6331f-1f9f-43c8-9610-f554ddebf2e3" Nov 03 20:00:30.174787 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:30.174718 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5gxd" podUID="5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2" Nov 03 20:00:30.319151 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:30.319113 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-crqkf" event={"ID":"b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879","Type":"ContainerStarted","Data":"4fbb34ac58fe8aecdee5cfa215036cb82f84476dae81932b8bfc93663b94dbda"} Nov 03 20:00:30.320795 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:30.320768 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v224g" event={"ID":"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1","Type":"ContainerStarted","Data":"fb49d69bcdc17800b7b08cd4cb242cec2a576010225772c93ab812fc146f6a6b"} Nov 03 20:00:30.324525 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:30.324496 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" event={"ID":"84404c7a-cc47-4e08-861b-a3b417f17e18","Type":"ContainerStarted","Data":"8d4fd090b734038a86e09a519f9edae9d6f86d37d6a9d1814a5d56c66636c525"} Nov 03 20:00:30.438347 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:30.438264 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-crqkf" podStartSLOduration=4.228741512 podStartE2EDuration="13.438245143s" totalImagesPullingTime="9.209503631s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 20:00:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:00:30.43778739 +0000 UTC m=+14.679654183" watchObservedRunningTime="2026-11-03 20:00:30.438245143 +0000 UTC m=+14.680111934" Nov 03 20:00:30.557464 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:30.557407 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-v224g" podStartSLOduration=1.9468444790000001 podStartE2EDuration="13.557392332s" totalImagesPullingTime="11.610547853s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 20:00:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:00:30.557032226 +0000 UTC m=+14.798899031" watchObservedRunningTime="2026-11-03 20:00:30.557392332 +0000 UTC m=+14.799259124" Nov 03 20:00:30.677424 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:30.677366 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" podStartSLOduration=2.781269558 podStartE2EDuration="13.677346079s" totalImagesPullingTime="10.896076521s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 20:00:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:00:30.676698035 +0000 UTC m=+14.918564825" watchObservedRunningTime="2026-11-03 20:00:30.677346079 +0000 UTC m=+14.919212870" Nov 03 20:00:31.328784 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:31.328748 2576 generic.go:356] "Generic (PLEG): container finished" podID="a445b335-dfaf-41a2-afb5-e9ee45ec471f" containerID="9d98527b84d5754d670d3cb0163697e826322444cfe68fc3d54dce94d5af0453" exitCode=0 Nov 03 20:00:31.329478 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:31.328876 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t5q7f" event={"ID":"a445b335-dfaf-41a2-afb5-e9ee45ec471f","Type":"ContainerDied","Data":"9d98527b84d5754d670d3cb0163697e826322444cfe68fc3d54dce94d5af0453"} Nov 03 20:00:32.174385 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:32.174355 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:00:32.174385 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:32.174374 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:00:32.174636 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:32.174480 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5gxd" podUID="5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2" Nov 03 20:00:32.174636 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:32.174544 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:00:32.174743 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:32.174683 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pslv9" podUID="aae6331f-1f9f-43c8-9610-f554ddebf2e3" Nov 03 20:00:32.174793 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:32.174740 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wz99q" podUID="30329c02-c760-48d5-86f7-dd265325adb0" Nov 03 20:00:33.336692 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:33.336455 2576 generic.go:356] "Generic (PLEG): container finished" podID="a445b335-dfaf-41a2-afb5-e9ee45ec471f" containerID="92f1da15d0184ee1adb39f7ae3936e46ea7fd1cd2e5056a619029dd04eebd9d2" exitCode=0 Nov 03 20:00:33.336692 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:33.336632 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t5q7f" event={"ID":"a445b335-dfaf-41a2-afb5-e9ee45ec471f","Type":"ContainerDied","Data":"92f1da15d0184ee1adb39f7ae3936e46ea7fd1cd2e5056a619029dd04eebd9d2"} Nov 03 20:00:33.954724 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:33.954688 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30329c02-c760-48d5-86f7-dd265325adb0-original-pull-secret\") pod \"global-pull-secret-syncer-wz99q\" (UID: \"30329c02-c760-48d5-86f7-dd265325adb0\") " pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:00:33.954901 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:33.954759 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aae6331f-1f9f-43c8-9610-f554ddebf2e3-metrics-certs\") pod \"network-metrics-daemon-pslv9\" (UID: \"aae6331f-1f9f-43c8-9610-f554ddebf2e3\") " pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:00:33.954901 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:33.954832 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 03 20:00:33.954901 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:33.954866 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 20:00:33.954901 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:33.954891 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30329c02-c760-48d5-86f7-dd265325adb0-original-pull-secret podName:30329c02-c760-48d5-86f7-dd265325adb0 nodeName:}" failed. No retries permitted until 2026-11-03 20:00:49.954877223 +0000 UTC m=+34.196744006 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/30329c02-c760-48d5-86f7-dd265325adb0-original-pull-secret") pod "global-pull-secret-syncer-wz99q" (UID: "30329c02-c760-48d5-86f7-dd265325adb0") : object "kube-system"/"original-pull-secret" not registered Nov 03 20:00:33.955047 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:33.954923 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aae6331f-1f9f-43c8-9610-f554ddebf2e3-metrics-certs podName:aae6331f-1f9f-43c8-9610-f554ddebf2e3 nodeName:}" failed. No retries permitted until 2026-11-03 20:00:49.954911 +0000 UTC m=+34.196777790 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aae6331f-1f9f-43c8-9610-f554ddebf2e3-metrics-certs") pod "network-metrics-daemon-pslv9" (UID: "aae6331f-1f9f-43c8-9610-f554ddebf2e3") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 20:00:34.155682 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:34.155648 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsbqv\" (UniqueName: \"kubernetes.io/projected/5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2-kube-api-access-rsbqv\") pod \"network-check-target-x5gxd\" (UID: \"5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2\") " pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:00:34.155842 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:34.155776 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 03 20:00:34.155842 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:34.155789 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 03 20:00:34.155842 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:34.155799 2576 projected.go:196] Error preparing data for projected volume kube-api-access-rsbqv for pod openshift-network-diagnostics/network-check-target-x5gxd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 20:00:34.155951 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:34.155851 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2-kube-api-access-rsbqv podName:5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2 nodeName:}" failed. No retries permitted until 2026-11-03 20:00:50.155838502 +0000 UTC m=+34.397705285 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rsbqv" (UniqueName: "kubernetes.io/projected/5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2-kube-api-access-rsbqv") pod "network-check-target-x5gxd" (UID: "5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 20:00:34.174769 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:34.174740 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:00:34.174889 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:34.174782 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:00:34.174889 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:34.174741 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:00:34.174889 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:34.174854 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pslv9" podUID="aae6331f-1f9f-43c8-9610-f554ddebf2e3" Nov 03 20:00:34.175042 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:34.174909 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wz99q" podUID="30329c02-c760-48d5-86f7-dd265325adb0" Nov 03 20:00:34.175042 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:34.174980 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5gxd" podUID="5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2" Nov 03 20:00:35.344703 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:35.344499 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t5q7f" event={"ID":"a445b335-dfaf-41a2-afb5-e9ee45ec471f","Type":"ContainerStarted","Data":"6db0f74ec684981c725f85660daeb3f0251e17371987e51f62b807c09f954955"} Nov 03 20:00:35.347666 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:35.347641 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7246c" event={"ID":"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb","Type":"ContainerStarted","Data":"90fe5a42c87610f237c33f8448ee3a2e98b4d57a74f481d6e3c224e917fab31b"} Nov 03 20:00:35.347776 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:35.347706 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7246c" event={"ID":"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb","Type":"ContainerStarted","Data":"745d8700d1c3c2bab2105c76ab84ceb90e7e6c897504b1dbd999707c845da6a6"} Nov 03 20:00:35.347776 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:35.347749 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7246c" event={"ID":"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb","Type":"ContainerStarted","Data":"216b8fbea7eaaefe132efcc89941745f32529fd994e9c43eafcbe2a71ab8a8c1"} Nov 03 20:00:35.347841 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:35.347777 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7246c" event={"ID":"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb","Type":"ContainerStarted","Data":"808d9676bc4b715edea088962d3fbe7d0ded6cbe5ec1dc143b5d775517b8cd4c"} Nov 03 20:00:35.347841 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:35.347803 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7246c" event={"ID":"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb","Type":"ContainerStarted","Data":"8dad12c36fb3887266e507d953b867fa8b76eb6a9dbbf8ac13837ea5c8ea407d"} Nov 03 20:00:35.348115 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:35.348078 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7246c" event={"ID":"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb","Type":"ContainerStarted","Data":"4e51ea9a49e3f4f1b3ac7386f973038ab9e178534d43c8dc46aa42bd4f19b75d"} Nov 03 20:00:36.175737 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:36.175705 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:00:36.175906 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:36.175791 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:00:36.175906 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:36.175834 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:00:36.175906 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:36.175842 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wz99q" podUID="30329c02-c760-48d5-86f7-dd265325adb0" Nov 03 20:00:36.176001 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:36.175905 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5gxd" podUID="5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2" Nov 03 20:00:36.176038 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:36.176002 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pslv9" podUID="aae6331f-1f9f-43c8-9610-f554ddebf2e3" Nov 03 20:00:36.352647 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:36.352613 2576 generic.go:356] "Generic (PLEG): container finished" podID="a445b335-dfaf-41a2-afb5-e9ee45ec471f" containerID="6db0f74ec684981c725f85660daeb3f0251e17371987e51f62b807c09f954955" exitCode=0 Nov 03 20:00:36.353009 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:36.352669 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t5q7f" event={"ID":"a445b335-dfaf-41a2-afb5-e9ee45ec471f","Type":"ContainerDied","Data":"6db0f74ec684981c725f85660daeb3f0251e17371987e51f62b807c09f954955"} Nov 03 20:00:37.358350 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:37.358308 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7246c" event={"ID":"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb","Type":"ContainerStarted","Data":"7d2c8165ddd0d36110791814b5f5baee60b82970866e3052ddc8e0c0ad9149e4"} Nov 03 20:00:37.361196 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:37.361170 2576 generic.go:356] "Generic (PLEG): container finished" podID="a445b335-dfaf-41a2-afb5-e9ee45ec471f" containerID="5ade4eca24c3e38b50a6cebd915bcdff6bbe5eb0fb830fb3d422ea5f88273c69" exitCode=0 Nov 03 20:00:37.361316 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:37.361209 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t5q7f" event={"ID":"a445b335-dfaf-41a2-afb5-e9ee45ec471f","Type":"ContainerDied","Data":"5ade4eca24c3e38b50a6cebd915bcdff6bbe5eb0fb830fb3d422ea5f88273c69"} Nov 03 20:00:38.174263 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:38.174231 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:00:38.174473 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:38.174237 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:00:38.174473 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:38.174357 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5gxd" podUID="5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2" Nov 03 20:00:38.174473 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:38.174372 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:00:38.174473 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:38.174459 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pslv9" podUID="aae6331f-1f9f-43c8-9610-f554ddebf2e3" Nov 03 20:00:38.174689 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:38.174582 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wz99q" podUID="30329c02-c760-48d5-86f7-dd265325adb0" Nov 03 20:00:38.366359 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:38.366319 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t5q7f" event={"ID":"a445b335-dfaf-41a2-afb5-e9ee45ec471f","Type":"ContainerStarted","Data":"ccd7df01fc8c077ba659761d7ffde98e9fc8f01e487563b08e88e043d0238445"} Nov 03 20:00:38.489812 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:38.489770 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-t5q7f" podStartSLOduration=8.688652561 podStartE2EDuration="21.489756595s" totalImagesPullingTime="12.801104034s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 20:00:17 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:00:38.489107621 +0000 UTC m=+22.730974413" watchObservedRunningTime="2026-11-03 20:00:38.489756595 +0000 UTC m=+22.731623384" Nov 03 20:00:39.371799 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:39.371759 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7246c" event={"ID":"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb","Type":"ContainerStarted","Data":"9d79347d6c0a9bdbd299b4a1b43d81884e027054223e98fdd53664469996bc4b"} Nov 03 20:00:39.605943 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:39.605736 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7246c" podStartSLOduration=6.825327001 podStartE2EDuration="22.605721166s" totalImagesPullingTime="15.780394165s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 20:00:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:00:39.605163539 +0000 UTC m=+23.847030339" watchObservedRunningTime="2026-11-03 20:00:39.605721166 +0000 UTC m=+23.847587958" Nov 03 20:00:40.174318 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:40.174291 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:00:40.174515 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:40.174368 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:00:40.174515 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:40.174380 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wz99q" podUID="30329c02-c760-48d5-86f7-dd265325adb0" Nov 03 20:00:40.174515 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:40.174294 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:00:40.174515 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:40.174471 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pslv9" podUID="aae6331f-1f9f-43c8-9610-f554ddebf2e3" Nov 03 20:00:40.174757 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:40.174539 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5gxd" podUID="5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2" Nov 03 20:00:40.374803 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:40.374770 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:40.375275 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:40.374869 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:40.375275 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:40.374920 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:40.390854 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:40.390820 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:40.391065 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:40.390942 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:00:41.470815 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:41.470788 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wz99q"] Nov 03 20:00:41.471217 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:41.470882 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:00:41.471217 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:41.470962 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wz99q" podUID="30329c02-c760-48d5-86f7-dd265325adb0" Nov 03 20:00:41.473796 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:41.473763 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-x5gxd"] Nov 03 20:00:41.473917 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:41.473856 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:00:41.473970 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:41.473955 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5gxd" podUID="5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2" Nov 03 20:00:41.474378 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:41.474360 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pslv9"] Nov 03 20:00:41.474438 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:41.474431 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:00:41.474533 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:41.474514 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pslv9" podUID="aae6331f-1f9f-43c8-9610-f554ddebf2e3" Nov 03 20:00:43.173976 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:43.173897 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:00:43.174344 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:43.173904 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:00:43.174344 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:43.174002 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pslv9" podUID="aae6331f-1f9f-43c8-9610-f554ddebf2e3" Nov 03 20:00:43.174344 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:43.174010 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:00:43.174344 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:43.174096 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wz99q" podUID="30329c02-c760-48d5-86f7-dd265325adb0" Nov 03 20:00:43.174344 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:43.174182 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5gxd" podUID="5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2" Nov 03 20:00:45.174554 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:45.174465 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:00:45.174554 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:45.174465 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:00:45.174990 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:45.174602 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pslv9" podUID="aae6331f-1f9f-43c8-9610-f554ddebf2e3" Nov 03 20:00:45.174990 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:45.174465 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:00:45.174990 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:45.174677 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5gxd" podUID="5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2" Nov 03 20:00:45.174990 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:45.174723 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wz99q" podUID="30329c02-c760-48d5-86f7-dd265325adb0" Nov 03 20:00:47.174580 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:47.174467 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:00:47.174580 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:47.174469 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:00:47.174995 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:47.174610 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pslv9" podUID="aae6331f-1f9f-43c8-9610-f554ddebf2e3" Nov 03 20:00:47.174995 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:47.174658 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:00:47.174995 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:47.174737 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wz99q" podUID="30329c02-c760-48d5-86f7-dd265325adb0" Nov 03 20:00:47.174995 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:47.174797 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5gxd" podUID="5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2" Nov 03 20:00:49.174001 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:49.173968 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:00:49.174379 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:49.174072 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:00:49.174379 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:49.174083 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pslv9" podUID="aae6331f-1f9f-43c8-9610-f554ddebf2e3" Nov 03 20:00:49.174379 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:49.174098 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:00:49.174379 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:49.174171 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5gxd" podUID="5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2" Nov 03 20:00:49.174379 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:49.174229 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wz99q" podUID="30329c02-c760-48d5-86f7-dd265325adb0" Nov 03 20:00:49.967898 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:49.967860 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30329c02-c760-48d5-86f7-dd265325adb0-original-pull-secret\") pod \"global-pull-secret-syncer-wz99q\" (UID: \"30329c02-c760-48d5-86f7-dd265325adb0\") " pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:00:49.968158 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:49.967921 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aae6331f-1f9f-43c8-9610-f554ddebf2e3-metrics-certs\") pod \"network-metrics-daemon-pslv9\" (UID: \"aae6331f-1f9f-43c8-9610-f554ddebf2e3\") " pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:00:49.968158 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:49.968020 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 20:00:49.968158 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:49.968021 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 03 20:00:49.968158 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:49.968077 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aae6331f-1f9f-43c8-9610-f554ddebf2e3-metrics-certs podName:aae6331f-1f9f-43c8-9610-f554ddebf2e3 nodeName:}" failed. No retries permitted until 2026-11-03 20:01:21.968062658 +0000 UTC m=+66.209929427 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aae6331f-1f9f-43c8-9610-f554ddebf2e3-metrics-certs") pod "network-metrics-daemon-pslv9" (UID: "aae6331f-1f9f-43c8-9610-f554ddebf2e3") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 20:00:49.968158 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:49.968091 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30329c02-c760-48d5-86f7-dd265325adb0-original-pull-secret podName:30329c02-c760-48d5-86f7-dd265325adb0 nodeName:}" failed. No retries permitted until 2026-11-03 20:01:21.968085135 +0000 UTC m=+66.209951905 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/30329c02-c760-48d5-86f7-dd265325adb0-original-pull-secret") pod "global-pull-secret-syncer-wz99q" (UID: "30329c02-c760-48d5-86f7-dd265325adb0") : object "kube-system"/"original-pull-secret" not registered Nov 03 20:00:50.169620 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:50.169584 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsbqv\" (UniqueName: \"kubernetes.io/projected/5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2-kube-api-access-rsbqv\") pod \"network-check-target-x5gxd\" (UID: \"5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2\") " pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:00:50.169808 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:50.169743 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 03 20:00:50.169808 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:50.169769 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 03 20:00:50.169808 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:50.169781 2576 projected.go:196] Error preparing data for projected volume kube-api-access-rsbqv for pod openshift-network-diagnostics/network-check-target-x5gxd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 20:00:50.169919 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:50.169834 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2-kube-api-access-rsbqv podName:5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2 nodeName:}" failed. No retries permitted until 2026-11-03 20:01:22.169818954 +0000 UTC m=+66.411685723 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rsbqv" (UniqueName: "kubernetes.io/projected/5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2-kube-api-access-rsbqv") pod "network-check-target-x5gxd" (UID: "5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 20:00:51.174433 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:51.174346 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:00:51.174433 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:51.174365 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:00:51.174913 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:51.174451 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5gxd" podUID="5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2" Nov 03 20:00:51.174913 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:51.174552 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pslv9" podUID="aae6331f-1f9f-43c8-9610-f554ddebf2e3" Nov 03 20:00:51.174913 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:51.174628 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:00:51.174913 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:51.174682 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wz99q" podUID="30329c02-c760-48d5-86f7-dd265325adb0" Nov 03 20:00:52.846658 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:52.846634 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8t9mw_ccbc5713-cd4c-455b-9162-f4ecfedde1f7/dns-node-resolver/0.log" Nov 03 20:00:53.174449 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:53.174364 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:00:53.174644 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:53.174459 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:00:53.174644 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:53.174475 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:00:53.174644 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:53.174459 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5gxd" podUID="5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2" Nov 03 20:00:53.174644 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:53.174611 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pslv9" podUID="aae6331f-1f9f-43c8-9610-f554ddebf2e3" Nov 03 20:00:53.174869 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:53.174652 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wz99q" podUID="30329c02-c760-48d5-86f7-dd265325adb0" Nov 03 20:00:54.072340 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:54.072312 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ts79p_2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3/node-ca/0.log" Nov 03 20:00:55.174759 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:55.174722 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:00:55.175229 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:55.174729 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:00:55.175229 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:55.174826 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wz99q" podUID="30329c02-c760-48d5-86f7-dd265325adb0" Nov 03 20:00:55.175229 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:55.174728 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:00:55.175229 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:55.174906 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pslv9" podUID="aae6331f-1f9f-43c8-9610-f554ddebf2e3" Nov 03 20:00:55.175229 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:55.175000 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5gxd" podUID="5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2" Nov 03 20:00:57.174504 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:57.174455 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:00:57.175013 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:57.174556 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:00:57.175013 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:57.174692 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:00:57.175013 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:57.174715 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wz99q" podUID="30329c02-c760-48d5-86f7-dd265325adb0" Nov 03 20:00:57.175013 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:57.174795 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pslv9" podUID="aae6331f-1f9f-43c8-9610-f554ddebf2e3" Nov 03 20:00:57.175013 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:57.174850 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5gxd" podUID="5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2" Nov 03 20:00:59.174500 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:59.174424 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:00:59.174865 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:59.174531 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:00:59.174865 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:00:59.174536 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:00:59.174865 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:59.174533 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wz99q" podUID="30329c02-c760-48d5-86f7-dd265325adb0" Nov 03 20:00:59.174865 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:59.174624 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5gxd" podUID="5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2" Nov 03 20:00:59.174865 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:00:59.174672 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pslv9" podUID="aae6331f-1f9f-43c8-9610-f554ddebf2e3" Nov 03 20:01:01.174762 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:01.174723 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:01:01.175254 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:01.174816 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:01:01.175254 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:01:01.174822 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wz99q" podUID="30329c02-c760-48d5-86f7-dd265325adb0" Nov 03 20:01:01.175254 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:01:01.174923 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pslv9" podUID="aae6331f-1f9f-43c8-9610-f554ddebf2e3" Nov 03 20:01:01.175254 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:01.174950 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:01:01.175254 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:01:01.174996 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5gxd" podUID="5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2" Nov 03 20:01:03.174601 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:03.174547 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:01:03.174601 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:03.174594 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:01:03.175056 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:03.174549 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:01:03.175056 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:01:03.174676 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wz99q" podUID="30329c02-c760-48d5-86f7-dd265325adb0" Nov 03 20:01:03.175056 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:01:03.174736 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pslv9" podUID="aae6331f-1f9f-43c8-9610-f554ddebf2e3" Nov 03 20:01:03.175056 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:01:03.174790 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5gxd" podUID="5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2" Nov 03 20:01:05.174116 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:05.174076 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:01:05.174116 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:05.174120 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:01:05.174622 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:05.174177 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:01:05.174622 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:01:05.174189 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5gxd" podUID="5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2" Nov 03 20:01:05.174622 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:01:05.174278 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wz99q" podUID="30329c02-c760-48d5-86f7-dd265325adb0" Nov 03 20:01:05.174622 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:01:05.174408 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pslv9" podUID="aae6331f-1f9f-43c8-9610-f554ddebf2e3" Nov 03 20:01:07.174534 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:07.174490 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:01:07.174534 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:07.174519 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:01:07.174982 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:07.174508 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:01:07.174982 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:01:07.174634 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5gxd" podUID="5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2" Nov 03 20:01:07.174982 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:01:07.174748 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wz99q" podUID="30329c02-c760-48d5-86f7-dd265325adb0" Nov 03 20:01:07.174982 ip-10-0-140-181 kubenswrapper[2576]: E1103 20:01:07.174814 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pslv9" podUID="aae6331f-1f9f-43c8-9610-f554ddebf2e3" Nov 03 20:01:08.509539 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.509468 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-181.us-west-1.compute.internal" event="NodeReady" Nov 03 20:01:08.509904 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.509600 2576 kubelet_node_status.go:477] "Fast updating node status as it just became ready" Nov 03 20:01:08.678676 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.678646 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-s2xtj"] Nov 03 20:01:08.680607 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.680582 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pbv28"] Nov 03 20:01:08.680741 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.680687 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s2xtj" Nov 03 20:01:08.683045 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.683028 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gt9b8"] Nov 03 20:01:08.683172 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.683155 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pbv28" Nov 03 20:01:08.684745 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.684730 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s2xtj"] Nov 03 20:01:08.684825 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.684814 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gt9b8" Nov 03 20:01:08.692001 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.691978 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pbv28"] Nov 03 20:01:08.712000 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.711979 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gt9b8"] Nov 03 20:01:08.735689 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.735663 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Nov 03 20:01:08.735689 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.735674 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rmlxz\"" Nov 03 20:01:08.738118 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.738101 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Nov 03 20:01:08.784002 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.783924 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Nov 03 20:01:08.784002 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.783934 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Nov 03 20:01:08.784002 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.783929 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Nov 03 20:01:08.784002 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.783931 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Nov 03 20:01:08.784002 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.783934 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Nov 03 20:01:08.784002 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.783932 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Nov 03 20:01:08.797182 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.797156 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7acfd1d0-46c5-4c12-a419-597cc58d88f1-metrics-tls\") pod \"dns-default-s2xtj\" (UID: \"7acfd1d0-46c5-4c12-a419-597cc58d88f1\") " pod="openshift-dns/dns-default-s2xtj" Nov 03 20:01:08.797272 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.797189 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gt9b8\" (UID: \"22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9\") " pod="openshift-insights/insights-runtime-extractor-gt9b8" Nov 03 20:01:08.797272 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.797216 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7acfd1d0-46c5-4c12-a419-597cc58d88f1-config-volume\") pod \"dns-default-s2xtj\" (UID: \"7acfd1d0-46c5-4c12-a419-597cc58d88f1\") " pod="openshift-dns/dns-default-s2xtj" Nov 03 20:01:08.797352 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.797268 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/999ebe89-05a8-4bae-ba5b-b756dd69b073-cert\") pod \"ingress-canary-pbv28\" (UID: \"999ebe89-05a8-4bae-ba5b-b756dd69b073\") " pod="openshift-ingress-canary/ingress-canary-pbv28" Nov 03 20:01:08.797352 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.797331 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9-data-volume\") pod \"insights-runtime-extractor-gt9b8\" (UID: \"22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9\") " pod="openshift-insights/insights-runtime-extractor-gt9b8" Nov 03 20:01:08.797435 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.797351 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjlrv\" (UniqueName: \"kubernetes.io/projected/22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9-kube-api-access-jjlrv\") pod \"insights-runtime-extractor-gt9b8\" (UID: \"22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9\") " pod="openshift-insights/insights-runtime-extractor-gt9b8" Nov 03 20:01:08.797435 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.797371 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77q8n\" (UniqueName: \"kubernetes.io/projected/999ebe89-05a8-4bae-ba5b-b756dd69b073-kube-api-access-77q8n\") pod \"ingress-canary-pbv28\" (UID: \"999ebe89-05a8-4bae-ba5b-b756dd69b073\") " pod="openshift-ingress-canary/ingress-canary-pbv28" Nov 03 20:01:08.797625 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.797447 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqz58\" (UniqueName: \"kubernetes.io/projected/7acfd1d0-46c5-4c12-a419-597cc58d88f1-kube-api-access-nqz58\") pod \"dns-default-s2xtj\" (UID: \"7acfd1d0-46c5-4c12-a419-597cc58d88f1\") " pod="openshift-dns/dns-default-s2xtj" Nov 03 20:01:08.797625 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.797509 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7acfd1d0-46c5-4c12-a419-597cc58d88f1-tmp-dir\") pod \"dns-default-s2xtj\" (UID: \"7acfd1d0-46c5-4c12-a419-597cc58d88f1\") " pod="openshift-dns/dns-default-s2xtj" Nov 03 20:01:08.797625 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.797538 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gt9b8\" (UID: \"22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9\") " pod="openshift-insights/insights-runtime-extractor-gt9b8" Nov 03 20:01:08.797625 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.797594 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9-crio-socket\") pod \"insights-runtime-extractor-gt9b8\" (UID: \"22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9\") " pod="openshift-insights/insights-runtime-extractor-gt9b8" Nov 03 20:01:08.837127 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.837092 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-p4th4\"" Nov 03 20:01:08.837259 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.837150 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Nov 03 20:01:08.837259 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.837219 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-d6hfg\"" Nov 03 20:01:08.898600 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.898576 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7acfd1d0-46c5-4c12-a419-597cc58d88f1-metrics-tls\") pod \"dns-default-s2xtj\" (UID: \"7acfd1d0-46c5-4c12-a419-597cc58d88f1\") " pod="openshift-dns/dns-default-s2xtj" Nov 03 20:01:08.898673 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.898611 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gt9b8\" (UID: \"22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9\") " pod="openshift-insights/insights-runtime-extractor-gt9b8" Nov 03 20:01:08.898673 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.898631 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7acfd1d0-46c5-4c12-a419-597cc58d88f1-config-volume\") pod \"dns-default-s2xtj\" (UID: \"7acfd1d0-46c5-4c12-a419-597cc58d88f1\") " pod="openshift-dns/dns-default-s2xtj" Nov 03 20:01:08.898673 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.898646 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/999ebe89-05a8-4bae-ba5b-b756dd69b073-cert\") pod \"ingress-canary-pbv28\" (UID: \"999ebe89-05a8-4bae-ba5b-b756dd69b073\") " pod="openshift-ingress-canary/ingress-canary-pbv28" Nov 03 20:01:08.898673 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.898663 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9-data-volume\") pod \"insights-runtime-extractor-gt9b8\" (UID: \"22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9\") " pod="openshift-insights/insights-runtime-extractor-gt9b8" Nov 03 20:01:08.898852 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.898678 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjlrv\" (UniqueName: \"kubernetes.io/projected/22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9-kube-api-access-jjlrv\") pod \"insights-runtime-extractor-gt9b8\" (UID: \"22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9\") " pod="openshift-insights/insights-runtime-extractor-gt9b8" Nov 03 20:01:08.898852 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.898697 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77q8n\" (UniqueName: \"kubernetes.io/projected/999ebe89-05a8-4bae-ba5b-b756dd69b073-kube-api-access-77q8n\") pod \"ingress-canary-pbv28\" (UID: \"999ebe89-05a8-4bae-ba5b-b756dd69b073\") " pod="openshift-ingress-canary/ingress-canary-pbv28" Nov 03 20:01:08.898852 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.898726 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqz58\" (UniqueName: \"kubernetes.io/projected/7acfd1d0-46c5-4c12-a419-597cc58d88f1-kube-api-access-nqz58\") pod \"dns-default-s2xtj\" (UID: \"7acfd1d0-46c5-4c12-a419-597cc58d88f1\") " pod="openshift-dns/dns-default-s2xtj" Nov 03 20:01:08.898852 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.898756 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7acfd1d0-46c5-4c12-a419-597cc58d88f1-tmp-dir\") pod \"dns-default-s2xtj\" (UID: \"7acfd1d0-46c5-4c12-a419-597cc58d88f1\") " pod="openshift-dns/dns-default-s2xtj" Nov 03 20:01:08.898852 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.898780 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gt9b8\" (UID: \"22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9\") " pod="openshift-insights/insights-runtime-extractor-gt9b8" Nov 03 20:01:08.898852 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.898808 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9-crio-socket\") pod \"insights-runtime-extractor-gt9b8\" (UID: \"22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9\") " pod="openshift-insights/insights-runtime-extractor-gt9b8" Nov 03 20:01:08.899130 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.899009 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9-crio-socket\") pod \"insights-runtime-extractor-gt9b8\" (UID: \"22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9\") " pod="openshift-insights/insights-runtime-extractor-gt9b8" Nov 03 20:01:08.899315 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.899287 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9-data-volume\") pod \"insights-runtime-extractor-gt9b8\" (UID: \"22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9\") " pod="openshift-insights/insights-runtime-extractor-gt9b8" Nov 03 20:01:08.899521 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.899499 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7acfd1d0-46c5-4c12-a419-597cc58d88f1-tmp-dir\") pod \"dns-default-s2xtj\" (UID: \"7acfd1d0-46c5-4c12-a419-597cc58d88f1\") " pod="openshift-dns/dns-default-s2xtj" Nov 03 20:01:08.899612 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.899541 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gt9b8\" (UID: \"22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9\") " pod="openshift-insights/insights-runtime-extractor-gt9b8" Nov 03 20:01:08.899760 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.899739 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7acfd1d0-46c5-4c12-a419-597cc58d88f1-config-volume\") pod \"dns-default-s2xtj\" (UID: \"7acfd1d0-46c5-4c12-a419-597cc58d88f1\") " pod="openshift-dns/dns-default-s2xtj" Nov 03 20:01:08.902212 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.902192 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7acfd1d0-46c5-4c12-a419-597cc58d88f1-metrics-tls\") pod \"dns-default-s2xtj\" (UID: \"7acfd1d0-46c5-4c12-a419-597cc58d88f1\") " pod="openshift-dns/dns-default-s2xtj" Nov 03 20:01:08.902308 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.902268 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gt9b8\" (UID: \"22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9\") " pod="openshift-insights/insights-runtime-extractor-gt9b8" Nov 03 20:01:08.902308 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.902292 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/999ebe89-05a8-4bae-ba5b-b756dd69b073-cert\") pod \"ingress-canary-pbv28\" (UID: \"999ebe89-05a8-4bae-ba5b-b756dd69b073\") " pod="openshift-ingress-canary/ingress-canary-pbv28" Nov 03 20:01:08.961692 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.961663 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqz58\" (UniqueName: \"kubernetes.io/projected/7acfd1d0-46c5-4c12-a419-597cc58d88f1-kube-api-access-nqz58\") pod \"dns-default-s2xtj\" (UID: \"7acfd1d0-46c5-4c12-a419-597cc58d88f1\") " pod="openshift-dns/dns-default-s2xtj" Nov 03 20:01:08.961692 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.961690 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjlrv\" (UniqueName: \"kubernetes.io/projected/22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9-kube-api-access-jjlrv\") pod \"insights-runtime-extractor-gt9b8\" (UID: \"22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9\") " pod="openshift-insights/insights-runtime-extractor-gt9b8" Nov 03 20:01:08.961873 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.961743 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77q8n\" (UniqueName: \"kubernetes.io/projected/999ebe89-05a8-4bae-ba5b-b756dd69b073-kube-api-access-77q8n\") pod \"ingress-canary-pbv28\" (UID: \"999ebe89-05a8-4bae-ba5b-b756dd69b073\") " pod="openshift-ingress-canary/ingress-canary-pbv28" Nov 03 20:01:08.993297 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.993271 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s2xtj" Nov 03 20:01:08.999832 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:08.999807 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pbv28" Nov 03 20:01:09.006403 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:09.006383 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gt9b8" Nov 03 20:01:09.174682 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:09.174639 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:01:09.174682 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:09.174660 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:01:09.174935 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:09.174851 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:01:09.229332 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:09.229303 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Nov 03 20:01:09.229625 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:09.229380 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Nov 03 20:01:09.229625 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:09.229456 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-kbkmq\"" Nov 03 20:01:09.229625 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:09.229603 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-nwkgp\"" Nov 03 20:01:09.229625 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:09.229614 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vw2xk\"" Nov 03 20:01:09.229803 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:09.229629 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Nov 03 20:01:09.229803 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:09.229647 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Nov 03 20:01:09.381899 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:09.381671 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pbv28"] Nov 03 20:01:09.384643 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:01:09.384612 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod999ebe89_05a8_4bae_ba5b_b756dd69b073.slice/crio-d5f9d4a516c2641c72f78d01228d85b5ac97190650053ad91869207f58b72259 WatchSource:0}: Error finding container d5f9d4a516c2641c72f78d01228d85b5ac97190650053ad91869207f58b72259: Status 404 returned error can't find the container with id d5f9d4a516c2641c72f78d01228d85b5ac97190650053ad91869207f58b72259 Nov 03 20:01:09.437114 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:09.437079 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pbv28" event={"ID":"999ebe89-05a8-4bae-ba5b-b756dd69b073","Type":"ContainerStarted","Data":"d5f9d4a516c2641c72f78d01228d85b5ac97190650053ad91869207f58b72259"} Nov 03 20:01:09.438116 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:09.438091 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s2xtj"] Nov 03 20:01:09.438232 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:09.438146 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gt9b8"] Nov 03 20:01:09.440890 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:01:09.440866 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22f4ca73_ade8_44d0_a45d_62ca0a9bcfb9.slice/crio-a50278cd6c9777df22e5b3d318fe96b833221b657b96777c122692df98859471 WatchSource:0}: Error finding container a50278cd6c9777df22e5b3d318fe96b833221b657b96777c122692df98859471: Status 404 returned error can't find the container with id a50278cd6c9777df22e5b3d318fe96b833221b657b96777c122692df98859471 Nov 03 20:01:09.441860 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:01:09.441835 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7acfd1d0_46c5_4c12_a419_597cc58d88f1.slice/crio-e95e79534ee3bdcb9b3e17d9e55af8360d35af5b5b2313ad46ad4b8097896fe4 WatchSource:0}: Error finding container e95e79534ee3bdcb9b3e17d9e55af8360d35af5b5b2313ad46ad4b8097896fe4: Status 404 returned error can't find the container with id e95e79534ee3bdcb9b3e17d9e55af8360d35af5b5b2313ad46ad4b8097896fe4 Nov 03 20:01:10.164508 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:10.164479 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kl7g8"] Nov 03 20:01:10.166388 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:10.166373 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kl7g8" Nov 03 20:01:10.219778 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:10.219745 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Nov 03 20:01:10.219962 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:10.219953 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-sd4tl\"" Nov 03 20:01:10.224775 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:10.224748 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kl7g8"] Nov 03 20:01:10.309380 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:10.309343 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0c479f18-0308-403a-adf1-42575f8adfa2-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-kl7g8\" (UID: \"0c479f18-0308-403a-adf1-42575f8adfa2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kl7g8" Nov 03 20:01:10.410305 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:10.410245 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0c479f18-0308-403a-adf1-42575f8adfa2-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-kl7g8\" (UID: \"0c479f18-0308-403a-adf1-42575f8adfa2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kl7g8" Nov 03 20:01:10.414336 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:10.414308 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0c479f18-0308-403a-adf1-42575f8adfa2-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-kl7g8\" (UID: \"0c479f18-0308-403a-adf1-42575f8adfa2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kl7g8" Nov 03 20:01:10.443138 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:10.442983 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gt9b8" event={"ID":"22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9","Type":"ContainerStarted","Data":"db828c3a311c247113f0fbb4a3351489afdc47879bf22ce886c2f9f8b4f93807"} Nov 03 20:01:10.443138 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:10.443054 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gt9b8" event={"ID":"22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9","Type":"ContainerStarted","Data":"a50278cd6c9777df22e5b3d318fe96b833221b657b96777c122692df98859471"} Nov 03 20:01:10.444711 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:10.444682 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s2xtj" event={"ID":"7acfd1d0-46c5-4c12-a419-597cc58d88f1","Type":"ContainerStarted","Data":"e95e79534ee3bdcb9b3e17d9e55af8360d35af5b5b2313ad46ad4b8097896fe4"} Nov 03 20:01:10.476074 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:10.476039 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kl7g8" Nov 03 20:01:10.861486 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:10.860457 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kl7g8"] Nov 03 20:01:10.864882 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:01:10.864847 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c479f18_0308_403a_adf1_42575f8adfa2.slice/crio-a6944b1f2d00e498ad7cb060325ecc52f29922dde9e0a0add0f38e424d92427e WatchSource:0}: Error finding container a6944b1f2d00e498ad7cb060325ecc52f29922dde9e0a0add0f38e424d92427e: Status 404 returned error can't find the container with id a6944b1f2d00e498ad7cb060325ecc52f29922dde9e0a0add0f38e424d92427e Nov 03 20:01:11.450417 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:11.450372 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gt9b8" event={"ID":"22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9","Type":"ContainerStarted","Data":"1abe37c62ed1b7f6fca8f8ead8152e46e92517134c73f9b18cea21403f62722c"} Nov 03 20:01:11.451818 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:11.451788 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kl7g8" event={"ID":"0c479f18-0308-403a-adf1-42575f8adfa2","Type":"ContainerStarted","Data":"a6944b1f2d00e498ad7cb060325ecc52f29922dde9e0a0add0f38e424d92427e"} Nov 03 20:01:12.393512 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:12.393477 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:12.457279 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:12.457245 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s2xtj" event={"ID":"7acfd1d0-46c5-4c12-a419-597cc58d88f1","Type":"ContainerStarted","Data":"c14be41e1a32aa1dc527990a7a0f457ce12931bee0bea5ea311909c7837cea73"} Nov 03 20:01:12.457774 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:12.457306 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s2xtj" event={"ID":"7acfd1d0-46c5-4c12-a419-597cc58d88f1","Type":"ContainerStarted","Data":"4f031bd15811b5824228a89580415f51f48982d57bff5fa80c31c579b37df568"} Nov 03 20:01:12.457904 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:12.457886 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-s2xtj" Nov 03 20:01:12.749672 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:12.749623 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-s2xtj" podStartSLOduration=2.429633074 podStartE2EDuration="4.749606003s" totalImagesPullingTime="2.319972929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:01:12.749436274 +0000 UTC m=+56.991303069" watchObservedRunningTime="2026-11-03 20:01:12.749606003 +0000 UTC m=+56.991472795" Nov 03 20:01:13.462775 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:13.462740 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gt9b8" event={"ID":"22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9","Type":"ContainerStarted","Data":"857f8e18498401c1755272c7e2c726b59b2404e857790eeecf0e447620145f82"} Nov 03 20:01:13.464249 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:13.464228 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pbv28" event={"ID":"999ebe89-05a8-4bae-ba5b-b756dd69b073","Type":"ContainerStarted","Data":"bdc8ff70b01b80bff71ab837b88432f89617c893408f33de8c3eb8b9561648ee"} Nov 03 20:01:13.465674 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:13.465651 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kl7g8" event={"ID":"0c479f18-0308-403a-adf1-42575f8adfa2","Type":"ContainerStarted","Data":"56bf2da941eb0ca3343396cb3dfec6af64d8b9a86b35bab3f50e9b3b3813714f"} Nov 03 20:01:13.465845 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:13.465827 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kl7g8" Nov 03 20:01:13.470367 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:13.470347 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kl7g8" Nov 03 20:01:13.583118 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:13.583060 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gt9b8" podStartSLOduration=2.497680252 podStartE2EDuration="5.583043682s" totalImagesPullingTime="3.08536343s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 20:01:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:01:13.58252534 +0000 UTC m=+57.824392132" watchObservedRunningTime="2026-11-03 20:01:13.583043682 +0000 UTC m=+57.824910474" Nov 03 20:01:13.699762 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:13.699706 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pbv28" podStartSLOduration=2.315008994 podStartE2EDuration="5.699690382s" totalImagesPullingTime="3.384681388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:01:13.699201494 +0000 UTC m=+57.941068298" watchObservedRunningTime="2026-11-03 20:01:13.699690382 +0000 UTC m=+57.941557187" Nov 03 20:01:13.816734 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:13.816634 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kl7g8" podStartSLOduration=2.187075679 podStartE2EDuration="3.816619919s" totalImagesPullingTime="1.62954424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:01:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:01:13.816031514 +0000 UTC m=+58.057898306" watchObservedRunningTime="2026-11-03 20:01:13.816619919 +0000 UTC m=+58.058486710" Nov 03 20:01:14.800304 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:14.800268 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-v5lh8"] Nov 03 20:01:14.802227 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:14.802211 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-v5lh8" Nov 03 20:01:14.848298 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:14.848254 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62a2d16f-a781-4b20-ae3e-323c123f9ac0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-v5lh8\" (UID: \"62a2d16f-a781-4b20-ae3e-323c123f9ac0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-v5lh8" Nov 03 20:01:14.848475 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:14.848326 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62a2d16f-a781-4b20-ae3e-323c123f9ac0-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-v5lh8\" (UID: \"62a2d16f-a781-4b20-ae3e-323c123f9ac0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-v5lh8" Nov 03 20:01:14.848475 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:14.848389 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/62a2d16f-a781-4b20-ae3e-323c123f9ac0-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-v5lh8\" (UID: \"62a2d16f-a781-4b20-ae3e-323c123f9ac0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-v5lh8" Nov 03 20:01:14.848475 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:14.848446 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7l96\" (UniqueName: \"kubernetes.io/projected/62a2d16f-a781-4b20-ae3e-323c123f9ac0-kube-api-access-f7l96\") pod \"prometheus-operator-9cd89b74c-v5lh8\" (UID: \"62a2d16f-a781-4b20-ae3e-323c123f9ac0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-v5lh8" Nov 03 20:01:14.907035 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:14.907005 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Nov 03 20:01:14.907035 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:14.907005 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Nov 03 20:01:14.907035 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:14.907040 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-6zq2q\"" Nov 03 20:01:14.907260 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:14.907112 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Nov 03 20:01:14.907260 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:14.907184 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Nov 03 20:01:14.907260 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:14.907213 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Nov 03 20:01:14.949509 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:14.949475 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62a2d16f-a781-4b20-ae3e-323c123f9ac0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-v5lh8\" (UID: \"62a2d16f-a781-4b20-ae3e-323c123f9ac0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-v5lh8" Nov 03 20:01:14.949634 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:14.949526 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62a2d16f-a781-4b20-ae3e-323c123f9ac0-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-v5lh8\" (UID: \"62a2d16f-a781-4b20-ae3e-323c123f9ac0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-v5lh8" Nov 03 20:01:14.949634 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:14.949544 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/62a2d16f-a781-4b20-ae3e-323c123f9ac0-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-v5lh8\" (UID: \"62a2d16f-a781-4b20-ae3e-323c123f9ac0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-v5lh8" Nov 03 20:01:14.949634 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:14.949585 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7l96\" (UniqueName: \"kubernetes.io/projected/62a2d16f-a781-4b20-ae3e-323c123f9ac0-kube-api-access-f7l96\") pod \"prometheus-operator-9cd89b74c-v5lh8\" (UID: \"62a2d16f-a781-4b20-ae3e-323c123f9ac0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-v5lh8" Nov 03 20:01:14.950344 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:14.950319 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62a2d16f-a781-4b20-ae3e-323c123f9ac0-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-v5lh8\" (UID: \"62a2d16f-a781-4b20-ae3e-323c123f9ac0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-v5lh8" Nov 03 20:01:14.952131 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:14.952109 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62a2d16f-a781-4b20-ae3e-323c123f9ac0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-v5lh8\" (UID: \"62a2d16f-a781-4b20-ae3e-323c123f9ac0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-v5lh8" Nov 03 20:01:14.952248 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:14.952232 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/62a2d16f-a781-4b20-ae3e-323c123f9ac0-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-v5lh8\" (UID: \"62a2d16f-a781-4b20-ae3e-323c123f9ac0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-v5lh8" Nov 03 20:01:14.958824 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:14.958801 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-v5lh8"] Nov 03 20:01:15.013231 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:15.013193 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7l96\" (UniqueName: \"kubernetes.io/projected/62a2d16f-a781-4b20-ae3e-323c123f9ac0-kube-api-access-f7l96\") pod \"prometheus-operator-9cd89b74c-v5lh8\" (UID: \"62a2d16f-a781-4b20-ae3e-323c123f9ac0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-v5lh8" Nov 03 20:01:15.112728 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:15.112630 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-v5lh8" Nov 03 20:01:15.480483 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:15.480461 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-v5lh8"] Nov 03 20:01:15.482800 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:01:15.482775 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62a2d16f_a781_4b20_ae3e_323c123f9ac0.slice/crio-2e62244c4b8d4f787091f14f1780b2d2571c5607d819f1e1d8e4b1cedeeb7604 WatchSource:0}: Error finding container 2e62244c4b8d4f787091f14f1780b2d2571c5607d819f1e1d8e4b1cedeeb7604: Status 404 returned error can't find the container with id 2e62244c4b8d4f787091f14f1780b2d2571c5607d819f1e1d8e4b1cedeeb7604 Nov 03 20:01:16.477338 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:16.477299 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-v5lh8" event={"ID":"62a2d16f-a781-4b20-ae3e-323c123f9ac0","Type":"ContainerStarted","Data":"2e62244c4b8d4f787091f14f1780b2d2571c5607d819f1e1d8e4b1cedeeb7604"} Nov 03 20:01:17.482155 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:17.482118 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-v5lh8" event={"ID":"62a2d16f-a781-4b20-ae3e-323c123f9ac0","Type":"ContainerStarted","Data":"50b8d65d98e60484432b1251e529bc7c5ffd28857d365e62a5d9d80c88a429f0"} Nov 03 20:01:17.482578 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:17.482214 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-v5lh8" event={"ID":"62a2d16f-a781-4b20-ae3e-323c123f9ac0","Type":"ContainerStarted","Data":"9cb0da6c0a383b7156a768423e81a3e495039e38023808b27e00ba41a190a997"} Nov 03 20:01:17.600837 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:17.600787 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-9cd89b74c-v5lh8" podStartSLOduration=2.109910386 podStartE2EDuration="3.600774304s" totalImagesPullingTime="1.490863918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:01:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:01:17.60049935 +0000 UTC m=+61.842366149" watchObservedRunningTime="2026-11-03 20:01:17.600774304 +0000 UTC m=+61.842641095" Nov 03 20:01:19.698785 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:19.698747 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-577678865d-sxpjq"] Nov 03 20:01:19.700793 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:19.700777 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:19.754411 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:19.754368 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Nov 03 20:01:19.782015 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:19.781978 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Nov 03 20:01:19.786200 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:19.786174 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e720aa2-db14-40f6-b905-0155bcbd7809-service-ca\") pod \"console-577678865d-sxpjq\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:19.786279 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:19.786211 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e720aa2-db14-40f6-b905-0155bcbd7809-oauth-serving-cert\") pod \"console-577678865d-sxpjq\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:19.786353 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:19.786335 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e720aa2-db14-40f6-b905-0155bcbd7809-tmp\") pod \"console-577678865d-sxpjq\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:19.786502 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:19.786472 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e720aa2-db14-40f6-b905-0155bcbd7809-console-config\") pod \"console-577678865d-sxpjq\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:19.786593 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:19.786549 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e720aa2-db14-40f6-b905-0155bcbd7809-console-oauth-config\") pod \"console-577678865d-sxpjq\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:19.786650 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:19.786608 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sj4s\" (UniqueName: \"kubernetes.io/projected/0e720aa2-db14-40f6-b905-0155bcbd7809-kube-api-access-6sj4s\") pod \"console-577678865d-sxpjq\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:19.786685 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:19.786656 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e720aa2-db14-40f6-b905-0155bcbd7809-console-serving-cert\") pod \"console-577678865d-sxpjq\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:19.804733 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:19.804701 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Nov 03 20:01:19.804883 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:19.804757 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Nov 03 20:01:19.804883 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:19.804774 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Nov 03 20:01:19.804883 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:19.804757 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Nov 03 20:01:19.804883 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:19.804792 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-swft6\"" Nov 03 20:01:19.805010 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:19.804892 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Nov 03 20:01:19.805785 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:19.805766 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-577678865d-sxpjq"] Nov 03 20:01:19.887927 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:19.887887 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e720aa2-db14-40f6-b905-0155bcbd7809-console-config\") pod \"console-577678865d-sxpjq\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:19.887927 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:19.887926 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e720aa2-db14-40f6-b905-0155bcbd7809-console-oauth-config\") pod \"console-577678865d-sxpjq\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:19.888185 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:19.887945 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sj4s\" (UniqueName: \"kubernetes.io/projected/0e720aa2-db14-40f6-b905-0155bcbd7809-kube-api-access-6sj4s\") pod \"console-577678865d-sxpjq\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:19.888185 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:19.888084 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e720aa2-db14-40f6-b905-0155bcbd7809-console-serving-cert\") pod \"console-577678865d-sxpjq\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:19.888185 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:19.888131 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e720aa2-db14-40f6-b905-0155bcbd7809-service-ca\") pod \"console-577678865d-sxpjq\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:19.888185 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:19.888153 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e720aa2-db14-40f6-b905-0155bcbd7809-oauth-serving-cert\") pod \"console-577678865d-sxpjq\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:19.888379 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:19.888202 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e720aa2-db14-40f6-b905-0155bcbd7809-tmp\") pod \"console-577678865d-sxpjq\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:19.888650 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:19.888623 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e720aa2-db14-40f6-b905-0155bcbd7809-tmp\") pod \"console-577678865d-sxpjq\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:19.888824 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:19.888805 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e720aa2-db14-40f6-b905-0155bcbd7809-service-ca\") pod \"console-577678865d-sxpjq\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:19.888940 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:19.888919 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e720aa2-db14-40f6-b905-0155bcbd7809-oauth-serving-cert\") pod \"console-577678865d-sxpjq\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:19.888998 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:19.888947 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e720aa2-db14-40f6-b905-0155bcbd7809-console-config\") pod \"console-577678865d-sxpjq\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:19.890673 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:19.890648 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e720aa2-db14-40f6-b905-0155bcbd7809-console-serving-cert\") pod \"console-577678865d-sxpjq\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:19.890673 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:19.890662 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e720aa2-db14-40f6-b905-0155bcbd7809-console-oauth-config\") pod \"console-577678865d-sxpjq\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:19.950105 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:19.950034 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sj4s\" (UniqueName: \"kubernetes.io/projected/0e720aa2-db14-40f6-b905-0155bcbd7809-kube-api-access-6sj4s\") pod \"console-577678865d-sxpjq\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:20.010604 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.010543 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:20.262703 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.262669 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-w78q9"] Nov 03 20:01:20.265421 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.265398 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-w78q9" Nov 03 20:01:20.291843 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.291804 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpqvp\" (UniqueName: \"kubernetes.io/projected/960e81d3-4bff-4a35-b6a8-edcd186c6c44-kube-api-access-jpqvp\") pod \"openshift-state-metrics-7bd7489957-w78q9\" (UID: \"960e81d3-4bff-4a35-b6a8-edcd186c6c44\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-w78q9" Nov 03 20:01:20.291843 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.291847 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/960e81d3-4bff-4a35-b6a8-edcd186c6c44-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-w78q9\" (UID: \"960e81d3-4bff-4a35-b6a8-edcd186c6c44\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-w78q9" Nov 03 20:01:20.292033 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.291867 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/960e81d3-4bff-4a35-b6a8-edcd186c6c44-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-w78q9\" (UID: \"960e81d3-4bff-4a35-b6a8-edcd186c6c44\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-w78q9" Nov 03 20:01:20.292033 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.291970 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/960e81d3-4bff-4a35-b6a8-edcd186c6c44-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-w78q9\" (UID: \"960e81d3-4bff-4a35-b6a8-edcd186c6c44\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-w78q9" Nov 03 20:01:20.319971 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.319940 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Nov 03 20:01:20.320115 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.320003 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-95hcs\"" Nov 03 20:01:20.320115 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.320069 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Nov 03 20:01:20.324247 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.324218 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-w78q9"] Nov 03 20:01:20.368393 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.368355 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp"] Nov 03 20:01:20.370358 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.370340 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp" Nov 03 20:01:20.386668 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.386547 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pxws5"] Nov 03 20:01:20.388992 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.388965 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:20.393079 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.393046 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zr4p\" (UniqueName: \"kubernetes.io/projected/bd8a2436-4362-4c11-9e4b-9e20b73094e6-kube-api-access-9zr4p\") pod \"kube-state-metrics-5dc8d7d89b-lwkdp\" (UID: \"bd8a2436-4362-4c11-9e4b-9e20b73094e6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp" Nov 03 20:01:20.393220 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.393131 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bd8a2436-4362-4c11-9e4b-9e20b73094e6-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-lwkdp\" (UID: \"bd8a2436-4362-4c11-9e4b-9e20b73094e6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp" Nov 03 20:01:20.393220 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.393166 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/960e81d3-4bff-4a35-b6a8-edcd186c6c44-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-w78q9\" (UID: \"960e81d3-4bff-4a35-b6a8-edcd186c6c44\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-w78q9" Nov 03 20:01:20.393220 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.393206 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd8a2436-4362-4c11-9e4b-9e20b73094e6-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-lwkdp\" (UID: \"bd8a2436-4362-4c11-9e4b-9e20b73094e6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp" Nov 03 20:01:20.393382 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.393227 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpqvp\" (UniqueName: \"kubernetes.io/projected/960e81d3-4bff-4a35-b6a8-edcd186c6c44-kube-api-access-jpqvp\") pod \"openshift-state-metrics-7bd7489957-w78q9\" (UID: \"960e81d3-4bff-4a35-b6a8-edcd186c6c44\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-w78q9" Nov 03 20:01:20.393382 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.393327 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bd8a2436-4362-4c11-9e4b-9e20b73094e6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-lwkdp\" (UID: \"bd8a2436-4362-4c11-9e4b-9e20b73094e6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp" Nov 03 20:01:20.393382 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.393362 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd8a2436-4362-4c11-9e4b-9e20b73094e6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-lwkdp\" (UID: \"bd8a2436-4362-4c11-9e4b-9e20b73094e6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp" Nov 03 20:01:20.393520 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.393384 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/960e81d3-4bff-4a35-b6a8-edcd186c6c44-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-w78q9\" (UID: \"960e81d3-4bff-4a35-b6a8-edcd186c6c44\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-w78q9" Nov 03 20:01:20.393520 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.393403 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd8a2436-4362-4c11-9e4b-9e20b73094e6-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-lwkdp\" (UID: \"bd8a2436-4362-4c11-9e4b-9e20b73094e6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp" Nov 03 20:01:20.393632 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.393610 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/960e81d3-4bff-4a35-b6a8-edcd186c6c44-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-w78q9\" (UID: \"960e81d3-4bff-4a35-b6a8-edcd186c6c44\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-w78q9" Nov 03 20:01:20.394053 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.393981 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/960e81d3-4bff-4a35-b6a8-edcd186c6c44-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-w78q9\" (UID: \"960e81d3-4bff-4a35-b6a8-edcd186c6c44\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-w78q9" Nov 03 20:01:20.396053 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.395853 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/960e81d3-4bff-4a35-b6a8-edcd186c6c44-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-w78q9\" (UID: \"960e81d3-4bff-4a35-b6a8-edcd186c6c44\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-w78q9" Nov 03 20:01:20.396053 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.395999 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/960e81d3-4bff-4a35-b6a8-edcd186c6c44-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-w78q9\" (UID: \"960e81d3-4bff-4a35-b6a8-edcd186c6c44\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-w78q9" Nov 03 20:01:20.423902 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.423866 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Nov 03 20:01:20.423902 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.423886 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Nov 03 20:01:20.423902 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.423890 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Nov 03 20:01:20.423902 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.423889 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-s9vpg\"" Nov 03 20:01:20.429021 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.429000 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-577678865d-sxpjq"] Nov 03 20:01:20.431679 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:01:20.431651 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e720aa2_db14_40f6_b905_0155bcbd7809.slice/crio-a0fbad3549f5a9ee433e12d0ecb908c828d95b925fe17e43123d72f87a9485db WatchSource:0}: Error finding container a0fbad3549f5a9ee433e12d0ecb908c828d95b925fe17e43123d72f87a9485db: Status 404 returned error can't find the container with id a0fbad3549f5a9ee433e12d0ecb908c828d95b925fe17e43123d72f87a9485db Nov 03 20:01:20.432072 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.432052 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp"] Nov 03 20:01:20.443027 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.442998 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Nov 03 20:01:20.443177 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.443079 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Nov 03 20:01:20.443231 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.443175 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2r7jg\"" Nov 03 20:01:20.454964 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.454932 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpqvp\" (UniqueName: \"kubernetes.io/projected/960e81d3-4bff-4a35-b6a8-edcd186c6c44-kube-api-access-jpqvp\") pod \"openshift-state-metrics-7bd7489957-w78q9\" (UID: \"960e81d3-4bff-4a35-b6a8-edcd186c6c44\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-w78q9" Nov 03 20:01:20.492244 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.492210 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-577678865d-sxpjq" event={"ID":"0e720aa2-db14-40f6-b905-0155bcbd7809","Type":"ContainerStarted","Data":"a0fbad3549f5a9ee433e12d0ecb908c828d95b925fe17e43123d72f87a9485db"} Nov 03 20:01:20.494517 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.494496 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb01d4b7-2af5-4493-af2c-8d90a120851f-metrics-client-ca\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:20.494605 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.494527 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eb01d4b7-2af5-4493-af2c-8d90a120851f-node-exporter-tls\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:20.494605 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.494543 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shsdx\" (UniqueName: \"kubernetes.io/projected/eb01d4b7-2af5-4493-af2c-8d90a120851f-kube-api-access-shsdx\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:20.494605 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.494578 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb01d4b7-2af5-4493-af2c-8d90a120851f-sys\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:20.494706 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.494683 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/eb01d4b7-2af5-4493-af2c-8d90a120851f-root\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:20.494735 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.494725 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zr4p\" (UniqueName: \"kubernetes.io/projected/bd8a2436-4362-4c11-9e4b-9e20b73094e6-kube-api-access-9zr4p\") pod \"kube-state-metrics-5dc8d7d89b-lwkdp\" (UID: \"bd8a2436-4362-4c11-9e4b-9e20b73094e6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp" Nov 03 20:01:20.494763 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.494744 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/eb01d4b7-2af5-4493-af2c-8d90a120851f-node-exporter-textfile\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:20.494763 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.494760 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/eb01d4b7-2af5-4493-af2c-8d90a120851f-node-exporter-wtmp\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:20.494822 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.494796 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bd8a2436-4362-4c11-9e4b-9e20b73094e6-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-lwkdp\" (UID: \"bd8a2436-4362-4c11-9e4b-9e20b73094e6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp" Nov 03 20:01:20.494967 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.494953 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/eb01d4b7-2af5-4493-af2c-8d90a120851f-node-exporter-accelerators-collector-config\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:20.495000 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.494978 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd8a2436-4362-4c11-9e4b-9e20b73094e6-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-lwkdp\" (UID: \"bd8a2436-4362-4c11-9e4b-9e20b73094e6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp" Nov 03 20:01:20.495049 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.495031 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb01d4b7-2af5-4493-af2c-8d90a120851f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:20.495113 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.495087 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bd8a2436-4362-4c11-9e4b-9e20b73094e6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-lwkdp\" (UID: \"bd8a2436-4362-4c11-9e4b-9e20b73094e6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp" Nov 03 20:01:20.495170 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.495145 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd8a2436-4362-4c11-9e4b-9e20b73094e6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-lwkdp\" (UID: \"bd8a2436-4362-4c11-9e4b-9e20b73094e6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp" Nov 03 20:01:20.495222 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.495175 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd8a2436-4362-4c11-9e4b-9e20b73094e6-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-lwkdp\" (UID: \"bd8a2436-4362-4c11-9e4b-9e20b73094e6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp" Nov 03 20:01:20.495363 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.495343 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bd8a2436-4362-4c11-9e4b-9e20b73094e6-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-lwkdp\" (UID: \"bd8a2436-4362-4c11-9e4b-9e20b73094e6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp" Nov 03 20:01:20.495903 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.495824 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd8a2436-4362-4c11-9e4b-9e20b73094e6-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-lwkdp\" (UID: \"bd8a2436-4362-4c11-9e4b-9e20b73094e6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp" Nov 03 20:01:20.495903 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.495837 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bd8a2436-4362-4c11-9e4b-9e20b73094e6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-lwkdp\" (UID: \"bd8a2436-4362-4c11-9e4b-9e20b73094e6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp" Nov 03 20:01:20.497619 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.497598 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd8a2436-4362-4c11-9e4b-9e20b73094e6-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-lwkdp\" (UID: \"bd8a2436-4362-4c11-9e4b-9e20b73094e6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp" Nov 03 20:01:20.497619 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.497616 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd8a2436-4362-4c11-9e4b-9e20b73094e6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-lwkdp\" (UID: \"bd8a2436-4362-4c11-9e4b-9e20b73094e6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp" Nov 03 20:01:20.524352 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.524270 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Nov 03 20:01:20.556702 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.556668 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zr4p\" (UniqueName: \"kubernetes.io/projected/bd8a2436-4362-4c11-9e4b-9e20b73094e6-kube-api-access-9zr4p\") pod \"kube-state-metrics-5dc8d7d89b-lwkdp\" (UID: \"bd8a2436-4362-4c11-9e4b-9e20b73094e6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp" Nov 03 20:01:20.576673 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.576636 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-w78q9" Nov 03 20:01:20.595828 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.595793 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/eb01d4b7-2af5-4493-af2c-8d90a120851f-node-exporter-textfile\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:20.595828 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.595827 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/eb01d4b7-2af5-4493-af2c-8d90a120851f-node-exporter-wtmp\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:20.595980 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.595867 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/eb01d4b7-2af5-4493-af2c-8d90a120851f-node-exporter-accelerators-collector-config\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:20.595980 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.595894 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb01d4b7-2af5-4493-af2c-8d90a120851f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:20.596078 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.596037 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/eb01d4b7-2af5-4493-af2c-8d90a120851f-node-exporter-wtmp\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:20.596131 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.596084 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb01d4b7-2af5-4493-af2c-8d90a120851f-metrics-client-ca\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:20.596131 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.596123 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eb01d4b7-2af5-4493-af2c-8d90a120851f-node-exporter-tls\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:20.596256 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.596231 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/eb01d4b7-2af5-4493-af2c-8d90a120851f-node-exporter-textfile\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:20.596345 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.596321 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shsdx\" (UniqueName: \"kubernetes.io/projected/eb01d4b7-2af5-4493-af2c-8d90a120851f-kube-api-access-shsdx\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:20.596411 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.596367 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb01d4b7-2af5-4493-af2c-8d90a120851f-sys\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:20.596411 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.596390 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/eb01d4b7-2af5-4493-af2c-8d90a120851f-root\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:20.596505 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.596437 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb01d4b7-2af5-4493-af2c-8d90a120851f-sys\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:20.596505 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.596457 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/eb01d4b7-2af5-4493-af2c-8d90a120851f-root\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:20.597615 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.596755 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb01d4b7-2af5-4493-af2c-8d90a120851f-metrics-client-ca\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:20.597615 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.596784 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/eb01d4b7-2af5-4493-af2c-8d90a120851f-node-exporter-accelerators-collector-config\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:20.598644 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.598624 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb01d4b7-2af5-4493-af2c-8d90a120851f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:20.598869 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.598852 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eb01d4b7-2af5-4493-af2c-8d90a120851f-node-exporter-tls\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:20.658526 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.658479 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shsdx\" (UniqueName: \"kubernetes.io/projected/eb01d4b7-2af5-4493-af2c-8d90a120851f-kube-api-access-shsdx\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:20.683458 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.683425 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp" Nov 03 20:01:20.701694 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.701663 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:20.711109 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:01:20.711071 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb01d4b7_2af5_4493_af2c_8d90a120851f.slice/crio-bad22f822ef6f404d989cca09a5f8f90d8905bc13e1ec818ba58e3593dcbe504 WatchSource:0}: Error finding container bad22f822ef6f404d989cca09a5f8f90d8905bc13e1ec818ba58e3593dcbe504: Status 404 returned error can't find the container with id bad22f822ef6f404d989cca09a5f8f90d8905bc13e1ec818ba58e3593dcbe504 Nov 03 20:01:20.949493 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:20.949470 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-w78q9"] Nov 03 20:01:20.951912 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:01:20.951883 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod960e81d3_4bff_4a35_b6a8_edcd186c6c44.slice/crio-dae873b182bfc3f60b97f7ceda8c99d20aaf214f33b455ff90891105abf47ddb WatchSource:0}: Error finding container dae873b182bfc3f60b97f7ceda8c99d20aaf214f33b455ff90891105abf47ddb: Status 404 returned error can't find the container with id dae873b182bfc3f60b97f7ceda8c99d20aaf214f33b455ff90891105abf47ddb Nov 03 20:01:21.057321 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:21.057151 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp"] Nov 03 20:01:21.059908 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:01:21.059867 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd8a2436_4362_4c11_9e4b_9e20b73094e6.slice/crio-bb581d67b2b27a04a236ff64b2f71ebbdabf9c413b792e369aaff7d991e14c4e WatchSource:0}: Error finding container bb581d67b2b27a04a236ff64b2f71ebbdabf9c413b792e369aaff7d991e14c4e: Status 404 returned error can't find the container with id bb581d67b2b27a04a236ff64b2f71ebbdabf9c413b792e369aaff7d991e14c4e Nov 03 20:01:21.500528 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:21.500488 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pxws5" event={"ID":"eb01d4b7-2af5-4493-af2c-8d90a120851f","Type":"ContainerStarted","Data":"bad22f822ef6f404d989cca09a5f8f90d8905bc13e1ec818ba58e3593dcbe504"} Nov 03 20:01:21.502556 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:21.502524 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp" event={"ID":"bd8a2436-4362-4c11-9e4b-9e20b73094e6","Type":"ContainerStarted","Data":"bb581d67b2b27a04a236ff64b2f71ebbdabf9c413b792e369aaff7d991e14c4e"} Nov 03 20:01:21.504474 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:21.504452 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-w78q9" event={"ID":"960e81d3-4bff-4a35-b6a8-edcd186c6c44","Type":"ContainerStarted","Data":"5b82935e35455cc4139cc2766207c28be4fcc37892861a2ac96487c672ce6d42"} Nov 03 20:01:21.504583 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:21.504496 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-w78q9" event={"ID":"960e81d3-4bff-4a35-b6a8-edcd186c6c44","Type":"ContainerStarted","Data":"514e06f7034a87d8e6e52b0dfddb2e506179556e49f7828729f5bc7e60335904"} Nov 03 20:01:21.504583 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:21.504520 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-w78q9" event={"ID":"960e81d3-4bff-4a35-b6a8-edcd186c6c44","Type":"ContainerStarted","Data":"dae873b182bfc3f60b97f7ceda8c99d20aaf214f33b455ff90891105abf47ddb"} Nov 03 20:01:22.007300 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.007245 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30329c02-c760-48d5-86f7-dd265325adb0-original-pull-secret\") pod \"global-pull-secret-syncer-wz99q\" (UID: \"30329c02-c760-48d5-86f7-dd265325adb0\") " pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:01:22.007766 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.007417 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aae6331f-1f9f-43c8-9610-f554ddebf2e3-metrics-certs\") pod \"network-metrics-daemon-pslv9\" (UID: \"aae6331f-1f9f-43c8-9610-f554ddebf2e3\") " pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:01:22.059837 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.059798 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Nov 03 20:01:22.060060 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.060042 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Nov 03 20:01:22.070723 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.070691 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30329c02-c760-48d5-86f7-dd265325adb0-original-pull-secret\") pod \"global-pull-secret-syncer-wz99q\" (UID: \"30329c02-c760-48d5-86f7-dd265325adb0\") " pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:01:22.070723 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.070723 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aae6331f-1f9f-43c8-9610-f554ddebf2e3-metrics-certs\") pod \"network-metrics-daemon-pslv9\" (UID: \"aae6331f-1f9f-43c8-9610-f554ddebf2e3\") " pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:01:22.137869 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.137834 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-kbkmq\"" Nov 03 20:01:22.146223 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.145993 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:01:22.149529 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.149505 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vw2xk\"" Nov 03 20:01:22.157547 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.157518 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:01:22.209641 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.209280 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsbqv\" (UniqueName: \"kubernetes.io/projected/5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2-kube-api-access-rsbqv\") pod \"network-check-target-x5gxd\" (UID: \"5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2\") " pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:01:22.262627 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.262528 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Nov 03 20:01:22.322381 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.322348 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Nov 03 20:01:22.334827 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.334790 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsbqv\" (UniqueName: \"kubernetes.io/projected/5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2-kube-api-access-rsbqv\") pod \"network-check-target-x5gxd\" (UID: \"5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2\") " pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:01:22.443363 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.443307 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-nwkgp\"" Nov 03 20:01:22.451622 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.451584 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:01:22.513591 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.512438 2576 generic.go:356] "Generic (PLEG): container finished" podID="eb01d4b7-2af5-4493-af2c-8d90a120851f" containerID="84f8d55e87f0332659d20132941c35ce4adfa4e7ad8e40403a95cd2658cb417f" exitCode=0 Nov 03 20:01:22.513591 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.512524 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pxws5" event={"ID":"eb01d4b7-2af5-4493-af2c-8d90a120851f","Type":"ContainerDied","Data":"84f8d55e87f0332659d20132941c35ce4adfa4e7ad8e40403a95cd2658cb417f"} Nov 03 20:01:22.537941 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.537695 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wz99q"] Nov 03 20:01:22.586829 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:01:22.586799 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30329c02_c760_48d5_86f7_dd265325adb0.slice/crio-7d208722eb470db1c9341fa7767eb1673c9c260587b9b8a448828888a3ac8d92 WatchSource:0}: Error finding container 7d208722eb470db1c9341fa7767eb1673c9c260587b9b8a448828888a3ac8d92: Status 404 returned error can't find the container with id 7d208722eb470db1c9341fa7767eb1673c9c260587b9b8a448828888a3ac8d92 Nov 03 20:01:22.595587 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.595543 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pslv9"] Nov 03 20:01:22.604810 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:01:22.604664 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaae6331f_1f9f_43c8_9610_f554ddebf2e3.slice/crio-629f3d2fd9e832092d3193bf3273444080ab8b0c9327e6bd5d83f1918e237325 WatchSource:0}: Error finding container 629f3d2fd9e832092d3193bf3273444080ab8b0c9327e6bd5d83f1918e237325: Status 404 returned error can't find the container with id 629f3d2fd9e832092d3193bf3273444080ab8b0c9327e6bd5d83f1918e237325 Nov 03 20:01:22.681231 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.681190 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 03 20:01:22.684396 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.684343 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:22.716637 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.713327 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:22.716637 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.713373 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:22.716637 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.713408 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/26c31b1c-c3c5-4676-b71f-f44499e10a3b-config-out\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:22.716637 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.713437 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:22.716637 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.713460 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/26c31b1c-c3c5-4676-b71f-f44499e10a3b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:22.716637 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.713475 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:22.716637 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.713501 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26c31b1c-c3c5-4676-b71f-f44499e10a3b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:22.716637 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.713517 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jjfg\" (UniqueName: \"kubernetes.io/projected/26c31b1c-c3c5-4676-b71f-f44499e10a3b-kube-api-access-5jjfg\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:22.716637 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.713538 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26c31b1c-c3c5-4676-b71f-f44499e10a3b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:22.716637 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.713583 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-web-config\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:22.716637 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.713607 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-config-volume\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:22.716637 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.713624 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:22.716637 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.713638 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/26c31b1c-c3c5-4676-b71f-f44499e10a3b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:22.738841 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.738808 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Nov 03 20:01:22.739001 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.738904 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Nov 03 20:01:22.739001 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.738945 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Nov 03 20:01:22.739860 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.739824 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Nov 03 20:01:22.740156 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.740138 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Nov 03 20:01:22.740294 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.740192 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Nov 03 20:01:22.740294 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.740208 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-sbl24\"" Nov 03 20:01:22.740294 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.740212 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Nov 03 20:01:22.740294 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.740252 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Nov 03 20:01:22.791468 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.791386 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Nov 03 20:01:22.792966 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.792934 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 03 20:01:22.813981 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.813945 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:22.814142 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.814006 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/26c31b1c-c3c5-4676-b71f-f44499e10a3b-config-out\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:22.814142 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.814057 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:22.814142 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.814091 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/26c31b1c-c3c5-4676-b71f-f44499e10a3b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:22.814142 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.814114 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:22.814337 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.814154 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26c31b1c-c3c5-4676-b71f-f44499e10a3b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:22.814337 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.814191 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jjfg\" (UniqueName: \"kubernetes.io/projected/26c31b1c-c3c5-4676-b71f-f44499e10a3b-kube-api-access-5jjfg\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:22.814337 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.814216 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26c31b1c-c3c5-4676-b71f-f44499e10a3b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:22.814337 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.814246 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-web-config\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:22.814337 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.814288 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-config-volume\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:22.814337 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.814318 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:22.814702 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.814344 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/26c31b1c-c3c5-4676-b71f-f44499e10a3b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:22.814702 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.814384 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:22.816749 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.816150 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26c31b1c-c3c5-4676-b71f-f44499e10a3b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:22.818235 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.817890 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26c31b1c-c3c5-4676-b71f-f44499e10a3b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:22.818235 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.818134 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/26c31b1c-c3c5-4676-b71f-f44499e10a3b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:22.819668 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.819641 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:22.822213 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.822189 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:22.822303 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.822214 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/26c31b1c-c3c5-4676-b71f-f44499e10a3b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:22.822383 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.822362 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/26c31b1c-c3c5-4676-b71f-f44499e10a3b-config-out\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:22.822747 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.822713 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:22.823067 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.823042 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:22.823368 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.823346 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-web-config\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:22.823543 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.823524 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:22.823756 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.823739 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-config-volume\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:22.836547 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.836515 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-x5gxd"] Nov 03 20:01:22.837780 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:01:22.837746 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ba2d30a_cdd9_47c3_a1fe_8bbd8b1110d2.slice/crio-79a12079c959238bd59f3eadb4bb47806725e75ff362bb2e7df5fae97177757d WatchSource:0}: Error finding container 79a12079c959238bd59f3eadb4bb47806725e75ff362bb2e7df5fae97177757d: Status 404 returned error can't find the container with id 79a12079c959238bd59f3eadb4bb47806725e75ff362bb2e7df5fae97177757d Nov 03 20:01:22.877937 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:22.877901 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jjfg\" (UniqueName: \"kubernetes.io/projected/26c31b1c-c3c5-4676-b71f-f44499e10a3b-kube-api-access-5jjfg\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:23.000923 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.000892 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-75c5c6c675-9tqxn"] Nov 03 20:01:23.006601 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.005135 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:23.006601 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.006435 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:23.064271 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.064245 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Nov 03 20:01:23.064869 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.064803 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3he3nqfq319mg\"" Nov 03 20:01:23.064923 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.064889 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Nov 03 20:01:23.064989 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.064954 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Nov 03 20:01:23.065099 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.065059 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-ktbdc\"" Nov 03 20:01:23.065183 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.065164 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Nov 03 20:01:23.065247 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.065231 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Nov 03 20:01:23.072077 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.072048 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-75c5c6c675-9tqxn"] Nov 03 20:01:23.116537 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.116498 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-secret-thanos-querier-tls\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:23.116828 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.116583 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:23.116828 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.116622 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-secret-grpc-tls\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:23.116828 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.116652 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:23.116828 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.116692 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:23.116828 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.116717 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-tmp\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:23.116828 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.116760 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z65ln\" (UniqueName: \"kubernetes.io/projected/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-kube-api-access-z65ln\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:23.116828 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.116783 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:23.116828 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.116807 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-metrics-client-ca\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:23.217419 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.217391 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-secret-thanos-querier-tls\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:23.217559 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.217453 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:23.217559 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.217489 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-secret-grpc-tls\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:23.217559 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.217521 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:23.217747 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.217559 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:23.217747 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.217611 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-tmp\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:23.217747 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.217657 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z65ln\" (UniqueName: \"kubernetes.io/projected/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-kube-api-access-z65ln\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:23.217747 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.217685 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:23.217747 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.217713 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-metrics-client-ca\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:23.218422 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.218397 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-metrics-client-ca\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:23.218700 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.218674 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-tmp\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:23.220558 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.220529 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:23.221271 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.221248 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-secret-thanos-querier-tls\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:23.221369 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.221334 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:23.221437 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.221401 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:23.221944 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.221922 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-secret-grpc-tls\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:23.222518 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.222485 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:23.282555 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.282519 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z65ln\" (UniqueName: \"kubernetes.io/projected/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-kube-api-access-z65ln\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:23.323688 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.323454 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:23.441946 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.441914 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 03 20:01:23.446777 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:01:23.446745 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26c31b1c_c3c5_4676_b71f_f44499e10a3b.slice/crio-97c9b81f31810c9510cb064f7bf6b901b40808abef6a684b99accaea77411965 WatchSource:0}: Error finding container 97c9b81f31810c9510cb064f7bf6b901b40808abef6a684b99accaea77411965: Status 404 returned error can't find the container with id 97c9b81f31810c9510cb064f7bf6b901b40808abef6a684b99accaea77411965 Nov 03 20:01:23.471947 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.471925 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-s2xtj" Nov 03 20:01:23.525247 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.525216 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pxws5" event={"ID":"eb01d4b7-2af5-4493-af2c-8d90a120851f","Type":"ContainerStarted","Data":"453a19d450f12062feae7d7a7121d547dbde761d6e6a7435bb49c8ed0719f40e"} Nov 03 20:01:23.525404 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.525270 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pxws5" event={"ID":"eb01d4b7-2af5-4493-af2c-8d90a120851f","Type":"ContainerStarted","Data":"860ddef488d8b54ff873efbdfa2010d765643fa03e8d4424836200f2596e9491"} Nov 03 20:01:23.529307 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.528724 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp" event={"ID":"bd8a2436-4362-4c11-9e4b-9e20b73094e6","Type":"ContainerStarted","Data":"2cb1a3422616a1e6b120bcac66b2241377b242b991cb646708e87213d0708068"} Nov 03 20:01:23.529307 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.528789 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp" event={"ID":"bd8a2436-4362-4c11-9e4b-9e20b73094e6","Type":"ContainerStarted","Data":"8b835adf9543d6603fb90fa5594a6c4a95e021a110599cddd708113f95418d7d"} Nov 03 20:01:23.529307 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.528816 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp" event={"ID":"bd8a2436-4362-4c11-9e4b-9e20b73094e6","Type":"ContainerStarted","Data":"55d353ea487752c2f334307b213b1f1ded8c464c27051d26959e2e19f56b4974"} Nov 03 20:01:23.531241 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.531214 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-x5gxd" event={"ID":"5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2","Type":"ContainerStarted","Data":"79a12079c959238bd59f3eadb4bb47806725e75ff362bb2e7df5fae97177757d"} Nov 03 20:01:23.532681 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.532653 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wz99q" event={"ID":"30329c02-c760-48d5-86f7-dd265325adb0","Type":"ContainerStarted","Data":"7d208722eb470db1c9341fa7767eb1673c9c260587b9b8a448828888a3ac8d92"} Nov 03 20:01:23.534152 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.534125 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"26c31b1c-c3c5-4676-b71f-f44499e10a3b","Type":"ContainerStarted","Data":"97c9b81f31810c9510cb064f7bf6b901b40808abef6a684b99accaea77411965"} Nov 03 20:01:23.537121 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.537046 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-w78q9" event={"ID":"960e81d3-4bff-4a35-b6a8-edcd186c6c44","Type":"ContainerStarted","Data":"806eb8aa94aca6fddf037ff6470649e35f246c899ff943a359fb87f6b4c9ccc2"} Nov 03 20:01:23.538846 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.538824 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pslv9" event={"ID":"aae6331f-1f9f-43c8-9610-f554ddebf2e3","Type":"ContainerStarted","Data":"629f3d2fd9e832092d3193bf3273444080ab8b0c9327e6bd5d83f1918e237325"} Nov 03 20:01:23.710226 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.708414 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-75c5c6c675-9tqxn"] Nov 03 20:01:23.712586 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:01:23.712524 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5da7c0e_2db7_48fd_ac10_bccc095ef79e.slice/crio-d81772f20883761e0d12e5b34bf9bdd2362d6f328a86c68296e817b4d0ecc036 WatchSource:0}: Error finding container d81772f20883761e0d12e5b34bf9bdd2362d6f328a86c68296e817b4d0ecc036: Status 404 returned error can't find the container with id d81772f20883761e0d12e5b34bf9bdd2362d6f328a86c68296e817b4d0ecc036 Nov 03 20:01:23.715885 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.714545 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pxws5" podStartSLOduration=2.23257925 podStartE2EDuration="3.714527515s" totalImagesPullingTime="1.366082386s" totalInitContainerRuntime="115.865879ms" isStatefulPod=true podCreationTimestamp="2026-11-03 20:01:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:01:23.714131089 +0000 UTC m=+67.955997885" watchObservedRunningTime="2026-11-03 20:01:23.714527515 +0000 UTC m=+67.956394305" Nov 03 20:01:23.835929 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.835718 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-w78q9" podStartSLOduration=2.021356125 podStartE2EDuration="3.835697642s" totalImagesPullingTime="1.814341517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:01:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:01:23.834392185 +0000 UTC m=+68.076259190" watchObservedRunningTime="2026-11-03 20:01:23.835697642 +0000 UTC m=+68.077564436" Nov 03 20:01:23.956199 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:23.956134 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp" podStartSLOduration=1.844291429 podStartE2EDuration="3.95611578s" totalImagesPullingTime="2.111824351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:01:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:01:23.954992438 +0000 UTC m=+68.196859305" watchObservedRunningTime="2026-11-03 20:01:23.95611578 +0000 UTC m=+68.197982573" Nov 03 20:01:24.549765 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:24.549728 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" event={"ID":"f5da7c0e-2db7-48fd-ac10-bccc095ef79e","Type":"ContainerStarted","Data":"d81772f20883761e0d12e5b34bf9bdd2362d6f328a86c68296e817b4d0ecc036"} Nov 03 20:01:24.552328 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:24.552298 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pslv9" event={"ID":"aae6331f-1f9f-43c8-9610-f554ddebf2e3","Type":"ContainerStarted","Data":"b2cfcff4fb443efeda8f572620671c4db42dab6e163e92637ae4c4add0a2272e"} Nov 03 20:01:25.296052 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:25.296012 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-748b9d444f-gwfk2"] Nov 03 20:01:25.298466 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:25.298440 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:01:25.350967 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:25.350940 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4dbfce43-ac06-4413-92eb-f123614df91d-audit-log\") pod \"metrics-server-748b9d444f-gwfk2\" (UID: \"4dbfce43-ac06-4413-92eb-f123614df91d\") " pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:01:25.351098 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:25.351006 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dbfce43-ac06-4413-92eb-f123614df91d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-748b9d444f-gwfk2\" (UID: \"4dbfce43-ac06-4413-92eb-f123614df91d\") " pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:01:25.351098 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:25.351026 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4dbfce43-ac06-4413-92eb-f123614df91d-metrics-server-audit-profiles\") pod \"metrics-server-748b9d444f-gwfk2\" (UID: \"4dbfce43-ac06-4413-92eb-f123614df91d\") " pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:01:25.351098 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:25.351043 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4dbfce43-ac06-4413-92eb-f123614df91d-secret-metrics-server-tls\") pod \"metrics-server-748b9d444f-gwfk2\" (UID: \"4dbfce43-ac06-4413-92eb-f123614df91d\") " pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:01:25.351098 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:25.351070 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4dbfce43-ac06-4413-92eb-f123614df91d-secret-metrics-server-client-certs\") pod \"metrics-server-748b9d444f-gwfk2\" (UID: \"4dbfce43-ac06-4413-92eb-f123614df91d\") " pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:01:25.351295 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:25.351100 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r74cx\" (UniqueName: \"kubernetes.io/projected/4dbfce43-ac06-4413-92eb-f123614df91d-kube-api-access-r74cx\") pod \"metrics-server-748b9d444f-gwfk2\" (UID: \"4dbfce43-ac06-4413-92eb-f123614df91d\") " pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:01:25.351295 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:25.351118 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4dbfce43-ac06-4413-92eb-f123614df91d-client-ca-bundle\") pod \"metrics-server-748b9d444f-gwfk2\" (UID: \"4dbfce43-ac06-4413-92eb-f123614df91d\") " pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:01:25.352329 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:25.352301 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Nov 03 20:01:25.352424 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:25.352397 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Nov 03 20:01:25.352618 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:25.352549 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-zqcfj\"" Nov 03 20:01:25.352685 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:25.352553 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Nov 03 20:01:25.352685 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:25.352632 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Nov 03 20:01:25.352778 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:25.352720 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-4uep8qniusafg\"" Nov 03 20:01:25.357309 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:25.357286 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-748b9d444f-gwfk2"] Nov 03 20:01:25.451850 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:25.451814 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r74cx\" (UniqueName: \"kubernetes.io/projected/4dbfce43-ac06-4413-92eb-f123614df91d-kube-api-access-r74cx\") pod \"metrics-server-748b9d444f-gwfk2\" (UID: \"4dbfce43-ac06-4413-92eb-f123614df91d\") " pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:01:25.451965 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:25.451868 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4dbfce43-ac06-4413-92eb-f123614df91d-client-ca-bundle\") pod \"metrics-server-748b9d444f-gwfk2\" (UID: \"4dbfce43-ac06-4413-92eb-f123614df91d\") " pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:01:25.451965 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:25.451903 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4dbfce43-ac06-4413-92eb-f123614df91d-audit-log\") pod \"metrics-server-748b9d444f-gwfk2\" (UID: \"4dbfce43-ac06-4413-92eb-f123614df91d\") " pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:01:25.452056 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:25.451968 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dbfce43-ac06-4413-92eb-f123614df91d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-748b9d444f-gwfk2\" (UID: \"4dbfce43-ac06-4413-92eb-f123614df91d\") " pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:01:25.452056 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:25.451995 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4dbfce43-ac06-4413-92eb-f123614df91d-metrics-server-audit-profiles\") pod \"metrics-server-748b9d444f-gwfk2\" (UID: \"4dbfce43-ac06-4413-92eb-f123614df91d\") " pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:01:25.452056 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:25.452021 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4dbfce43-ac06-4413-92eb-f123614df91d-secret-metrics-server-tls\") pod \"metrics-server-748b9d444f-gwfk2\" (UID: \"4dbfce43-ac06-4413-92eb-f123614df91d\") " pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:01:25.452168 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:25.452060 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4dbfce43-ac06-4413-92eb-f123614df91d-secret-metrics-server-client-certs\") pod \"metrics-server-748b9d444f-gwfk2\" (UID: \"4dbfce43-ac06-4413-92eb-f123614df91d\") " pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:01:25.452867 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:25.452801 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4dbfce43-ac06-4413-92eb-f123614df91d-audit-log\") pod \"metrics-server-748b9d444f-gwfk2\" (UID: \"4dbfce43-ac06-4413-92eb-f123614df91d\") " pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:01:25.453712 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:25.453690 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dbfce43-ac06-4413-92eb-f123614df91d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-748b9d444f-gwfk2\" (UID: \"4dbfce43-ac06-4413-92eb-f123614df91d\") " pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:01:25.454297 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:25.454251 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4dbfce43-ac06-4413-92eb-f123614df91d-metrics-server-audit-profiles\") pod \"metrics-server-748b9d444f-gwfk2\" (UID: \"4dbfce43-ac06-4413-92eb-f123614df91d\") " pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:01:25.454898 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:25.454873 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4dbfce43-ac06-4413-92eb-f123614df91d-secret-metrics-server-client-certs\") pod \"metrics-server-748b9d444f-gwfk2\" (UID: \"4dbfce43-ac06-4413-92eb-f123614df91d\") " pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:01:25.456369 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:25.456345 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4dbfce43-ac06-4413-92eb-f123614df91d-client-ca-bundle\") pod \"metrics-server-748b9d444f-gwfk2\" (UID: \"4dbfce43-ac06-4413-92eb-f123614df91d\") " pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:01:25.456663 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:25.456635 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4dbfce43-ac06-4413-92eb-f123614df91d-secret-metrics-server-tls\") pod \"metrics-server-748b9d444f-gwfk2\" (UID: \"4dbfce43-ac06-4413-92eb-f123614df91d\") " pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:01:25.515864 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:25.515754 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r74cx\" (UniqueName: \"kubernetes.io/projected/4dbfce43-ac06-4413-92eb-f123614df91d-kube-api-access-r74cx\") pod \"metrics-server-748b9d444f-gwfk2\" (UID: \"4dbfce43-ac06-4413-92eb-f123614df91d\") " pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:01:25.558301 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:25.558265 2576 generic.go:356] "Generic (PLEG): container finished" podID="26c31b1c-c3c5-4676-b71f-f44499e10a3b" containerID="d9a6fde832579f5d3b441121db3a042fbe6047ba212506a27d8c6934c79f3e9a" exitCode=0 Nov 03 20:01:25.558762 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:25.558417 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"26c31b1c-c3c5-4676-b71f-f44499e10a3b","Type":"ContainerDied","Data":"d9a6fde832579f5d3b441121db3a042fbe6047ba212506a27d8c6934c79f3e9a"} Nov 03 20:01:25.562745 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:25.562157 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pslv9" event={"ID":"aae6331f-1f9f-43c8-9610-f554ddebf2e3","Type":"ContainerStarted","Data":"ed6800179237a1f3cad6901a277f5da61c04e3bb26bee607c0c3267a46e7a087"} Nov 03 20:01:25.613918 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:25.613516 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:01:25.845699 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:25.845194 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pslv9" podStartSLOduration=67.061941619 podStartE2EDuration="1m8.845172413s" totalImagesPullingTime="1.783230794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:00:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:01:25.843486641 +0000 UTC m=+70.085353435" watchObservedRunningTime="2026-11-03 20:01:25.845172413 +0000 UTC m=+70.087039205" Nov 03 20:01:26.065352 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.065279 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-748b9d444f-gwfk2"] Nov 03 20:01:26.072436 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:01:26.072388 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dbfce43_ac06_4413_92eb_f123614df91d.slice/crio-8e0075cb87635dee2539a8fb45f72d488ad43efd1245dd21b15f0eff57019d6b WatchSource:0}: Error finding container 8e0075cb87635dee2539a8fb45f72d488ad43efd1245dd21b15f0eff57019d6b: Status 404 returned error can't find the container with id 8e0075cb87635dee2539a8fb45f72d488ad43efd1245dd21b15f0eff57019d6b Nov 03 20:01:26.106608 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.106490 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5c75c8599-kcxp6"] Nov 03 20:01:26.109909 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.109465 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:26.160120 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.160082 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1241d10-9647-4075-9091-19183e105d50-serving-certs-ca-bundle\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:26.160315 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.160135 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f1241d10-9647-4075-9091-19183e105d50-telemeter-client-tls\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:26.160315 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.160168 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1241d10-9647-4075-9091-19183e105d50-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:26.160315 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.160267 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7vcn\" (UniqueName: \"kubernetes.io/projected/f1241d10-9647-4075-9091-19183e105d50-kube-api-access-r7vcn\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:26.160482 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.160379 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1241d10-9647-4075-9091-19183e105d50-metrics-client-ca\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:26.160482 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.160417 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f1241d10-9647-4075-9091-19183e105d50-federate-client-tls\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:26.160482 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.160453 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1241d10-9647-4075-9091-19183e105d50-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:26.160482 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.160478 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f1241d10-9647-4075-9091-19183e105d50-secret-telemeter-client\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:26.168398 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.166274 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Nov 03 20:01:26.168398 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.166904 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Nov 03 20:01:26.168398 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.166998 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Nov 03 20:01:26.168398 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.167135 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-4hs22\"" Nov 03 20:01:26.168398 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.167209 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Nov 03 20:01:26.168398 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.167253 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Nov 03 20:01:26.217487 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.217451 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\"" Nov 03 20:01:26.219378 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.219351 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c75c8599-kcxp6"] Nov 03 20:01:26.260994 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.260951 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f1241d10-9647-4075-9091-19183e105d50-secret-telemeter-client\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:26.260994 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.260990 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1241d10-9647-4075-9091-19183e105d50-serving-certs-ca-bundle\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:26.261171 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.261012 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f1241d10-9647-4075-9091-19183e105d50-telemeter-client-tls\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:26.261171 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.261044 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1241d10-9647-4075-9091-19183e105d50-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:26.261932 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.261902 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1241d10-9647-4075-9091-19183e105d50-serving-certs-ca-bundle\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:26.262145 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.261968 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7vcn\" (UniqueName: \"kubernetes.io/projected/f1241d10-9647-4075-9091-19183e105d50-kube-api-access-r7vcn\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:26.262145 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.262054 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1241d10-9647-4075-9091-19183e105d50-metrics-client-ca\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:26.262145 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.262088 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f1241d10-9647-4075-9091-19183e105d50-federate-client-tls\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:26.262145 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.262135 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1241d10-9647-4075-9091-19183e105d50-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:26.262958 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.262885 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1241d10-9647-4075-9091-19183e105d50-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:26.263769 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.263746 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1241d10-9647-4075-9091-19183e105d50-metrics-client-ca\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:26.264274 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.264227 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1241d10-9647-4075-9091-19183e105d50-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:26.266679 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.266649 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f1241d10-9647-4075-9091-19183e105d50-secret-telemeter-client\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:26.266790 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.266767 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f1241d10-9647-4075-9091-19183e105d50-telemeter-client-tls\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:26.267387 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.267363 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f1241d10-9647-4075-9091-19183e105d50-federate-client-tls\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:26.325915 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.325853 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7vcn\" (UniqueName: \"kubernetes.io/projected/f1241d10-9647-4075-9091-19183e105d50-kube-api-access-r7vcn\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:26.425692 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.425613 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:26.568242 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.568114 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" event={"ID":"4dbfce43-ac06-4413-92eb-f123614df91d","Type":"ContainerStarted","Data":"8e0075cb87635dee2539a8fb45f72d488ad43efd1245dd21b15f0eff57019d6b"} Nov 03 20:01:26.571775 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.571717 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-577678865d-sxpjq" event={"ID":"0e720aa2-db14-40f6-b905-0155bcbd7809","Type":"ContainerStarted","Data":"826225c582774b96e2b4de92800d0ea0d12e7b7353107890337a0a2160334020"} Nov 03 20:01:26.695645 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.693325 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-577678865d-sxpjq" podStartSLOduration=2.584777233 podStartE2EDuration="7.693304928s" totalImagesPullingTime="5.108527695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:01:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:01:26.692014177 +0000 UTC m=+70.933880988" watchObservedRunningTime="2026-11-03 20:01:26.693304928 +0000 UTC m=+70.935171721" Nov 03 20:01:26.872388 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:26.872343 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c75c8599-kcxp6"] Nov 03 20:01:26.875872 ip-10-0-140-181 kubenswrapper[2576]: W1103 20:01:26.875772 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1241d10_9647_4075_9091_19183e105d50.slice/crio-88bc9c95b6c532a38daf4d42bfb0fb5f51c852a295b1fef6fcb5dc13a3e2d7a1 WatchSource:0}: Error finding container 88bc9c95b6c532a38daf4d42bfb0fb5f51c852a295b1fef6fcb5dc13a3e2d7a1: Status 404 returned error can't find the container with id 88bc9c95b6c532a38daf4d42bfb0fb5f51c852a295b1fef6fcb5dc13a3e2d7a1 Nov 03 20:01:27.580588 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:27.580529 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" event={"ID":"f5da7c0e-2db7-48fd-ac10-bccc095ef79e","Type":"ContainerStarted","Data":"22621b9e9a6b993cac7fe0a4eb71fd669e841636725327ed9b632f913e5152d2"} Nov 03 20:01:27.581064 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:27.580650 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" event={"ID":"f5da7c0e-2db7-48fd-ac10-bccc095ef79e","Type":"ContainerStarted","Data":"7e4f5dd3b302f6c3a470d2488aea3e8cff911f8a1c373dc05aeb725417c686c5"} Nov 03 20:01:27.581064 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:27.580697 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" event={"ID":"f5da7c0e-2db7-48fd-ac10-bccc095ef79e","Type":"ContainerStarted","Data":"d8f1d99d0350b05dc074e843c9424f56a24898f4e023861aff2e0da690432886"} Nov 03 20:01:27.584482 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:27.584449 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" event={"ID":"f1241d10-9647-4075-9091-19183e105d50","Type":"ContainerStarted","Data":"88bc9c95b6c532a38daf4d42bfb0fb5f51c852a295b1fef6fcb5dc13a3e2d7a1"} Nov 03 20:01:28.591610 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:28.591063 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-x5gxd" event={"ID":"5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2","Type":"ContainerStarted","Data":"d0f0006ea6b9a97c5268ebd1b1e72fa33132a31d117deefacfa20305d3729bb6"} Nov 03 20:01:28.592045 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:28.591682 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:01:28.596622 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:28.596452 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"26c31b1c-c3c5-4676-b71f-f44499e10a3b","Type":"ContainerStarted","Data":"0e50aab9b670d17e900f506d647135307d7e71fc459b3fe945eb3041ffa40c85"} Nov 03 20:01:28.596622 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:28.596509 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"26c31b1c-c3c5-4676-b71f-f44499e10a3b","Type":"ContainerStarted","Data":"f792768c003a7d7cb9b4dcdf1cf49218d8ec68ddc8baf89f3c20a7be2d867375"} Nov 03 20:01:28.596622 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:28.596534 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"26c31b1c-c3c5-4676-b71f-f44499e10a3b","Type":"ContainerStarted","Data":"c716c75d1aef47b81dc36fc7507c8bfb5e7eaf85366802c6231271b0c5d91188"} Nov 03 20:01:28.596622 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:28.596556 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"26c31b1c-c3c5-4676-b71f-f44499e10a3b","Type":"ContainerStarted","Data":"9eb3b256043614bcc0883ab53936170e3232b11734e321aa055bbd703e72166c"} Nov 03 20:01:28.596622 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:28.596591 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"26c31b1c-c3c5-4676-b71f-f44499e10a3b","Type":"ContainerStarted","Data":"ca32ffc835bab4a15726b4c13a81687d7e95fd59b5b9dcb93b1dad9e868b60dd"} Nov 03 20:01:29.611473 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:29.611441 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"26c31b1c-c3c5-4676-b71f-f44499e10a3b","Type":"ContainerStarted","Data":"0d817fa96bbc573fbc89e48560eb6b13575a92968d78b1841cbf09c9d9356355"} Nov 03 20:01:29.615319 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:29.615212 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" event={"ID":"f5da7c0e-2db7-48fd-ac10-bccc095ef79e","Type":"ContainerStarted","Data":"1774dfb1a0b4a1e7e8c4b99b1107f3033e050f322d5d39a3ca5437a8b0fe2f55"} Nov 03 20:01:29.615319 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:29.615292 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" event={"ID":"f5da7c0e-2db7-48fd-ac10-bccc095ef79e","Type":"ContainerStarted","Data":"4f547c5698e321412b5d3f9522117e71fbf201bf9344e4e4f30679e921f7fa43"} Nov 03 20:01:29.615499 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:29.615334 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" event={"ID":"f5da7c0e-2db7-48fd-ac10-bccc095ef79e","Type":"ContainerStarted","Data":"f240eed312f8cb7c7e58b34ca0d2bbcbc712bc7872e6a912efd0236d2af46652"} Nov 03 20:01:29.615499 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:29.615385 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:29.617859 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:29.617833 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" event={"ID":"4dbfce43-ac06-4413-92eb-f123614df91d","Type":"ContainerStarted","Data":"18b28e0d4d15605224d0e9a61bf9b191fc73796beea0ff13c67919dba6344fa9"} Nov 03 20:01:29.748810 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:29.748759 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.63087194 podStartE2EDuration="7.748741475s" totalImagesPullingTime="5.110825268s" totalInitContainerRuntime="7.044267ms" isStatefulPod=false podCreationTimestamp="2026-11-03 20:01:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:01:29.747582723 +0000 UTC m=+73.989449513" watchObservedRunningTime="2026-11-03 20:01:29.748741475 +0000 UTC m=+73.990608267" Nov 03 20:01:29.748991 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:29.748927 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-x5gxd" podStartSLOduration=67.319307105 podStartE2EDuration="1m12.74892032s" totalImagesPullingTime="5.429613215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:00:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:01:28.711522691 +0000 UTC m=+72.953389484" watchObservedRunningTime="2026-11-03 20:01:29.74892032 +0000 UTC m=+73.990787111" Nov 03 20:01:29.874592 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:29.874427 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" podStartSLOduration=3.006488341 podStartE2EDuration="7.874410608s" totalImagesPullingTime="4.867922267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:01:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:01:29.872809735 +0000 UTC m=+74.114676517" watchObservedRunningTime="2026-11-03 20:01:29.874410608 +0000 UTC m=+74.116277402" Nov 03 20:01:29.994208 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:29.994145 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" podStartSLOduration=2.226275511 podStartE2EDuration="4.994125818s" totalImagesPullingTime="2.767850307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:01:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:01:29.992783565 +0000 UTC m=+74.234650361" watchObservedRunningTime="2026-11-03 20:01:29.994125818 +0000 UTC m=+74.235992609" Nov 03 20:01:30.011037 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:30.010995 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:30.011211 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:30.011056 2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:30.016611 ip-10-0-140-181 kubenswrapper[2576]: I1103 20:01:30.016584 2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:30.355545 ip-10-0-140-181 systemd[1]: Stopping Kubernetes Kubelet... Nov 03 20:01:30.378039 ip-10-0-140-181 systemd[1]: kubelet.service: Deactivated successfully. Nov 03 20:01:30.378297 ip-10-0-140-181 systemd[1]: Stopped Kubernetes Kubelet. Nov 03 20:01:30.378365 ip-10-0-140-181 systemd[1]: kubelet.service: Consumed 4.477s CPU time. Nov 03 20:01:30.396347 ip-10-0-140-181 systemd[1]: Starting Kubernetes Kubelet... Nov 03 20:01:30.465301 ip-10-0-140-181 kubenswrapper[5857]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 03 20:01:30.465301 ip-10-0-140-181 kubenswrapper[5857]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Nov 03 20:01:30.465301 ip-10-0-140-181 kubenswrapper[5857]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 03 20:01:30.465301 ip-10-0-140-181 kubenswrapper[5857]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 03 20:01:30.467515 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467429 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 20:01:30.467515 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467514 5857 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 20:01:30.467515 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467518 5857 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 20:01:30.467515 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467521 5857 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 20:01:30.467671 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467524 5857 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 20:01:30.467671 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467527 5857 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 20:01:30.467671 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467529 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 20:01:30.467671 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467534 5857 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 20:01:30.467671 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467537 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 20:01:30.467671 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467539 5857 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 20:01:30.467671 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467542 5857 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 20:01:30.467671 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467545 5857 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 20:01:30.467671 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467547 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 20:01:30.467671 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467550 5857 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 20:01:30.467671 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467553 5857 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 20:01:30.467671 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467555 5857 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 20:01:30.467671 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467557 5857 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 20:01:30.467671 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467577 5857 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 20:01:30.467671 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467581 5857 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 20:01:30.467671 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467585 5857 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 20:01:30.467671 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467588 5857 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 20:01:30.467671 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467592 5857 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 20:01:30.467671 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467597 5857 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 20:01:30.467671 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467600 5857 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 20:01:30.468168 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467604 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 20:01:30.468168 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467606 5857 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 20:01:30.468168 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467609 5857 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 20:01:30.468168 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467614 5857 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 20:01:30.468168 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467617 5857 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 20:01:30.468168 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467620 5857 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 20:01:30.468168 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467622 5857 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 20:01:30.468168 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467625 5857 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 20:01:30.468168 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467627 5857 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 20:01:30.468168 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467630 5857 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 20:01:30.468168 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467633 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 20:01:30.468168 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467635 5857 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 20:01:30.468168 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467638 5857 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 20:01:30.468168 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467641 5857 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 20:01:30.468168 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467644 5857 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 20:01:30.468168 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467646 5857 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 20:01:30.468168 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467649 5857 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 20:01:30.468168 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467651 5857 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 20:01:30.468168 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467654 5857 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 20:01:30.468657 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467657 5857 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 20:01:30.468657 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467661 5857 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 20:01:30.468657 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467664 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 20:01:30.468657 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467666 5857 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 20:01:30.468657 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467669 5857 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 20:01:30.468657 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467672 5857 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 20:01:30.468657 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467674 5857 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 20:01:30.468657 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467677 5857 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 20:01:30.468657 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467679 5857 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 20:01:30.468657 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467682 5857 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 20:01:30.468657 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467685 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 20:01:30.468657 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467687 5857 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 20:01:30.468657 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467690 5857 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 20:01:30.468657 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467693 5857 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 20:01:30.468657 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467695 5857 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 20:01:30.468657 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467698 5857 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 20:01:30.468657 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467700 5857 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 20:01:30.468657 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467703 5857 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 20:01:30.468657 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467706 5857 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 20:01:30.468657 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467709 5857 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 20:01:30.469129 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467713 5857 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 20:01:30.469129 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467716 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 20:01:30.469129 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467720 5857 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 20:01:30.469129 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467722 5857 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 20:01:30.469129 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467725 5857 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 20:01:30.469129 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467728 5857 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 20:01:30.469129 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467731 5857 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 20:01:30.469129 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467733 5857 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 20:01:30.469129 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467736 5857 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 20:01:30.469129 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467739 5857 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 20:01:30.469129 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467742 5857 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 20:01:30.469129 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467744 5857 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 20:01:30.469129 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467746 5857 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 20:01:30.469129 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467749 5857 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 20:01:30.469129 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467751 5857 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 20:01:30.469129 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467754 5857 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 20:01:30.469129 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467756 5857 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 20:01:30.469129 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467758 5857 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 20:01:30.469129 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467761 5857 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 20:01:30.469603 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467763 5857 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 20:01:30.469603 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467766 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 20:01:30.469603 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467768 5857 feature_gate.go:386] unrecognized feature gate: Example Nov 03 20:01:30.469603 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467770 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 20:01:30.469603 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467773 5857 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 20:01:30.469603 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467775 5857 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 20:01:30.469603 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467778 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 20:01:30.469603 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467780 5857 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 20:01:30.469603 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467783 5857 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 20:01:30.469603 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467785 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 20:01:30.469603 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467787 5857 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 20:01:30.469603 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467791 5857 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 20:01:30.469603 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467794 5857 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 20:01:30.469603 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467796 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 20:01:30.469603 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467800 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 20:01:30.469603 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467802 5857 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 20:01:30.469603 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467805 5857 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 20:01:30.469603 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467807 5857 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 20:01:30.469603 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467810 5857 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 20:01:30.469603 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467812 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 20:01:30.470133 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467815 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 20:01:30.470133 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467817 5857 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 20:01:30.470133 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467819 5857 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 20:01:30.470133 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.467823 5857 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 20:01:30.470133 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468678 5857 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 20:01:30.470133 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468687 5857 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 20:01:30.470133 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468690 5857 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 20:01:30.470133 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468693 5857 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 20:01:30.470133 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468696 5857 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 20:01:30.470133 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468699 5857 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 20:01:30.470133 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468701 5857 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 20:01:30.470133 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468705 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 20:01:30.470133 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468707 5857 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 20:01:30.470133 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468710 5857 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 20:01:30.470133 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468712 5857 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 20:01:30.470133 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468715 5857 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 20:01:30.470133 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468717 5857 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 20:01:30.470133 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468720 5857 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 20:01:30.470133 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468724 5857 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 20:01:30.470622 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468728 5857 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 20:01:30.470622 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468731 5857 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 20:01:30.470622 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468738 5857 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 20:01:30.470622 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468741 5857 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 20:01:30.470622 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468747 5857 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 20:01:30.470622 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468750 5857 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 20:01:30.470622 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468753 5857 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 20:01:30.470622 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468756 5857 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 20:01:30.470622 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468759 5857 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 20:01:30.470622 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468761 5857 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 20:01:30.470622 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468764 5857 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 20:01:30.470622 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468767 5857 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 20:01:30.470622 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468769 5857 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 20:01:30.470622 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468772 5857 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 20:01:30.470622 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468775 5857 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 20:01:30.470622 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468777 5857 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 20:01:30.470622 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468780 5857 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 20:01:30.470622 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468782 5857 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 20:01:30.470622 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468786 5857 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 20:01:30.470622 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468790 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 20:01:30.471098 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468793 5857 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 20:01:30.471098 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468796 5857 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 20:01:30.471098 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468799 5857 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 20:01:30.471098 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468802 5857 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 20:01:30.471098 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468805 5857 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 20:01:30.471098 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468808 5857 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 20:01:30.471098 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468811 5857 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 20:01:30.471098 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468814 5857 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 20:01:30.471098 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468816 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 20:01:30.471098 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468819 5857 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 20:01:30.471098 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468822 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 20:01:30.471098 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468824 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 20:01:30.471098 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468827 5857 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 20:01:30.471098 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468829 5857 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 20:01:30.471098 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468833 5857 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 20:01:30.471098 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468835 5857 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 20:01:30.471098 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468838 5857 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 20:01:30.471098 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468840 5857 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 20:01:30.471098 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468843 5857 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 20:01:30.471098 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468846 5857 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 20:01:30.471691 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468849 5857 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 20:01:30.471691 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468852 5857 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 20:01:30.471691 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468855 5857 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 20:01:30.471691 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468857 5857 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 20:01:30.471691 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468860 5857 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 20:01:30.471691 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468862 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 20:01:30.471691 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468865 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 20:01:30.471691 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468868 5857 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 20:01:30.471691 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468870 5857 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 20:01:30.471691 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468873 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 20:01:30.471691 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468875 5857 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 20:01:30.471691 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468878 5857 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 20:01:30.471691 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468880 5857 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 20:01:30.471691 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468883 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 20:01:30.471691 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468885 5857 feature_gate.go:386] unrecognized feature gate: Example Nov 03 20:01:30.471691 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468888 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 20:01:30.471691 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468890 5857 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 20:01:30.471691 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468893 5857 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 20:01:30.471691 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468895 5857 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 20:01:30.472275 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468897 5857 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 20:01:30.472275 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468900 5857 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 20:01:30.472275 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468902 5857 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 20:01:30.472275 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468905 5857 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 20:01:30.472275 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468907 5857 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 20:01:30.472275 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468910 5857 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 20:01:30.472275 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468912 5857 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 20:01:30.472275 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468916 5857 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 20:01:30.472275 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468918 5857 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 20:01:30.472275 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468920 5857 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 20:01:30.472275 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468923 5857 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 20:01:30.472275 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468926 5857 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 20:01:30.472275 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468929 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 20:01:30.472275 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468932 5857 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 20:01:30.472275 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468934 5857 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 20:01:30.472275 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468936 5857 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 20:01:30.472275 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468939 5857 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 20:01:30.472275 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468941 5857 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 20:01:30.472275 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468944 5857 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 20:01:30.472275 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468946 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 20:01:30.472841 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468949 5857 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 20:01:30.472841 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468951 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 20:01:30.472841 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468954 5857 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 20:01:30.472841 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468956 5857 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 20:01:30.472841 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468959 5857 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 20:01:30.472841 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468961 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 20:01:30.472841 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468963 5857 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 20:01:30.472841 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468966 5857 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 20:01:30.472841 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468968 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 20:01:30.472841 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468972 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 20:01:30.472841 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468974 5857 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 20:01:30.472841 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.468976 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 20:01:30.472841 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469471 5857 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 20:01:30.472841 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469476 5857 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 20:01:30.472841 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469479 5857 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 20:01:30.472841 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469482 5857 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 20:01:30.472841 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469484 5857 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 20:01:30.472841 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469487 5857 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 20:01:30.472841 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469491 5857 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 20:01:30.473306 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469496 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 20:01:30.473306 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469499 5857 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 20:01:30.473306 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469502 5857 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 20:01:30.473306 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469505 5857 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 20:01:30.473306 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469508 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 20:01:30.473306 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469511 5857 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 20:01:30.473306 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469514 5857 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 20:01:30.473306 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469516 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 20:01:30.473306 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469519 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 20:01:30.473306 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469521 5857 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 20:01:30.473306 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469524 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 20:01:30.473306 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469526 5857 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 20:01:30.473306 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469528 5857 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 20:01:30.473306 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469531 5857 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 20:01:30.473306 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469533 5857 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 20:01:30.473306 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469536 5857 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 20:01:30.473306 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469538 5857 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 20:01:30.473306 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469540 5857 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 20:01:30.473306 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469543 5857 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 20:01:30.473823 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469545 5857 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 20:01:30.473823 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469547 5857 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 20:01:30.473823 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469550 5857 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 20:01:30.473823 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469553 5857 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 20:01:30.473823 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469556 5857 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 20:01:30.473823 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469558 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 20:01:30.473823 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469581 5857 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 20:01:30.473823 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469584 5857 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 20:01:30.473823 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469586 5857 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 20:01:30.473823 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469589 5857 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 20:01:30.473823 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469592 5857 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 20:01:30.473823 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469594 5857 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 20:01:30.473823 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469597 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 20:01:30.473823 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469600 5857 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 20:01:30.473823 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469602 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 20:01:30.473823 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469605 5857 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 20:01:30.473823 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469607 5857 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 20:01:30.473823 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469611 5857 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 20:01:30.473823 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469614 5857 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 20:01:30.473823 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469617 5857 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 20:01:30.474305 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469620 5857 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 20:01:30.474305 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469622 5857 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 20:01:30.474305 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469624 5857 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 20:01:30.474305 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469627 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 20:01:30.474305 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469629 5857 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 20:01:30.474305 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469632 5857 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 20:01:30.474305 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469634 5857 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 20:01:30.474305 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469637 5857 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 20:01:30.474305 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469639 5857 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 20:01:30.474305 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469642 5857 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 20:01:30.474305 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469644 5857 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 20:01:30.474305 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469647 5857 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 20:01:30.474305 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469650 5857 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 20:01:30.474305 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469652 5857 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 20:01:30.474305 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469655 5857 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 20:01:30.474305 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469658 5857 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 20:01:30.474305 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469662 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 20:01:30.474305 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469664 5857 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 20:01:30.474305 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469667 5857 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 20:01:30.474305 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469670 5857 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 20:01:30.474837 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469673 5857 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 20:01:30.474837 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469675 5857 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 20:01:30.474837 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469678 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 20:01:30.474837 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469680 5857 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 20:01:30.474837 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469683 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 20:01:30.474837 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469685 5857 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 20:01:30.474837 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469687 5857 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 20:01:30.474837 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469690 5857 feature_gate.go:386] unrecognized feature gate: Example Nov 03 20:01:30.474837 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469692 5857 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 20:01:30.474837 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469694 5857 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 20:01:30.474837 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469697 5857 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 20:01:30.474837 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469700 5857 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 20:01:30.474837 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469708 5857 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 20:01:30.474837 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469711 5857 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 20:01:30.474837 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469714 5857 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 20:01:30.474837 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469716 5857 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 20:01:30.474837 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469719 5857 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 20:01:30.474837 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469721 5857 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 20:01:30.474837 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469724 5857 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 20:01:30.475539 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469726 5857 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 20:01:30.475539 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469729 5857 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 20:01:30.475539 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469731 5857 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 20:01:30.475539 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469734 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 20:01:30.475539 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469737 5857 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 20:01:30.475539 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469739 5857 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 20:01:30.475539 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469741 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 20:01:30.475539 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469744 5857 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 20:01:30.475539 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469746 5857 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 20:01:30.475539 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469751 5857 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 20:01:30.475539 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469753 5857 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 20:01:30.475539 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469756 5857 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 20:01:30.475539 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469758 5857 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 20:01:30.475539 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469761 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 20:01:30.475539 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469763 5857 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 20:01:30.475539 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469766 5857 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 20:01:30.475539 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469768 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 20:01:30.475539 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469770 5857 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 20:01:30.475539 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469773 5857 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 20:01:30.476202 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469775 5857 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 20:01:30.476202 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.469778 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 20:01:30.476202 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.469875 5857 flags.go:64] FLAG: --address="0.0.0.0" Nov 03 20:01:30.476202 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.469893 5857 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Nov 03 20:01:30.476202 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.469901 5857 flags.go:64] FLAG: --anonymous-auth="true" Nov 03 20:01:30.476202 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.469906 5857 flags.go:64] FLAG: --application-metrics-count-limit="100" Nov 03 20:01:30.476202 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.469911 5857 flags.go:64] FLAG: --authentication-token-webhook="false" Nov 03 20:01:30.476202 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.469920 5857 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Nov 03 20:01:30.476202 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.469925 5857 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Nov 03 20:01:30.476202 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.469929 5857 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Nov 03 20:01:30.476202 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.469932 5857 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Nov 03 20:01:30.476202 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.469935 5857 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Nov 03 20:01:30.476202 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.469939 5857 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Nov 03 20:01:30.476202 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.469942 5857 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Nov 03 20:01:30.476202 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.469945 5857 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Nov 03 20:01:30.476202 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.469948 5857 flags.go:64] FLAG: --cgroup-root="" Nov 03 20:01:30.476202 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.469951 5857 flags.go:64] FLAG: --cgroups-per-qos="true" Nov 03 20:01:30.476202 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.469954 5857 flags.go:64] FLAG: --client-ca-file="" Nov 03 20:01:30.476202 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.469957 5857 flags.go:64] FLAG: --cloud-provider="external" Nov 03 20:01:30.476202 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.469960 5857 flags.go:64] FLAG: --cluster-dns="[]" Nov 03 20:01:30.476202 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.469964 5857 flags.go:64] FLAG: --cluster-domain="" Nov 03 20:01:30.476202 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.469966 5857 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Nov 03 20:01:30.476202 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.469971 5857 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Nov 03 20:01:30.476779 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.469974 5857 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Nov 03 20:01:30.476779 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.469977 5857 flags.go:64] FLAG: --container-log-max-files="5" Nov 03 20:01:30.476779 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.469981 5857 flags.go:64] FLAG: --container-log-max-size="10Mi" Nov 03 20:01:30.476779 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.469984 5857 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Nov 03 20:01:30.476779 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.469987 5857 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Nov 03 20:01:30.476779 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.469990 5857 flags.go:64] FLAG: --containerd-namespace="k8s.io" Nov 03 20:01:30.476779 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.469993 5857 flags.go:64] FLAG: --contention-profiling="false" Nov 03 20:01:30.476779 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.469996 5857 flags.go:64] FLAG: --cpu-cfs-quota="true" Nov 03 20:01:30.476779 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.469999 5857 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Nov 03 20:01:30.476779 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470002 5857 flags.go:64] FLAG: --cpu-manager-policy="none" Nov 03 20:01:30.476779 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470007 5857 flags.go:64] FLAG: --cpu-manager-policy-options="" Nov 03 20:01:30.476779 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470011 5857 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Nov 03 20:01:30.476779 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470014 5857 flags.go:64] FLAG: --enable-controller-attach-detach="true" Nov 03 20:01:30.476779 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470017 5857 flags.go:64] FLAG: --enable-debugging-handlers="true" Nov 03 20:01:30.476779 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470019 5857 flags.go:64] FLAG: --enable-load-reader="false" Nov 03 20:01:30.476779 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470022 5857 flags.go:64] FLAG: --enable-server="true" Nov 03 20:01:30.476779 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470025 5857 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Nov 03 20:01:30.476779 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470029 5857 flags.go:64] FLAG: --event-burst="100" Nov 03 20:01:30.476779 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470033 5857 flags.go:64] FLAG: --event-qps="50" Nov 03 20:01:30.476779 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470035 5857 flags.go:64] FLAG: --event-storage-age-limit="default=0" Nov 03 20:01:30.476779 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470038 5857 flags.go:64] FLAG: --event-storage-event-limit="default=0" Nov 03 20:01:30.476779 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470041 5857 flags.go:64] FLAG: --eviction-hard="" Nov 03 20:01:30.476779 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470045 5857 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Nov 03 20:01:30.476779 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470048 5857 flags.go:64] FLAG: --eviction-minimum-reclaim="" Nov 03 20:01:30.477396 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470051 5857 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Nov 03 20:01:30.477396 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470054 5857 flags.go:64] FLAG: --eviction-soft="" Nov 03 20:01:30.477396 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470057 5857 flags.go:64] FLAG: --eviction-soft-grace-period="" Nov 03 20:01:30.477396 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470060 5857 flags.go:64] FLAG: --exit-on-lock-contention="false" Nov 03 20:01:30.477396 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470063 5857 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Nov 03 20:01:30.477396 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470066 5857 flags.go:64] FLAG: --experimental-mounter-path="" Nov 03 20:01:30.477396 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470068 5857 flags.go:64] FLAG: --fail-cgroupv1="true" Nov 03 20:01:30.477396 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470073 5857 flags.go:64] FLAG: --fail-swap-on="true" Nov 03 20:01:30.477396 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470075 5857 flags.go:64] FLAG: --feature-gates="" Nov 03 20:01:30.477396 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470080 5857 flags.go:64] FLAG: --file-check-frequency="20s" Nov 03 20:01:30.477396 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470083 5857 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Nov 03 20:01:30.477396 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470086 5857 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Nov 03 20:01:30.477396 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470089 5857 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Nov 03 20:01:30.477396 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470092 5857 flags.go:64] FLAG: --healthz-port="10248" Nov 03 20:01:30.477396 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470095 5857 flags.go:64] FLAG: --help="false" Nov 03 20:01:30.477396 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470098 5857 flags.go:64] FLAG: --hostname-override="ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:01:30.477396 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470101 5857 flags.go:64] FLAG: --housekeeping-interval="10s" Nov 03 20:01:30.477396 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470104 5857 flags.go:64] FLAG: --http-check-frequency="20s" Nov 03 20:01:30.477396 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470111 5857 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Nov 03 20:01:30.477396 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470114 5857 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Nov 03 20:01:30.477396 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470118 5857 flags.go:64] FLAG: --image-gc-high-threshold="85" Nov 03 20:01:30.477396 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470121 5857 flags.go:64] FLAG: --image-gc-low-threshold="80" Nov 03 20:01:30.477396 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470124 5857 flags.go:64] FLAG: --image-service-endpoint="" Nov 03 20:01:30.477978 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470126 5857 flags.go:64] FLAG: --kernel-memcg-notification="false" Nov 03 20:01:30.477978 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470129 5857 flags.go:64] FLAG: --kube-api-burst="100" Nov 03 20:01:30.477978 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470132 5857 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Nov 03 20:01:30.477978 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470136 5857 flags.go:64] FLAG: --kube-api-qps="50" Nov 03 20:01:30.477978 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470139 5857 flags.go:64] FLAG: --kube-reserved="" Nov 03 20:01:30.477978 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470142 5857 flags.go:64] FLAG: --kube-reserved-cgroup="" Nov 03 20:01:30.477978 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470145 5857 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Nov 03 20:01:30.477978 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470148 5857 flags.go:64] FLAG: --kubelet-cgroups="" Nov 03 20:01:30.477978 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470151 5857 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Nov 03 20:01:30.477978 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470153 5857 flags.go:64] FLAG: --lock-file="" Nov 03 20:01:30.477978 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470156 5857 flags.go:64] FLAG: --log-cadvisor-usage="false" Nov 03 20:01:30.477978 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470159 5857 flags.go:64] FLAG: --log-flush-frequency="5s" Nov 03 20:01:30.477978 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470162 5857 flags.go:64] FLAG: --log-json-info-buffer-size="0" Nov 03 20:01:30.477978 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470167 5857 flags.go:64] FLAG: --log-json-split-stream="false" Nov 03 20:01:30.477978 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470171 5857 flags.go:64] FLAG: --log-text-info-buffer-size="0" Nov 03 20:01:30.477978 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470174 5857 flags.go:64] FLAG: --log-text-split-stream="false" Nov 03 20:01:30.477978 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470178 5857 flags.go:64] FLAG: --logging-format="text" Nov 03 20:01:30.477978 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470181 5857 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Nov 03 20:01:30.477978 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470184 5857 flags.go:64] FLAG: --make-iptables-util-chains="true" Nov 03 20:01:30.477978 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470187 5857 flags.go:64] FLAG: --manifest-url="" Nov 03 20:01:30.477978 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470190 5857 flags.go:64] FLAG: --manifest-url-header="" Nov 03 20:01:30.477978 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470194 5857 flags.go:64] FLAG: --max-housekeeping-interval="15s" Nov 03 20:01:30.477978 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470197 5857 flags.go:64] FLAG: --max-open-files="1000000" Nov 03 20:01:30.477978 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470201 5857 flags.go:64] FLAG: --max-pods="110" Nov 03 20:01:30.477978 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470204 5857 flags.go:64] FLAG: --maximum-dead-containers="-1" Nov 03 20:01:30.478688 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470207 5857 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Nov 03 20:01:30.478688 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470210 5857 flags.go:64] FLAG: --memory-manager-policy="None" Nov 03 20:01:30.478688 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470214 5857 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Nov 03 20:01:30.478688 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470217 5857 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Nov 03 20:01:30.478688 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470220 5857 flags.go:64] FLAG: --node-ip="0.0.0.0" Nov 03 20:01:30.478688 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470223 5857 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Nov 03 20:01:30.478688 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470230 5857 flags.go:64] FLAG: --node-status-max-images="50" Nov 03 20:01:30.478688 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470233 5857 flags.go:64] FLAG: --node-status-update-frequency="10s" Nov 03 20:01:30.478688 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470236 5857 flags.go:64] FLAG: --oom-score-adj="-999" Nov 03 20:01:30.478688 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470239 5857 flags.go:64] FLAG: --pod-cidr="" Nov 03 20:01:30.478688 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470242 5857 flags.go:64] FLAG: --pod-manifest-path="" Nov 03 20:01:30.478688 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470245 5857 flags.go:64] FLAG: --pod-max-pids="-1" Nov 03 20:01:30.478688 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470248 5857 flags.go:64] FLAG: --pods-per-core="0" Nov 03 20:01:30.478688 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470251 5857 flags.go:64] FLAG: --port="10250" Nov 03 20:01:30.478688 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470254 5857 flags.go:64] FLAG: --protect-kernel-defaults="false" Nov 03 20:01:30.478688 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470257 5857 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-047ba3ae6a22c1166" Nov 03 20:01:30.478688 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470260 5857 flags.go:64] FLAG: --qos-reserved="" Nov 03 20:01:30.478688 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470263 5857 flags.go:64] FLAG: --read-only-port="10255" Nov 03 20:01:30.478688 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470266 5857 flags.go:64] FLAG: --register-node="true" Nov 03 20:01:30.478688 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470269 5857 flags.go:64] FLAG: --register-with-taints="" Nov 03 20:01:30.478688 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470272 5857 flags.go:64] FLAG: --registry-burst="10" Nov 03 20:01:30.478688 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470275 5857 flags.go:64] FLAG: --registry-qps="5" Nov 03 20:01:30.478688 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470278 5857 flags.go:64] FLAG: --reserved-cpus="" Nov 03 20:01:30.478688 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470282 5857 flags.go:64] FLAG: --reserved-memory="" Nov 03 20:01:30.478688 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470285 5857 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Nov 03 20:01:30.478688 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470288 5857 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Nov 03 20:01:30.479318 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470291 5857 flags.go:64] FLAG: --rotate-certificates="false" Nov 03 20:01:30.479318 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470294 5857 flags.go:64] FLAG: --rotate-server-certificates="false" Nov 03 20:01:30.479318 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470297 5857 flags.go:64] FLAG: --runonce="false" Nov 03 20:01:30.479318 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470300 5857 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Nov 03 20:01:30.479318 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470303 5857 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Nov 03 20:01:30.479318 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470305 5857 flags.go:64] FLAG: --seccomp-default="false" Nov 03 20:01:30.479318 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470308 5857 flags.go:64] FLAG: --serialize-image-pulls="true" Nov 03 20:01:30.479318 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470311 5857 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Nov 03 20:01:30.479318 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470315 5857 flags.go:64] FLAG: --storage-driver-db="cadvisor" Nov 03 20:01:30.479318 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470318 5857 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Nov 03 20:01:30.479318 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470321 5857 flags.go:64] FLAG: --storage-driver-password="root" Nov 03 20:01:30.479318 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470324 5857 flags.go:64] FLAG: --storage-driver-secure="false" Nov 03 20:01:30.479318 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470327 5857 flags.go:64] FLAG: --storage-driver-table="stats" Nov 03 20:01:30.479318 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470330 5857 flags.go:64] FLAG: --storage-driver-user="root" Nov 03 20:01:30.479318 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470333 5857 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Nov 03 20:01:30.479318 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470336 5857 flags.go:64] FLAG: --sync-frequency="1m0s" Nov 03 20:01:30.479318 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470339 5857 flags.go:64] FLAG: --system-cgroups="" Nov 03 20:01:30.479318 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470341 5857 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Nov 03 20:01:30.479318 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470347 5857 flags.go:64] FLAG: --system-reserved-cgroup="" Nov 03 20:01:30.479318 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470350 5857 flags.go:64] FLAG: --tls-cert-file="" Nov 03 20:01:30.479318 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470353 5857 flags.go:64] FLAG: --tls-cipher-suites="[]" Nov 03 20:01:30.479318 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470357 5857 flags.go:64] FLAG: --tls-min-version="" Nov 03 20:01:30.479318 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470359 5857 flags.go:64] FLAG: --tls-private-key-file="" Nov 03 20:01:30.479318 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470362 5857 flags.go:64] FLAG: --topology-manager-policy="none" Nov 03 20:01:30.479318 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470365 5857 flags.go:64] FLAG: --topology-manager-policy-options="" Nov 03 20:01:30.479929 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470368 5857 flags.go:64] FLAG: --topology-manager-scope="container" Nov 03 20:01:30.479929 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470370 5857 flags.go:64] FLAG: --v="2" Nov 03 20:01:30.479929 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470375 5857 flags.go:64] FLAG: --version="false" Nov 03 20:01:30.479929 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470379 5857 flags.go:64] FLAG: --vmodule="" Nov 03 20:01:30.479929 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470384 5857 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Nov 03 20:01:30.479929 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470387 5857 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Nov 03 20:01:30.479929 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470620 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 20:01:30.479929 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470626 5857 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 20:01:30.479929 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470630 5857 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 20:01:30.479929 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470633 5857 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 20:01:30.479929 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470636 5857 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 20:01:30.479929 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470639 5857 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 20:01:30.479929 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470641 5857 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 20:01:30.479929 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470644 5857 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 20:01:30.479929 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470647 5857 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 20:01:30.479929 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470651 5857 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 20:01:30.479929 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470653 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 20:01:30.479929 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470656 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 20:01:30.479929 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470658 5857 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 20:01:30.479929 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470661 5857 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 20:01:30.479929 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470664 5857 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 20:01:30.480441 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470667 5857 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 20:01:30.480441 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470669 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 20:01:30.480441 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470672 5857 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 20:01:30.480441 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470674 5857 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 20:01:30.480441 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470676 5857 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 20:01:30.480441 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470680 5857 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 20:01:30.480441 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470683 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 20:01:30.480441 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470686 5857 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 20:01:30.480441 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470688 5857 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 20:01:30.480441 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470691 5857 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 20:01:30.480441 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470693 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 20:01:30.480441 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470696 5857 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 20:01:30.480441 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470699 5857 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 20:01:30.480441 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470701 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 20:01:30.480441 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470705 5857 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 20:01:30.480441 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470711 5857 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 20:01:30.480441 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470714 5857 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 20:01:30.480441 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470717 5857 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 20:01:30.480441 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470720 5857 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 20:01:30.481117 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470722 5857 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 20:01:30.481117 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470725 5857 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 20:01:30.481117 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470728 5857 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 20:01:30.481117 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470731 5857 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 20:01:30.481117 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470734 5857 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 20:01:30.481117 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470736 5857 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 20:01:30.481117 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470739 5857 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 20:01:30.481117 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470742 5857 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 20:01:30.481117 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470744 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 20:01:30.481117 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470747 5857 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 20:01:30.481117 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470749 5857 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 20:01:30.481117 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470752 5857 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 20:01:30.481117 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470755 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 20:01:30.481117 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470757 5857 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 20:01:30.481117 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470760 5857 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 20:01:30.481117 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470762 5857 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 20:01:30.481117 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470765 5857 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 20:01:30.481117 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470767 5857 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 20:01:30.481117 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470770 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 20:01:30.481887 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470773 5857 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 20:01:30.481887 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470775 5857 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 20:01:30.481887 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470778 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 20:01:30.481887 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470780 5857 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 20:01:30.481887 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470783 5857 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 20:01:30.481887 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470785 5857 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 20:01:30.481887 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470788 5857 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 20:01:30.481887 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470790 5857 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 20:01:30.481887 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470793 5857 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 20:01:30.481887 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470798 5857 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 20:01:30.481887 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470801 5857 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 20:01:30.481887 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470803 5857 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 20:01:30.481887 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470806 5857 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 20:01:30.481887 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470808 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 20:01:30.481887 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470811 5857 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 20:01:30.481887 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470813 5857 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 20:01:30.481887 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470816 5857 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 20:01:30.481887 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470818 5857 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 20:01:30.481887 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470821 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 20:01:30.481887 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470824 5857 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 20:01:30.482554 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470826 5857 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 20:01:30.482554 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470829 5857 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 20:01:30.482554 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470831 5857 feature_gate.go:386] unrecognized feature gate: Example Nov 03 20:01:30.482554 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470833 5857 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 20:01:30.482554 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470836 5857 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 20:01:30.482554 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470839 5857 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 20:01:30.482554 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470841 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 20:01:30.482554 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470843 5857 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 20:01:30.482554 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470846 5857 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 20:01:30.482554 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470850 5857 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 20:01:30.482554 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470853 5857 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 20:01:30.482554 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470856 5857 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 20:01:30.482554 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470858 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 20:01:30.482554 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470861 5857 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 20:01:30.482554 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470864 5857 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 20:01:30.482554 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470866 5857 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 20:01:30.482554 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470869 5857 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 20:01:30.482554 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470871 5857 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 20:01:30.482554 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470873 5857 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 20:01:30.482554 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470876 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 20:01:30.483077 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470878 5857 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 20:01:30.483077 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470882 5857 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 20:01:30.483077 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470885 5857 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 20:01:30.483077 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470887 5857 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 20:01:30.483077 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470890 5857 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 20:01:30.483077 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470892 5857 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 20:01:30.483077 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470895 5857 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 20:01:30.483077 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470897 5857 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 20:01:30.483077 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470900 5857 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 20:01:30.483077 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470902 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 20:01:30.483077 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470904 5857 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 20:01:30.483077 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470907 5857 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 20:01:30.483077 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470910 5857 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 20:01:30.483077 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.470936 5857 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 03 20:01:30.483077 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470979 5857 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 20:01:30.483077 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470985 5857 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 20:01:30.483665 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470987 5857 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 20:01:30.483665 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470990 5857 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 20:01:30.483665 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470992 5857 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 20:01:30.483665 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470995 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 20:01:30.483665 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.470998 5857 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 20:01:30.483665 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471000 5857 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 20:01:30.483665 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471003 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 20:01:30.483665 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471005 5857 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 20:01:30.483665 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471008 5857 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 20:01:30.483665 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471010 5857 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 20:01:30.483665 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471014 5857 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 20:01:30.483665 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471017 5857 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 20:01:30.483665 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471019 5857 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 20:01:30.483665 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471022 5857 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 20:01:30.483665 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471024 5857 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 20:01:30.483665 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471027 5857 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 20:01:30.483665 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471029 5857 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 20:01:30.483665 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471032 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 20:01:30.483665 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471035 5857 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 20:01:30.483665 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471038 5857 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 20:01:30.484579 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471040 5857 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 20:01:30.484579 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471043 5857 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 20:01:30.484579 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471045 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 20:01:30.484579 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471049 5857 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 20:01:30.484579 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471052 5857 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 20:01:30.484579 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471054 5857 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 20:01:30.484579 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471056 5857 feature_gate.go:386] unrecognized feature gate: Example Nov 03 20:01:30.484579 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471059 5857 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 20:01:30.484579 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471061 5857 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 20:01:30.484579 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471064 5857 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 20:01:30.484579 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471066 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 20:01:30.484579 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471069 5857 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 20:01:30.484579 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471071 5857 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 20:01:30.484579 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471075 5857 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 20:01:30.484579 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471079 5857 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 20:01:30.484579 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471082 5857 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 20:01:30.484579 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471085 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 20:01:30.484579 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471088 5857 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 20:01:30.484579 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471090 5857 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 20:01:30.484579 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471093 5857 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 20:01:30.485426 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471095 5857 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 20:01:30.485426 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471098 5857 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 20:01:30.485426 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471100 5857 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 20:01:30.485426 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471103 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 20:01:30.485426 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471106 5857 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 20:01:30.485426 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471108 5857 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 20:01:30.485426 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471111 5857 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 20:01:30.485426 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471114 5857 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 20:01:30.485426 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471116 5857 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 20:01:30.485426 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471118 5857 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 20:01:30.485426 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471123 5857 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 20:01:30.485426 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471125 5857 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 20:01:30.485426 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471128 5857 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 20:01:30.485426 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471130 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 20:01:30.485426 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471132 5857 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 20:01:30.485426 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471136 5857 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 20:01:30.485426 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471141 5857 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 20:01:30.485426 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471143 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 20:01:30.485426 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471146 5857 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 20:01:30.485426 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471148 5857 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 20:01:30.486034 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471150 5857 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 20:01:30.486034 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471153 5857 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 20:01:30.486034 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471156 5857 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 20:01:30.486034 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471158 5857 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 20:01:30.486034 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471160 5857 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 20:01:30.486034 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471163 5857 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 20:01:30.486034 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471165 5857 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 20:01:30.486034 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471168 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 20:01:30.486034 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471170 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 20:01:30.486034 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471172 5857 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 20:01:30.486034 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471175 5857 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 20:01:30.486034 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471177 5857 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 20:01:30.486034 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471179 5857 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 20:01:30.486034 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471182 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 20:01:30.486034 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471184 5857 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 20:01:30.486034 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471187 5857 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 20:01:30.486034 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471190 5857 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 20:01:30.486034 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471192 5857 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 20:01:30.486034 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471195 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 20:01:30.486034 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471198 5857 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 20:01:30.486750 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471200 5857 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 20:01:30.486750 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471202 5857 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 20:01:30.486750 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471206 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 20:01:30.486750 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471209 5857 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 20:01:30.486750 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471211 5857 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 20:01:30.486750 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471214 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 20:01:30.486750 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471218 5857 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 20:01:30.486750 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471222 5857 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 20:01:30.486750 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471225 5857 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 20:01:30.486750 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471228 5857 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 20:01:30.486750 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471231 5857 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 20:01:30.486750 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471233 5857 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 20:01:30.486750 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471236 5857 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 20:01:30.486750 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471238 5857 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 20:01:30.486750 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471241 5857 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 20:01:30.486750 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471244 5857 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 20:01:30.486750 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471246 5857 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 20:01:30.486750 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471249 5857 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 20:01:30.486750 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471251 5857 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 20:01:30.487557 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471253 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 20:01:30.487557 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471256 5857 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 20:01:30.487557 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471258 5857 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 20:01:30.487557 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471261 5857 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 20:01:30.487557 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.471263 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 20:01:30.487557 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.475816 5857 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Nov 03 20:01:30.487557 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.475838 5857 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Nov 03 20:01:30.487557 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.475865 5857 watchdog_linux.go:95] "Systemd watchdog is not enabled" Nov 03 20:01:30.487557 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.475873 5857 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Nov 03 20:01:30.487557 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476207 5857 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 20:01:30.487557 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476221 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 20:01:30.487557 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476225 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 20:01:30.487557 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476228 5857 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 20:01:30.487557 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476231 5857 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 20:01:30.487557 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476235 5857 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 20:01:30.487557 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476238 5857 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 20:01:30.487557 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476240 5857 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 20:01:30.487557 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476243 5857 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 20:01:30.487557 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476246 5857 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 20:01:30.488104 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476248 5857 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 20:01:30.488104 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476251 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 20:01:30.488104 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476254 5857 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 20:01:30.488104 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476256 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 20:01:30.488104 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476259 5857 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 20:01:30.488104 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476261 5857 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 20:01:30.488104 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476264 5857 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 20:01:30.488104 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476267 5857 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 20:01:30.488104 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476270 5857 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 20:01:30.488104 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476273 5857 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 20:01:30.488104 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476276 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 20:01:30.488104 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476279 5857 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 20:01:30.488104 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476281 5857 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 20:01:30.488104 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476284 5857 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 20:01:30.488104 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476286 5857 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 20:01:30.488104 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476289 5857 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 20:01:30.488104 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476291 5857 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 20:01:30.488104 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476294 5857 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 20:01:30.488104 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476298 5857 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 20:01:30.488588 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476303 5857 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 20:01:30.488588 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476307 5857 feature_gate.go:386] unrecognized feature gate: Example Nov 03 20:01:30.488588 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476310 5857 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 20:01:30.488588 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476313 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 20:01:30.488588 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476315 5857 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 20:01:30.488588 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476318 5857 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 20:01:30.488588 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476320 5857 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 20:01:30.488588 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476323 5857 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 20:01:30.488588 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476325 5857 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 20:01:30.488588 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476328 5857 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 20:01:30.488588 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476333 5857 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 20:01:30.488588 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476335 5857 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 20:01:30.488588 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476338 5857 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 20:01:30.488588 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476341 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 20:01:30.488588 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476344 5857 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 20:01:30.488588 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476347 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 20:01:30.488588 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476349 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 20:01:30.488588 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476352 5857 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 20:01:30.488588 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476355 5857 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 20:01:30.489057 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476358 5857 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 20:01:30.489057 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476360 5857 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 20:01:30.489057 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476362 5857 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 20:01:30.489057 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476365 5857 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 20:01:30.489057 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476370 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 20:01:30.489057 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476372 5857 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 20:01:30.489057 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476375 5857 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 20:01:30.489057 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476379 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 20:01:30.489057 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476382 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 20:01:30.489057 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476385 5857 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 20:01:30.489057 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476387 5857 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 20:01:30.489057 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476390 5857 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 20:01:30.489057 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476393 5857 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 20:01:30.489057 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476396 5857 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 20:01:30.489057 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476398 5857 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 20:01:30.489057 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476401 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 20:01:30.489057 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476403 5857 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 20:01:30.489057 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476406 5857 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 20:01:30.489057 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476408 5857 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 20:01:30.489674 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476411 5857 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 20:01:30.489674 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476413 5857 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 20:01:30.489674 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476416 5857 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 20:01:30.489674 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476418 5857 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 20:01:30.489674 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476421 5857 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 20:01:30.489674 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476423 5857 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 20:01:30.489674 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476426 5857 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 20:01:30.489674 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476428 5857 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 20:01:30.489674 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476431 5857 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 20:01:30.489674 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476434 5857 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 20:01:30.489674 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476436 5857 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 20:01:30.489674 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476439 5857 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 20:01:30.489674 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476442 5857 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 20:01:30.489674 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476445 5857 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 20:01:30.489674 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476447 5857 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 20:01:30.489674 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476450 5857 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 20:01:30.489674 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476452 5857 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 20:01:30.489674 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476455 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 20:01:30.489674 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476458 5857 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 20:01:30.489674 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476460 5857 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 20:01:30.490446 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476463 5857 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 20:01:30.490446 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476465 5857 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 20:01:30.490446 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476468 5857 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 20:01:30.490446 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476470 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 20:01:30.490446 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476473 5857 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 20:01:30.490446 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476475 5857 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 20:01:30.490446 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476478 5857 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 20:01:30.490446 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476480 5857 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 20:01:30.490446 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476483 5857 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 20:01:30.490446 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476485 5857 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 20:01:30.490446 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476488 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 20:01:30.490446 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476490 5857 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 20:01:30.490446 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476493 5857 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 20:01:30.490446 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476497 5857 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 20:01:30.490446 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476500 5857 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 20:01:30.490446 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476503 5857 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 20:01:30.490446 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476506 5857 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 20:01:30.490446 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476508 5857 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 20:01:30.490446 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476511 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 20:01:30.491291 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.476541 5857 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 03 20:01:30.491291 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476706 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 20:01:30.491291 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476711 5857 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 20:01:30.491291 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476714 5857 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 20:01:30.491291 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476717 5857 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 20:01:30.491291 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476719 5857 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 20:01:30.491291 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476723 5857 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 20:01:30.491291 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476726 5857 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 20:01:30.491291 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476729 5857 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 20:01:30.491291 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476731 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 20:01:30.491291 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476734 5857 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 20:01:30.491291 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476736 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 20:01:30.491291 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476739 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 20:01:30.491291 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476741 5857 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 20:01:30.491291 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476744 5857 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 20:01:30.491291 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476747 5857 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 20:01:30.491882 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476749 5857 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 20:01:30.491882 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476752 5857 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 20:01:30.491882 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476754 5857 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 20:01:30.491882 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476757 5857 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 20:01:30.491882 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476759 5857 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 20:01:30.491882 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476762 5857 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 20:01:30.491882 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476764 5857 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 20:01:30.491882 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476767 5857 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 20:01:30.491882 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476769 5857 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 20:01:30.491882 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476772 5857 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 20:01:30.491882 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476775 5857 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 20:01:30.491882 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476777 5857 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 20:01:30.491882 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476780 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 20:01:30.491882 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476782 5857 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 20:01:30.491882 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476785 5857 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 20:01:30.491882 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476788 5857 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 20:01:30.491882 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476791 5857 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 20:01:30.491882 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476793 5857 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 20:01:30.491882 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476796 5857 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 20:01:30.491882 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476799 5857 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 20:01:30.492457 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476801 5857 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 20:01:30.492457 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476804 5857 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 20:01:30.492457 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476807 5857 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 20:01:30.492457 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476810 5857 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 20:01:30.492457 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476812 5857 feature_gate.go:386] unrecognized feature gate: Example Nov 03 20:01:30.492457 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476815 5857 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 20:01:30.492457 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476817 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 20:01:30.492457 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476820 5857 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 20:01:30.492457 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476822 5857 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 20:01:30.492457 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476825 5857 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 20:01:30.492457 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476827 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 20:01:30.492457 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476830 5857 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 20:01:30.492457 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476832 5857 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 20:01:30.492457 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476835 5857 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 20:01:30.492457 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476837 5857 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 20:01:30.492457 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476840 5857 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 20:01:30.492457 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476842 5857 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 20:01:30.492457 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476844 5857 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 20:01:30.492457 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476847 5857 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 20:01:30.492457 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476850 5857 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 20:01:30.493036 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476852 5857 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 20:01:30.493036 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476855 5857 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 20:01:30.493036 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476858 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 20:01:30.493036 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476860 5857 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 20:01:30.493036 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476863 5857 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 20:01:30.493036 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476865 5857 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 20:01:30.493036 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476868 5857 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 20:01:30.493036 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476870 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 20:01:30.493036 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476872 5857 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 20:01:30.493036 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476875 5857 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 20:01:30.493036 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476877 5857 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 20:01:30.493036 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476879 5857 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 20:01:30.493036 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476882 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 20:01:30.493036 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476885 5857 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 20:01:30.493036 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476888 5857 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 20:01:30.493036 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476891 5857 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 20:01:30.493036 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476894 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 20:01:30.493036 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476897 5857 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 20:01:30.493036 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476899 5857 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 20:01:30.493513 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476902 5857 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 20:01:30.493513 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476905 5857 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 20:01:30.493513 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476907 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 20:01:30.493513 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476910 5857 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 20:01:30.493513 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476912 5857 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 20:01:30.493513 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476914 5857 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 20:01:30.493513 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476917 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 20:01:30.493513 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476919 5857 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 20:01:30.493513 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476921 5857 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 20:01:30.493513 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476924 5857 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 20:01:30.493513 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476926 5857 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 20:01:30.493513 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476929 5857 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 20:01:30.493513 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476931 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 20:01:30.493513 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476934 5857 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 20:01:30.493513 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476936 5857 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 20:01:30.493513 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476940 5857 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 20:01:30.493513 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476943 5857 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 20:01:30.493513 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476946 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 20:01:30.493513 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476949 5857 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 20:01:30.494101 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476951 5857 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 20:01:30.494101 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476954 5857 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 20:01:30.494101 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476956 5857 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 20:01:30.494101 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476958 5857 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 20:01:30.494101 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476961 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 20:01:30.494101 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476964 5857 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 20:01:30.494101 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476966 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 20:01:30.494101 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476968 5857 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 20:01:30.494101 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476971 5857 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 20:01:30.494101 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476973 5857 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 20:01:30.494101 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476976 5857 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 20:01:30.494101 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476979 5857 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 20:01:30.494101 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.476982 5857 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 20:01:30.494101 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.477005 5857 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 03 20:01:30.494101 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477037 5857 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 20:01:30.494101 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477041 5857 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 20:01:30.494486 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477044 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 20:01:30.494486 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477047 5857 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 20:01:30.494486 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477049 5857 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 20:01:30.494486 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477053 5857 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 20:01:30.494486 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477057 5857 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 20:01:30.494486 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477060 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 20:01:30.494486 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477063 5857 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 20:01:30.494486 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477066 5857 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 20:01:30.494486 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477069 5857 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 20:01:30.494486 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477071 5857 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 20:01:30.494486 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477074 5857 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 20:01:30.494486 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477076 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 20:01:30.494486 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477079 5857 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 20:01:30.494486 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477082 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 20:01:30.494486 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477085 5857 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 20:01:30.494486 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477087 5857 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 20:01:30.494486 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477090 5857 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 20:01:30.494486 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477092 5857 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 20:01:30.494486 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477095 5857 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 20:01:30.495011 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477097 5857 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 20:01:30.495011 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477100 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 20:01:30.495011 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477102 5857 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 20:01:30.495011 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477104 5857 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 20:01:30.495011 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477107 5857 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 20:01:30.495011 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477109 5857 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 20:01:30.495011 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477112 5857 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 20:01:30.495011 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477114 5857 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 20:01:30.495011 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477117 5857 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 20:01:30.495011 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477119 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 20:01:30.495011 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477122 5857 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 20:01:30.495011 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477124 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 20:01:30.495011 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477127 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 20:01:30.495011 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477129 5857 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 20:01:30.495011 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477131 5857 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 20:01:30.495011 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477134 5857 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 20:01:30.495011 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477136 5857 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 20:01:30.495011 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477139 5857 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 20:01:30.495011 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477141 5857 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 20:01:30.495011 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477143 5857 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 20:01:30.495493 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477150 5857 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 20:01:30.495493 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477153 5857 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 20:01:30.495493 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477155 5857 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 20:01:30.495493 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477158 5857 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 20:01:30.495493 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477160 5857 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 20:01:30.495493 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477163 5857 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 20:01:30.495493 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477165 5857 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 20:01:30.495493 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477169 5857 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 20:01:30.495493 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477172 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 20:01:30.495493 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477175 5857 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 20:01:30.495493 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477177 5857 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 20:01:30.495493 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477180 5857 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 20:01:30.495493 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477182 5857 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 20:01:30.495493 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477185 5857 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 20:01:30.495493 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477187 5857 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 20:01:30.495493 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477190 5857 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 20:01:30.495493 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477193 5857 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 20:01:30.495493 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477195 5857 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 20:01:30.495493 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477198 5857 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 20:01:30.495493 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477201 5857 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 20:01:30.496007 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477203 5857 feature_gate.go:386] unrecognized feature gate: Example Nov 03 20:01:30.496007 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477206 5857 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 20:01:30.496007 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477209 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 20:01:30.496007 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477211 5857 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 20:01:30.496007 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477214 5857 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 20:01:30.496007 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477216 5857 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 20:01:30.496007 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477219 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 20:01:30.496007 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477221 5857 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 20:01:30.496007 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477224 5857 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 20:01:30.496007 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477226 5857 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 20:01:30.496007 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477228 5857 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 20:01:30.496007 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477231 5857 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 20:01:30.496007 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477235 5857 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 20:01:30.496007 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477237 5857 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 20:01:30.496007 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477240 5857 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 20:01:30.496007 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477242 5857 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 20:01:30.496007 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477245 5857 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 20:01:30.496007 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477248 5857 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 20:01:30.496007 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477250 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 20:01:30.496007 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477254 5857 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 20:01:30.496527 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477257 5857 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 20:01:30.496527 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477260 5857 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 20:01:30.496527 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477262 5857 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 20:01:30.496527 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477265 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 20:01:30.496527 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477267 5857 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 20:01:30.496527 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477269 5857 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 20:01:30.496527 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477272 5857 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 20:01:30.496527 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477274 5857 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 20:01:30.496527 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477277 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 20:01:30.496527 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477281 5857 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 20:01:30.496527 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477285 5857 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 20:01:30.496527 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477288 5857 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 20:01:30.496527 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477291 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 20:01:30.496527 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477293 5857 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 20:01:30.496527 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477296 5857 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 20:01:30.496527 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477299 5857 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 20:01:30.496527 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477301 5857 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 20:01:30.496527 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477304 5857 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 20:01:30.496527 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477306 5857 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 20:01:30.497194 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477309 5857 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 20:01:30.497194 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477311 5857 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 20:01:30.497194 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477313 5857 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 20:01:30.497194 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477316 5857 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 20:01:30.497194 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477318 5857 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 20:01:30.497194 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:30.477323 5857 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 20:01:30.497194 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.477383 5857 server.go:957] "Client rotation is on, will bootstrap in background" Nov 03 20:01:30.497194 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.478348 5857 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Nov 03 20:01:30.497194 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.478405 5857 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Nov 03 20:01:30.497194 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.478656 5857 server.go:1014] "Starting client certificate rotation" Nov 03 20:01:30.497194 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.478797 5857 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 03 20:01:30.497194 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.478838 5857 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-02 19:55:17 +0000 UTC" deadline="2028-05-06 21:06:42.021361642 +0000 UTC" Nov 03 20:01:30.497194 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.478872 5857 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13201h5m11.542491737s" Nov 03 20:01:30.497194 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.479158 5857 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 03 20:01:30.497194 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.480250 5857 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 03 20:01:30.497194 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.481785 5857 log.go:25] "Validated CRI v1 runtime API" Nov 03 20:01:30.497942 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.486278 5857 log.go:25] "Validated CRI v1 image API" Nov 03 20:01:30.497942 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.487231 5857 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Nov 03 20:01:30.497942 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.491677 5857 fs.go:135] Filesystem UUIDs: map[0b185b55-70d0-4102-9780-420d17256b2f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 dd108ab3-dc06-45e9-a3ab-f8d530283a8e:/dev/nvme0n1p4] Nov 03 20:01:30.498110 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.491701 5857 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0ae94da46971ce3c29e7ed8d62153bb16c9a5a0d14353bfcef6a7eb1c62b5d33/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0ae94da46971ce3c29e7ed8d62153bb16c9a5a0d14353bfcef6a7eb1c62b5d33/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0f0a289384e847e54564988a7badfa37668e875ad3d223b7c6f82a463975189f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0f0a289384e847e54564988a7badfa37668e875ad3d223b7c6f82a463975189f/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2e62244c4b8d4f787091f14f1780b2d2571c5607d819f1e1d8e4b1cedeeb7604/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2e62244c4b8d4f787091f14f1780b2d2571c5607d819f1e1d8e4b1cedeeb7604/userdata/shm major:0 minor:264 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2f19ee96e0cda5bba4e76a755fc521e9115b493710767b7674583d6b887d66c4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2f19ee96e0cda5bba4e76a755fc521e9115b493710767b7674583d6b887d66c4/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/629f3d2fd9e832092d3193bf3273444080ab8b0c9327e6bd5d83f1918e237325/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/629f3d2fd9e832092d3193bf3273444080ab8b0c9327e6bd5d83f1918e237325/userdata/shm major:0 minor:327 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/79a12079c959238bd59f3eadb4bb47806725e75ff362bb2e7df5fae97177757d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/79a12079c959238bd59f3eadb4bb47806725e75ff362bb2e7df5fae97177757d/userdata/shm major:0 minor:321 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7adef30e25b1d1a6858159dabdbd1786206e26ef92977685375acffd3caa2053/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7adef30e25b1d1a6858159dabdbd1786206e26ef92977685375acffd3caa2053/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7d208722eb470db1c9341fa7767eb1673c9c260587b9b8a448828888a3ac8d92/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7d208722eb470db1c9341fa7767eb1673c9c260587b9b8a448828888a3ac8d92/userdata/shm major:0 minor:322 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/88bc9c95b6c532a38daf4d42bfb0fb5f51c852a295b1fef6fcb5dc13a3e2d7a1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/88bc9c95b6c532a38daf4d42bfb0fb5f51c852a295b1fef6fcb5dc13a3e2d7a1/userdata/shm major:0 minor:419 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8e0075cb87635dee2539a8fb45f72d488ad43efd1245dd21b15f0eff57019d6b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8e0075cb87635dee2539a8fb45f72d488ad43efd1245dd21b15f0eff57019d6b/userdata/shm major:0 minor:406 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/97c9b81f31810c9510cb064f7bf6b901b40808abef6a684b99accaea77411965/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/97c9b81f31810c9510cb064f7bf6b901b40808abef6a684b99accaea77411965/userdata/shm major:0 minor:355 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9e2aa1c197055a6648b15a76bb70227f6f64f6edfd0b33c3dd7293eeca740aa6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9e2aa1c197055a6648b15a76bb70227f6f64f6edfd0b33c3dd7293eeca740aa6/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a0fbad3549f5a9ee433e12d0ecb908c828d95b925fe17e43123d72f87a9485db/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a0fbad3549f5a9ee433e12d0ecb908c828d95b925fe17e43123d72f87a9485db/userdata/shm major:0 minor:282 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a50278cd6c9777df22e5b3d318fe96b833221b657b96777c122692df98859471/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a50278cd6c9777df22e5b3d318fe96b833221b657b96777c122692df98859471/userdata/shm major:0 minor:209 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a64e3913a245391683e541997e9ccd6fce59cc1d433f712fe9760c80e43c6b24/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a64e3913a245391683e541997e9ccd6fce59cc1d433f712fe9760c80e43c6b24/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a6944b1f2d00e498ad7cb060325ecc52f29922dde9e0a0add0f38e424d92427e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a6944b1f2d00e498ad7cb060325ecc52f29922dde9e0a0add0f38e424d92427e/userdata/shm major:0 minor:224 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a9289d02c31995256882e2a388053ffdd6432b45cd4ad2186b61eedcd7853105/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a9289d02c31995256882e2a388053ffdd6432b45cd4ad2186b61eedcd7853105/userdata/shm major:0 minor:80 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/bad22f822ef6f404d989cca09a5f8f90d8905bc13e1ec818ba58e3593dcbe504/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/bad22f822ef6f404d989cca09a5f8f90d8905bc13e1ec818ba58e3593dcbe504/userdata/shm major:0 minor:299 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/bb581d67b2b27a04a236ff64b2f71ebbdabf9c413b792e369aaff7d991e14c4e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/bb581d67b2b27a04a236ff64b2f71ebbdabf9c413b792e369aaff7d991e14c4e/userdata/shm major:0 minor:297 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/bd6d9915d98b8ce879c7cc7cd16af82e1e828908695d1c5f96202a84267efc28/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/bd6d9915d98b8ce879c7cc7cd16af82e1e828908695d1c5f96202a84267efc28/userdata/shm major:0 minor:95 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d458e523b958bfc654cb0d4513a78242e0f96447453153b462882c3b477ee3f3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d458e523b958bfc654cb0d4513a78242e0f96447453153b462882c3b477ee3f3/userdata/shm major:0 minor:70 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d5f9d4a516c2641c72f78d01228d85b5ac97190650053ad91869207f58b72259/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d5f9d4a516c2641c72f78d01228d85b5ac97190650053ad91869207f58b72259/userdata/shm major:0 minor:207 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d81772f20883761e0d12e5b34bf9bdd2362d6f328a86c68296e817b4d0ecc036/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d81772f20883761e0d12e5b34bf9bdd2362d6f328a86c68296e817b4d0ecc036/userdata/shm major:0 minor:380 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/dae873b182bfc3f60b97f7ceda8c99d20aaf214f33b455ff90891105abf47ddb/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/dae873b182bfc3f60b97f7ceda8c99d20aaf214f33b455ff90891105abf47ddb/userdata/shm major:0 minor:292 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e1f881937bcaa543868f89113eb36d94c46458b2359d92515242d24ed9a35c17/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e1f881937bcaa543868f89113eb36d94c46458b2359d92515242d24ed9a35c17/userdata/shm major:0 minor:89 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e95e79534ee3bdcb9b3e17d9e55af8360d35af5b5b2313ad46ad4b8097896fe4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e95e79534ee3bdcb9b3e17d9e55af8360d35af5b5b2313ad46ad4b8097896fe4/userdata/shm major:0 minor:205 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0c479f18-0308-403a-adf1-42575f8adfa2/volumes/kubernetes.io~secret/tls-certificates:{mountpoint:/var/lib/kubelet/pods/0c479f18-0308-403a-adf1-42575f8adfa2/volumes/kubernetes.io~secret/tls-certificates major:0 minor:219 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0e720aa2-db14-40f6-b905-0155bcbd7809/volumes/kubernetes.io~projected/kube-api-access-6sj4s:{mountpoint:/var/lib/kubelet/pods/0e720aa2-db14-40f6-b905-0155bcbd7809/volumes/kubernetes.io~projected/kube-api-access-6sj4s major:0 minor:281 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0e720aa2-db14-40f6-b905-0155bcbd7809/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/0e720aa2-db14-40f6-b905-0155bcbd7809/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:276 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0e720aa2-db14-40f6-b905-0155bcbd7809/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/0e720aa2-db14-40f6-b905-0155bcbd7809/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:280 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/19f9860c-9efc-4678-8c1e-393c723b4611/volumes/kubernetes.io~projected/kube-api-access-wc8z5:{mountpoint:/var/lib/kubelet/pods/19f9860c-9efc-4678-8c1e-393c723b4611/volumes/kubernetes.io~projected/kube-api-access-wc8z5 major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9/volumes/kubernetes.io~projected/kube-api-access-jjlrv:{mountpoint:/var/lib/kubelet/pods/22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9/volumes/kubernetes.io~projected/kube-api-access-jjlrv major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volume-subpaths/cluster-tls-config/alertmanager/10:{mountpoint:/var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volume-subpaths/cluster-tls-config/alertmanager/10 major:0 minor:345 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volume-subpaths/web-config/alertmanager/9:{mountpoint:/var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volume-subpaths/web-config/alertmanager/9 major:0 minor:342 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volume-subpaths/web-config/config-reloader/6:{mountpoint:/var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volume-subpaths/web-config/config-reloader/6 major:0 minor:342 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volume-subpaths/web-config/init-config-reloader/6:{mountpoint:/var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volume-subpaths/web-config/init-config-reloader/6 major:0 minor:342 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volumes/kubernetes.io~empty-dir/config-out major:0 minor:346 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volumes/kubernetes.io~projected/kube-api-access-5jjfg:{mountpoint:/var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volumes/kubernetes.io~projected/kube-api-access-5jjfg major:0 minor:352 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volumes/kubernetes.io~projected/tls-assets major:0 minor:343 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volumes/kubernetes.io~secret/cluster-tls-config:{mountpoint:/var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volumes/kubernetes.io~secret/cluster-tls-config major:0 minor:345 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volumes/kubernetes.io~secret/config-volume:{mountpoint:/var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volumes/kubernetes.io~secret/config-volume major:0 minor:338 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy major:0 minor:344 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric:{mountpoint:/var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric major:0 minor:348 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web major:0 minor:349 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volumes/kubernetes.io~secret/secret-alertmanager-main-tls:{mountpoint:/var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volumes/kubernetes.io~secret/secret-alertmanager-main-tls major:0 minor:347 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volumes/kubernetes.io~secret/web-config major:0 minor:342 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3/volumes/kubernetes.io~projected/kube-api-access-9p6cc:{mountpoint:/var/lib/kubelet/pods/2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3/volumes/kubernetes.io~projected/kube-api-access-9p6cc major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/30329c02-c760-48d5-86f7-dd265325adb0/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/30329c02-c760-48d5-86f7-dd265325adb0/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:313 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb/volumes/kubernetes.io~projected/kube-api-access-fsxkj:{mountpoint:/var/lib/kubelet/pods/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb/volumes/kubernetes.io~projected/kube-api-access-fsxkj major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4dbfce43-ac06-4413-92eb-f123614df91d/volumes/kubernetes.io~projected/kube-api-access-r74cx:{mountpoint:/var/lib/kubelet/pods/4dbfce43-ac06-4413-92eb-f123614df91d/volumes/kubernetes.io~projected/kube-api-access-r74cx major:0 minor:397 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4dbfce43-ac06-4413-92eb-f123614df91d/volumes/kubernetes.io~secret/client-ca-bundle:{mountpoint:/var/lib/kubelet/pods/4dbfce43-ac06-4413-92eb-f123614df91d/volumes/kubernetes.io~secret/client-ca-bundle major:0 minor:403 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4dbfce43-ac06-4413-92eb-f123614df91d/volumes/kubernetes.io~secret/secret-metrics-server-client-certs:{mountpoint:/var/lib/kubelet/pods/4dbfce43-ac06-4413-92eb-f123614df91d/volumes/kubernetes.io~secret/secret-metrics-server-client-certs major:0 minor:402 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4dbfce43-ac06-4413-92eb-f123614df91d/volumes/kubernetes.io~secret/secret-metrics-server-tls:{mountpoint:/var/lib/kubelet/pods/4dbfce43-ac06-4413-92eb-f123614df91d/volumes/kubernetes.io~secret/secret-metrics-server-tls major:0 minor:404 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2/volumes/kubernetes.io~projected/kube-api-access-rsbqv:{mountpoint:/var/lib/kubelet/pods/5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2/volumes/kubernetes.io~projected/kube-api-access-rsbqv major:0 minor:320 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/62a2d16f-a781-4b20-ae3e-323c123f9ac0/volumes/kubernetes.io~projected/kube-api-access-f7l96:{mountpoint:/var/lib/kubelet/pods/62a2d16f-a781-4b20-ae3e-323c123f9ac0/volumes/kubernetes.io~projected/kube-api-access-f7l96 major:0 minor:263 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/62a2d16f-a781-4b20-ae3e-323c123f9ac0/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/62a2d16f-a781-4b20-ae3e-323c123f9ac0/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config major:0 minor:257 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/62a2d16f-a781-4b20-ae3e-323c123f9ac0/volumes/kubernetes.io~secret/prometheus-operator-tls:{mountpoint:/var/lib/kubelet/pods/62a2d16f-a781-4b20-ae3e-323c123f9ac0/volumes/kubernetes.io~secret/prometheus-operator-tls major:0 minor:262 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7acfd1d0-46c5-4c12-a419-597cc58d88f1/volumes/kubernetes.io~projected/kube-api-access-nqz58:{mountpoint:/var/lib/kubelet/pods/7acfd1d0-46c5-4c12-a419-597cc58d88f1/volumes/kubernetes.io~projected/kube-api-access-nqz58 major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7acfd1d0-46c5-4c12-a419-597cc58d88f1/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/7acfd1d0-46c5-4c12-a419-597cc58d88f1/volumes/kubernetes.io~secret/metrics-tls major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/84404c7a-cc47-4e08-861b-a3b417f17e18/volumes/kubernetes.io~projected/kube-api-access-jpcs7:{mountpoint:/var/lib/kubelet/pods/84404c7a-cc47-4e08-861b-a3b417f17e18/volumes/kubernetes.io~projected/kube-api-access-jpcs7 major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/960e81d3-4bff-4a35-b6a8-edcd186c6c44/volumes/kubernetes.io~projected/kube-api-access-jpqvp:{mountpoint:/var/lib/kubelet/pods/960e81d3-4bff-4a35-b6a8-edcd186c6c44/volumes/kubernetes.io~projected/kube-api-access-jpqvp major:0 minor:288 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/960e81d3-4bff-4a35-b6a8-edcd186c6c44/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/960e81d3-4bff-4a35-b6a8-edcd186c6c44/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config major:0 minor:285 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/960e81d3-4bff-4a35-b6a8-edcd186c6c44/volumes/kubernetes.io~secret/openshift-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/960e81d3-4bff-4a35-b6a8-edcd186c6c44/volumes/kubernetes.io~secret/openshift-state-metrics-tls major:0 minor:284 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/98448491-e429-4d6f-a50a-7cb104997edf/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/98448491-e429-4d6f-a50a-7cb104997edf/volumes/kubernetes.io~secret/agent-certs major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/999ebe89-05a8-4bae-ba5b-b756dd69b073/volumes/kubernetes.io~projected/kube-api-access-77q8n:{mountpoint:/var/lib/kubelet/pods/999ebe89-05a8-4bae-ba5b-b756dd69b073/volumes/kubernetes.io~projected/kube-api-access-77q8n major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/999ebe89-05a8-4bae-ba5b-b756dd69b073/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/999ebe89-05a8-4bae-ba5b-b756dd69b073/volumes/kubernetes.io~secret/cert major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a445b335-dfaf-41a2-afb5-e9ee45ec471f/volumes/kubernetes.io~projected/kube-api-access-t7rwr:{mountpoint:/var/lib/kubelet/pods/a445b335-dfaf-41a2-afb5-e9ee45ec471f/volumes/kubernetes.io~projected/kube-api-access-t7rwr major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aae6331f-1f9f-43c8-9610-f554ddebf2e3/volumes/kubernetes.io~projected/kube-api-access-nwhj2:{mountpoint:/var/lib/kubelet/pods/aae6331f-1f9f-43c8-9610-f554ddebf2e3/volumes/kubernetes.io~projected/kube-api-access-nwhj2 major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aae6331f-1f9f-43c8-9610-f554ddebf2e3/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/aae6331f-1f9f-43c8-9610-f554ddebf2e3/volumes/kubernetes.io~secret/metrics-certs major:0 minor:319 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879/volumes/kubernetes.io~projected/kube-api-access-dlv6z:{mountpoint:/var/lib/kubelet/pods/b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879/volumes/kubernetes.io~projected/kube-api-access-dlv6z major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bd8a2436-4362-4c11-9e4b-9e20b73094e6/volumes/kubernetes.io~projected/kube-api-access-9zr4p:{mountpoint:/var/lib/kubelet/pods/bd8a2436-4362-4c11-9e4b-9e20b73094e6/volumes/kubernetes.io~projected/kube-api-access-9zr4p major:0 minor:291 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bd8a2436-4362-4c11-9e4b-9e20b73094e6/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/bd8a2436-4362-4c11-9e4b-9e20b73094e6/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config major:0 minor:290 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bd8a2436-4362-4c11-9e4b-9e20b73094e6/volumes/kubernetes.io~secret/kube-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/bd8a2436-4362-4c11-9e4b-9e20b73094e6/volumes/kubernetes.io~secret/kube-state-metrics-tls major:0 minor:289 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ccbc5713-cd4c-455b-9162-f4ecfedde1f7/volumes/kubernetes.io~projected/kube-api-access-ddnm7:{mountpoint:/var/lib/kubelet/pods/ccbc5713-cd4c-455b-9162-f4ecfedde1f7/volumes/kubernetes.io~projected/kube-api-access-ddnm7 major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/eb01d4b7-2af5-4493-af2c-8d90a120851f/volumes/kubernetes.io~projected/kube-api-access-shsdx:{mountpoint:/var/lib/kubelet/pods/eb01d4b7-2af5-4493-af2c-8d90a120851f/volumes/kubernetes.io~projected/kube-api-access-shsdx major:0 minor:296 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/eb01d4b7-2af5-4493-af2c-8d90a120851f/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/eb01d4b7-2af5-4493-af2c-8d90a120851f/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config major:0 minor:294 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/eb01d4b7-2af5-4493-af2c-8d90a120851f/volumes/kubernetes.io~secret/node-exporter-tls:{mountpoint:/var/lib/kubelet/pods/eb01d4b7-2af5-4493-af2c-8d90a120851f/volumes/kubernetes.io~secret/node-exporter-tls major:0 minor:295 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1/volumes/kubernetes.io~empty-dir/tmp major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1/volumes/kubernetes.io~projected/kube-api-access-d9272:{mountpoint:/var/lib/kubelet/pods/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1/volumes/kubernetes.io~projected/kube-api-access-d9272 major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f1241d10-9647-4075-9091-19183e105d50/volumes/kubernetes.io~projected/kube-api-access-r7vcn:{mountpoint:/var/lib/kubelet/pods/f1241d10-9647-4075-9091-19183e105d50/volumes/kubernetes.io~projected/kube-api-access-r7vcn major:0 minor:418 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f1241d10-9647-4075-9091-19183e105d50/volumes/kubernetes.io~secret/federate-client-tls:{mountpoint:/var/lib/kubelet/pods/f1241d10-9647-4075-9091-19183e105d50/volumes/kubernetes.io~secret/federate-client-tls major:0 minor:417 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f1241d10-9647-4075-9091-19183e105d50/volumes/kubernetes.io~secret/secret-telemeter-client:{mountpoint:/var/lib/kubelet/pods/f1241d10-9647-4075-9091-19183e105d50/volumes/kubernetes.io~secret/secret-telemeter-client major:0 minor:415 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f1241d10-9647-4075-9091-19183e105d50/volumes/kubernetes.io~secret/secret-telemeter-client-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/f1241d10-9647-4075-9091-19183e105d50/volumes/kubernetes.io~secret/secret-telemeter-client-kube-rbac-proxy-config major:0 minor:414 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f1241d10-9647-4075-9091-19183e105d50/volumes/kubernetes.io~secret/telemeter-client-tls:{mountpoint:/var/lib/kubelet/pods/f1241d10-9647-4075-9091-19183e105d50/volumes/kubernetes.io~secret/telemeter-client-tls major:0 minor:416 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f5da7c0e-2db7-48fd-ac10-bccc095ef79e/volumes/kubernetes.io~projected/kube-api-access-z65ln:{mountpoint:/var/lib/kubelet/pods/f5da7c0e-2db7-48fd-ac10-bccc095ef79e/volumes/kubernetes.io~projected/kube-api-access-z65ln major:0 minor:375 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f5da7c0e-2db7-48fd-ac10-bccc095ef79e/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/f5da7c0e-2db7-48fd-ac10-bccc095ef79e/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:371 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f5da7c0e-2db7-48fd-ac10-bccc095ef79e/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/f5da7c0e-2db7-48fd-ac10-bccc095ef79e/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy major:0 minor:372 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f5da7c0e-2db7-48fd-ac10-bccc095ef79e/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics:{mountpoint:/var/lib/kubelet/pods/f5da7c0e-2db7-48fd-ac10-bccc095ef79e/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics major:0 minor:370 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f5da7c0e-2db7-48fd-ac10-bccc095ef79e/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules:{mountpoint:/var/lib/kubelet/pods/f5da7c0e-2db7-48fd-ac10-bccc095ef79e/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules major:0 minor:368 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f5da7c0e-2db7-48fd-ac10-bccc095ef79e/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/f5da7c0e-2db7-48fd-ac10-bccc095ef79e/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web major:0 minor:369 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f5da7c0e-2db7-48fd-ac10-bccc095ef79e/volumes/kubernetes.io~secret/secret-thanos-querier-tls:{mountpoint:/var/lib/kubelet/pods/f5da7c0e-2db7-48fd-ac10-bccc095ef79e/volumes/kubernetes.io~secret/secret-thanos-querier-tls major:0 minor:367 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/2f93fd07dc3a91348e20b31b1afe05a4ca4d83ab8b829ebd6deb2304e73072f9/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/2cceb32bd4acff1a53943eb37d14799a56eda5afef748e10f24ee9e6610a97f3/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/1d1ba28fb1601e85198849234ec9658e43046efce77056a79435744c3623ce60/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-109:{mountpoint:/var/lib/containers/storage/overlay/de099b8df43c9068020eaad759444504a49f019021f21f51903e9e879de439b7/merged major:0 minor:109 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/bec88547cf8e10677d99ceef84492005c51a7b6be423e1cfa07409422c70dba5/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/a770d3b4d05d97438e7baf86cd424c5d6733f29c1e136069fe20704ba37be35d/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/706aa62ab78edfab4421c72b2310636964ad05c96eee997d783e96970c3ec8ca/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/60b8db13642b121e00fe625141304cdc39162d52815c9777f0cc01bdb64a0dc8/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-131:{mountpoint:/var/lib/containers/storage/overlay/a406a0df964dd25d47eeba1e7a9fe0f88e1b9b92b9f719ff31c889e2928e2508/merged major:0 minor:131 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/61a0a54a72ad467afcc89f5e5d426e2634cc4df6609b0905e223c0b27b073c0b/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/8b9ec1414798d79b27014197aff8a2d81add23f52a6ec80963a4f1eddd3dc5b6/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-147:{mountpoint:/var/lib/containers/storage/overlay/3af06533f2a11d0f5f16975d1ca3f3b049775b971d783f5f3a91c0db7d9f759d/merged major:0 minor:147 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/da8f7ed06676150bcdc7b249f9ff740e798f8892e30e31aecc09e9ee71e0e3b8/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/daeb71ce5716e2bd7d455ccde4f58393f1444816b1a04facc9687bfc1d3730cf/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/ce2bdf087c78c6d43350650e9d1cf4b536a98347d01f4421dc4d4d21ab7ff3c6/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/282fb7f21103e4ebe93b946cd2b8184ad5d6280b0b2de44d37e369da62b65b92/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/e86b41e023c469bd61cdcaceaafa4756e56b50e5ed0b00e12e7fbc667c420261/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/61c41df84dacc7298003f0669c532ff94d3b5fd405d5fea753a988ffaf19166b/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/6e2625456dff81a8af1be68e6ca219f638b6aff136bfe4d83ddb2c5b5cf6f814/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/09a2628828c104647cd12691fa558bcd6ad05bf7d3f94d5273f248da1f5ef88d/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/ab7e5f432bfd7ac6681fe7af1e681b2359a45ca05942ed46113cca5815c430d8/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-211:{mountpoint:/var/lib/containers/storage/overlay/1a2c1b7d4e855814647525e10666275efa068c57b5caf20ca6d578e592c7d82a/merged major:0 minor:211 fsType:overlay blockSize:0} overlay_0-213:{mountpoint:/var/lib/containers/storage/overlay/e787f0b0a673adc3ad69f64b41fc1acf3c6b5aa7d297d7d7edb19f2227ed7e0d/merged major:0 minor:213 fsType:overlay blockSize:0} overlay_0-215:{mountpoint:/var/lib/containers/storage/overlay/83945f2827c0509f9f2f143560530fb13c0a6588a3dff7eaf04108c1f015efb4/merged major:0 minor:215 fsType:overlay blockSize:0} overlay_0-217:{mountpoint:/var/lib/containers/storage/overlay/29ba6ef0a3ebff2170c3636ec3426a27fc0681d3555f5e71e7cb92ff2b325c73/merged major:0 minor:217 fsType:overlay blockSize:0} overlay_0-226:{mountpoint:/var/lib/containers/storage/overlay/d09bfac8878bbbb44e29a9b9b66b20b31c61231c216cb80912ec43df0a45d198/merged major:0 minor:226 fsType:overlay blockSize:0} overlay_0-228:{mountpoint:/var/lib/containers/storage/overlay/ce7efa59d7d3cd254a6ce6cfd7cdcb188e0eae769026dac61f2cdb94d3be8014/merged major:0 minor:228 fsType:overlay blockSize:0} overlay_0-233:{mountpoint:/var/lib/containers/storage/overlay/37b492004df6efce84efe7471f21b18fa3ec6a9ab0f76dd4651be8201b4304c7/merged major:0 minor:233 fsType:overlay blockSize:0} overlay_0-235:{mountpoint:/var/lib/containers/storage/overlay/895b1b11874444c347822bcd2534611f84fa47addd6bd7feeeddc71d95a2367e/merged major:0 minor:235 fsType:overlay blockSize:0} overlay_0-241:{mountpoint:/var/lib/containers/storage/overlay/3ec89f1c43db866adce9d76e4adc8a7e8544b0ddbb9db3c8d36eefb5a1c8b971/merged major:0 minor:241 fsType:overlay blockSize:0} overlay_0-246:{mountpoint:/var/lib/containers/storage/overlay/73bbf2dabcef99713bbd50f919f1719eceb95f9900b8be040958589760fecb59/merged major:0 minor:246 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/65cc4acb8f1caf88e63325d489a2d22412126bfe44266bac4b37cb30454e1ba3/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-266:{mountpoint:/var/lib/containers/storage/overlay/297c0bb8a11c7b99a9b1c703aa047c7538248b96217d09e0763a485947e3db78/merged major:0 minor:266 fsType:overlay blockSize:0} overlay_0-268:{mountpoint:/var/lib/containers/storage/overlay/880e0e666b19377c103a62215d967a91b76491c058aebd7c6ad9995a48c264e1/merged major:0 minor:268 fsType:overlay blockSize:0} overlay_0-270:{mountpoint:/var/lib/containers/storage/overlay/7912385941d509b2bf273185b2338982466c03c9b362ec412983ba60e2b6fc5a/merged major:0 minor:270 fsType:overlay blockSize:0} overlay_0-286:{mountpoint:/var/lib/containers/storage/overlay/a0da94364647e1efdd9ddf53df32b08209e5958d51f06b9b159b5c56506f5024/merged major:0 minor:286 fsType:overlay blockSize:0} overlay_0-301:{mountpoint:/var/lib/containers/storage/overlay/e7514ad93194f03b786b9c9217df90d0aa6b585173a0879f38b0fac73e09cbb5/merged major:0 minor:301 fsType:overlay blockSize:0} overlay_0-303:{mountpoint:/var/lib/containers/storage/overlay/e064dfceedda26bbfa0aeb1beed338995a7074d1a35514c1f76f9da8b4875bd1/merged major:0 minor:303 fsType:overlay blockSize:0} overlay_0-305:{mountpoint:/var/lib/containers/storage/overlay/2a4da8947679eadab25bfd3d9af9c4ed22e4d814396dc7e533946296ca85c9ef/merged major:0 minor:305 fsType:overlay blockSize:0} overlay_0-307:{mountpoint:/var/lib/containers/storage/overlay/a251f87db7c94b2499a988d68a6e2f057be415716df40a563c046dfe5321c10e/merged major:0 minor:307 fsType:overlay blockSize:0} overlay_0-317:{mountpoint:/var/lib/containers/storage/overlay/4d03a2090f3cd1e42ac55bc0073bbc3b5ccea908a95c818046baec744004986b/merged major:0 minor:317 fsType:overlay blockSize:0} overlay_0-324:{mountpoint:/var/lib/containers/storage/overlay/2c90aba8109f606bacdc16e908cf3c50c463d2a4dbbc7d01cade9dec07310a02/merged major:0 minor:324 fsType:overlay blockSize:0} overlay_0-329:{mountpoint:/var/lib/containers/storage/overlay/33bfbe2abd0c8e5c62652417168b3a38868193fb916403889320b08e2b9bf11a/merged major:0 minor:329 fsType:overlay blockSize:0} overlay_0-333:{mountpoint:/var/lib/containers/storage/overlay/51086d01ecc3853a08be859023f75666233c56e6571a53284c79d52428198ae6/merged major:0 minor:333 fsType:overlay blockSize:0} overlay_0-336:{mountpoint:/var/lib/containers/storage/overlay/8ffa8934b9155342dce5d2567bf68d10963b2fe5c37001f732eb6256da947b6a/merged major:0 minor:336 fsType:overlay blockSize:0} overlay_0-350:{mountpoint:/var/lib/containers/storage/overlay/a3bba54f3bcc78044d123f081fdd67237b11fcdc50ba83f83b5de8591c08038c/merged major:0 minor:350 fsType:overlay blockSize:0} overlay_0-353:{mountpoint:/var/lib/containers/storage/overlay/91cf4fb5081a146f10ee47a9be43dafa4e1f88ffc5458cf9cea70c770826271a/merged major:0 minor:353 fsType:overlay blockSize:0} overlay_0-360:{mountpoint:/var/lib/containers/storage/overlay/a7dd837303dc24fb691bc926987f7f218e4f1123ac6762e9f4dcb9825043e4ec/merged major:0 minor:360 fsType:overlay blockSize:0} overlay_0-362:{mountpoint:/var/lib/containers/storage/overlay/faadae1c7bce7f07d8b596e955d465f534878f2058233004a9b1b743855a496c/merged major:0 minor:362 fsType:overlay blockSize:0} overlay_0-374:{mountpoint:/var/lib/containers/storage/overlay/bfbe9453649bb5118dd80c6333f2997fbccd3e536504dec3d1fbfcab4216f22a/merged major:0 minor:374 fsType:overlay blockSize:0} overlay_0-382:{mountpoint:/var/lib/containers/storage/overlay/7b3f3f1df0d6205f6bce17deec682f1c275630b62ef19cee09aefaabe2813d44/merged major:0 minor:382 fsType:overlay blockSize:0} overlay_0-387:{mountpoint:/var/lib/containers/storage/overlay/e92c66842161062bf248bed260d13f206010d94a0b2920633cde4482f0bcea9d/merged major:0 minor:387 fsType:overlay blockSize:0} overlay_0-389:{mountpoint:/var/lib/containers/storage/overlay/f48253369c09fa48824a73d39e9a9295811ef6e08a5e6f710b18f626cfc30358/merged major:0 minor:389 fsType:overlay blockSize:0} overlay_0-391:{mountpoint:/var/lib/containers/storage/overlay/1bcb35ad7da9c233156f2f2b194e375ea2dba157a430c3bc370966c28a7c2366/merged major:0 minor:391 fsType:overlay blockSize:0} overlay_0-401:{mountpoint:/var/lib/containers/storage/overlay/f2652645d23e30df2b972abb852901da5e5c98c75b7dd546e571e0e7deb61ed3/merged major:0 minor:401 fsType:overlay blockSize:0} overlay_0-412:{mountpoint:/var/lib/containers/storage/overlay/75d035f6068ded7e438bccac498dbb243e640e8d840cb8aef5f1ef8c952dbcd6/merged major:0 minor:412 fsType:overlay blockSize:0} overlay_0-421:{mountpoint:/var/lib/containers/storage/overlay/83ad8d185c6d036b59d6df83c98eee55a046d891564febfd2d1b3a9ab929e0d3/merged major:0 minor:421 fsType:overlay blockSize:0} overlay_0-423:{mountpoint:/var/lib/containers/storage/overlay/3011aa64ef67894c849dda7dd2864fba6a44dc12a5e450f94920d148e0887135/merged major:0 minor:423 fsType:overlay blockSize:0} overlay_0-425:{mountpoint:/var/lib/containers/storage/overlay/a50013989f56ade75f5e51d4015517b79e8303b2c8a5d97933cd6cd7e4c40881/merged major:0 minor:425 fsType:overlay blockSize:0} overlay_0-431:{mountpoint:/var/lib/containers/storage/overlay/4ed54f6d4d6e26a27d05f3e4de018f40fc5a5a4068e605ffcc0fc41fed84b016/merged major:0 minor:431 fsType:overlay blockSize:0} overlay_0-436:{mountpoint:/var/lib/containers/storage/overlay/2ed2e1a42b77d1f698fc8c816d6ce80220ec56635cdd2fbe3547d21459b18c9d/merged major:0 minor:436 fsType:overlay blockSize:0} overlay_0-441:{mountpoint:/var/lib/containers/storage/overlay/b63cd03badfbfdea3f10806a864ff33b82e63e76756dbd50870f90dac6215a8f/merged major:0 minor:441 fsType:overlay blockSize:0} overlay_0-447:{mountpoint:/var/lib/containers/storage/overlay/a1e551c82d6eff267329a1cc388339444d2764ccd00465cdd2a078a6bb8e15fb/merged major:0 minor:447 fsType:overlay blockSize:0} overlay_0-452:{mountpoint:/var/lib/containers/storage/overlay/6ab03603ac60a585697238d2f800c24e21e31b9f3175cab91a22762f3cf93d5c/merged major:0 minor:452 fsType:overlay blockSize:0} overlay_0-454:{mountpoint:/var/lib/containers/storage/overlay/c84e2d2576675d8a7d8d1d48be033d87258c2db9e2440aad4df56039afd0efb9/merged major:0 minor:454 fsType:overlay blockSize:0} overlay_0-463:{mountpoint:/var/lib/containers/storage/overlay/ac94a8877d685321a3a7ba1aad2ec36a3ef30be0ef7ff4e239af8ce56f35fe94/merged major:0 minor:463 fsType:overlay blockSize:0} overlay_0-468:{mountpoint:/var/lib/containers/storage/overlay/010860d4e5696c06f003eeb1ffd1362f335288bd770393c4c3802d4f9fa4859e/merged major:0 minor:468 fsType:overlay blockSize:0} overlay_0-473:{mountpoint:/var/lib/containers/storage/overlay/1528b0575d851e2a419c6dd24a7de98665da9fd9ebf148f63ae52f0dfcac5147/merged major:0 minor:473 fsType:overlay blockSize:0} overlay_0-475:{mountpoint:/var/lib/containers/storage/overlay/76aba73e64d262394574882c8ee38686f439f1f365ec2aba2be95c44be7bbf18/merged major:0 minor:475 fsType:overlay blockSize:0} overlay_0-484:{mountpoint:/var/lib/containers/storage/overlay/5e3045bd7642457b9a1c3d87bb91463fcd4d422c9275a9f7f29b5e8d3aa8e1b6/merged major:0 minor:484 fsType:overlay blockSize:0} overlay_0-489:{mountpoint:/var/lib/containers/storage/overlay/551885ed3ffec8d97588c9b2b0ff7a3c775eaa4ebbf587c375f93fdf372078c6/merged major:0 minor:489 fsType:overlay blockSize:0} overlay_0-494:{mountpoint:/var/lib/containers/storage/overlay/a872f779e335091a6eb9b7922bcee0c7b6cecd7181f452d400d752a1bf6c72fa/merged major:0 minor:494 fsType:overlay blockSize:0} overlay_0-499:{mountpoint:/var/lib/containers/storage/overlay/721ef24884ec18a80e57ba055ce50797b3ed5058727350b67ce15d04c5115a25/merged major:0 minor:499 fsType:overlay blockSize:0} overlay_0-505:{mountpoint:/var/lib/containers/storage/overlay/0ad7c394daa989dfba0217bb63988df237802c106cadf21e77c8e79f33f19366/merged major:0 minor:505 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/7af6635070e32199cd61b7257dd31a19df9d2861ba8538de6ac79c3058f6af18/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-510:{mountpoint:/var/lib/containers/storage/overlay/a5b3c4fb177f496eef2d6a6b0d32d34c203da0e1f525fe22fe193b13719f48b3/merged major:0 minor:510 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/a977bb2d1e7f5b875519beb32b3967b7525cd80fd8a53a3490c26a4112cfdf8d/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-71:{mountpoint:/var/lib/containers/storage/overlay/93a165f36acd7e91bf02f658aeb0ae3bd53607dda2bf9348d1c7b96991403759/merged major:0 minor:71 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/ba68b6adf3b5a3ee9c1ebbd95b5da948659eddda2644adfc343ab3d18fe725e9/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/e40369fb622685f63eb5fffa4ad89d204c02360b4c96ecca36df942d6e3ebad8/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-81:{mountpoint:/var/lib/containers/storage/overlay/747ff7112396b188422c086efbd72bff37d6c0723ca320ada647255557aba7fd/merged major:0 minor:81 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/368b4fa9e0b54b134498ac31f2035a19b88f345fbe438b08616cbb093b475e5b/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/6770604a2d29322a391d4e867892e3ee504f725c6b0c9192561666ff0a2f1072/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/a301a0fa64f34f999b60ab34eb1c6be681b1a281be535a4b9286eb22b94e2d08/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-97:{mountpoint:/var/lib/containers/storage/overlay/423c23cf138739037757d0154c7231e85c646c9d11447d8c9e0928c9489e685b/merged major:0 minor:97 fsType:overlay blockSize:0}] Nov 03 20:01:30.502132 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.501667 5857 manager.go:217] Machine: {Timestamp:2026-11-03 20:01:30.501090571 +0000 UTC m=+0.067980728 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102172 MemoryCapacity:32812015616 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec245ddc95d37a0f4360bcdf65533234 SystemUUID:ec245ddc-95d3-7a0f-4360-bcdf65533234 BootID:78a55a2e-ac34-4873-ae49-586768f24217 Filesystems:[{Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/999ebe89-05a8-4bae-ba5b-b756dd69b073/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:197 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/f5da7c0e-2db7-48fd-ac10-bccc095ef79e/volumes/kubernetes.io~projected/kube-api-access-z65ln DeviceMajor:0 DeviceMinor:375 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-494 DeviceMajor:0 DeviceMinor:494 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7acfd1d0-46c5-4c12-a419-597cc58d88f1/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:201 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/bd8a2436-4362-4c11-9e4b-9e20b73094e6/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:290 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/bb581d67b2b27a04a236ff64b2f71ebbdabf9c413b792e369aaff7d991e14c4e/userdata/shm DeviceMajor:0 DeviceMinor:297 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-374 DeviceMajor:0 DeviceMinor:374 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-389 DeviceMajor:0 DeviceMinor:389 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7d208722eb470db1c9341fa7767eb1673c9c260587b9b8a448828888a3ac8d92/userdata/shm DeviceMajor:0 DeviceMinor:322 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volume-subpaths/web-config/config-reloader/6 DeviceMajor:0 DeviceMinor:342 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2f19ee96e0cda5bba4e76a755fc521e9115b493710767b7674583d6b887d66c4/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-131 DeviceMajor:0 DeviceMinor:131 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:45 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:343 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb/volumes/kubernetes.io~projected/kube-api-access-fsxkj DeviceMajor:0 DeviceMinor:58 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/eb01d4b7-2af5-4493-af2c-8d90a120851f/volumes/kubernetes.io~projected/kube-api-access-shsdx DeviceMajor:0 DeviceMinor:296 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/79a12079c959238bd59f3eadb4bb47806725e75ff362bb2e7df5fae97177757d/userdata/shm DeviceMajor:0 DeviceMinor:321 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-324 DeviceMajor:0 DeviceMinor:324 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/97c9b81f31810c9510cb064f7bf6b901b40808abef6a684b99accaea77411965/userdata/shm DeviceMajor:0 DeviceMinor:355 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/f1241d10-9647-4075-9091-19183e105d50/volumes/kubernetes.io~secret/telemeter-client-tls DeviceMajor:0 DeviceMinor:416 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/ccbc5713-cd4c-455b-9162-f4ecfedde1f7/volumes/kubernetes.io~projected/kube-api-access-ddnm7 DeviceMajor:0 DeviceMinor:63 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a50278cd6c9777df22e5b3d318fe96b833221b657b96777c122692df98859471/userdata/shm DeviceMajor:0 DeviceMinor:209 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-213 DeviceMajor:0 DeviceMinor:213 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/62a2d16f-a781-4b20-ae3e-323c123f9ac0/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:257 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/0e720aa2-db14-40f6-b905-0155bcbd7809/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:280 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:346 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879/volumes/kubernetes.io~projected/kube-api-access-dlv6z DeviceMajor:0 DeviceMinor:64 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0ae94da46971ce3c29e7ed8d62153bb16c9a5a0d14353bfcef6a7eb1c62b5d33/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-350 DeviceMajor:0 DeviceMinor:350 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-362 DeviceMajor:0 DeviceMinor:362 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/88bc9c95b6c532a38daf4d42bfb0fb5f51c852a295b1fef6fcb5dc13a3e2d7a1/userdata/shm DeviceMajor:0 DeviceMinor:419 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/84404c7a-cc47-4e08-861b-a3b417f17e18/volumes/kubernetes.io~projected/kube-api-access-jpcs7 DeviceMajor:0 DeviceMinor:67 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a9289d02c31995256882e2a388053ffdd6432b45cd4ad2186b61eedcd7853105/userdata/shm DeviceMajor:0 DeviceMinor:80 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-301 DeviceMajor:0 DeviceMinor:301 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-412 DeviceMajor:0 DeviceMinor:412 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-217 DeviceMajor:0 DeviceMinor:217 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-228 DeviceMajor:0 DeviceMinor:228 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/629f3d2fd9e832092d3193bf3273444080ab8b0c9327e6bd5d83f1918e237325/userdata/shm DeviceMajor:0 DeviceMinor:327 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy DeviceMajor:0 DeviceMinor:344 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-391 DeviceMajor:0 DeviceMinor:391 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7acfd1d0-46c5-4c12-a419-597cc58d88f1/volumes/kubernetes.io~projected/kube-api-access-nqz58 DeviceMajor:0 DeviceMinor:203 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/0e720aa2-db14-40f6-b905-0155bcbd7809/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:276 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/dae873b182bfc3f60b97f7ceda8c99d20aaf214f33b455ff90891105abf47ddb/userdata/shm DeviceMajor:0 DeviceMinor:292 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volumes/kubernetes.io~projected/kube-api-access-5jjfg DeviceMajor:0 DeviceMinor:352 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-382 DeviceMajor:0 DeviceMinor:382 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-431 DeviceMajor:0 DeviceMinor:431 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volume-subpaths/web-config/alertmanager/9 DeviceMajor:0 DeviceMinor:342 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-454 DeviceMajor:0 DeviceMinor:454 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e95e79534ee3bdcb9b3e17d9e55af8360d35af5b5b2313ad46ad4b8097896fe4/userdata/shm DeviceMajor:0 DeviceMinor:205 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-235 DeviceMajor:0 DeviceMinor:235 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2e62244c4b8d4f787091f14f1780b2d2571c5607d819f1e1d8e4b1cedeeb7604/userdata/shm DeviceMajor:0 DeviceMinor:264 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/960e81d3-4bff-4a35-b6a8-edcd186c6c44/volumes/kubernetes.io~secret/openshift-state-metrics-tls DeviceMajor:0 DeviceMinor:284 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volumes/kubernetes.io~secret/secret-alertmanager-main-tls DeviceMajor:0 DeviceMinor:347 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric DeviceMajor:0 DeviceMinor:348 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:62 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/bd6d9915d98b8ce879c7cc7cd16af82e1e828908695d1c5f96202a84267efc28/userdata/shm DeviceMajor:0 DeviceMinor:95 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a0fbad3549f5a9ee433e12d0ecb908c828d95b925fe17e43123d72f87a9485db/userdata/shm DeviceMajor:0 DeviceMinor:282 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2/volumes/kubernetes.io~projected/kube-api-access-rsbqv DeviceMajor:0 DeviceMinor:320 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/4dbfce43-ac06-4413-92eb-f123614df91d/volumes/kubernetes.io~secret/secret-metrics-server-client-certs DeviceMajor:0 DeviceMinor:402 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8e0075cb87635dee2539a8fb45f72d488ad43efd1245dd21b15f0eff57019d6b/userdata/shm DeviceMajor:0 DeviceMinor:406 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/f1241d10-9647-4075-9091-19183e105d50/volumes/kubernetes.io~secret/federate-client-tls DeviceMajor:0 DeviceMinor:417 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-425 DeviceMajor:0 DeviceMinor:425 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3/volumes/kubernetes.io~projected/kube-api-access-9p6cc DeviceMajor:0 DeviceMinor:59 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a64e3913a245391683e541997e9ccd6fce59cc1d433f712fe9760c80e43c6b24/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-305 DeviceMajor:0 DeviceMinor:305 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-452 DeviceMajor:0 DeviceMinor:452 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-499 DeviceMajor:0 DeviceMinor:499 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-505 DeviceMajor:0 DeviceMinor:505 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-71 DeviceMajor:0 DeviceMinor:71 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4dbfce43-ac06-4413-92eb-f123614df91d/volumes/kubernetes.io~projected/kube-api-access-r74cx DeviceMajor:0 DeviceMinor:397 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-441 DeviceMajor:0 DeviceMinor:441 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0f0a289384e847e54564988a7badfa37668e875ad3d223b7c6f82a463975189f/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-353 DeviceMajor:0 DeviceMinor:353 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-468 DeviceMajor:0 DeviceMinor:468 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e1f881937bcaa543868f89113eb36d94c46458b2359d92515242d24ed9a35c17/userdata/shm DeviceMajor:0 DeviceMinor:89 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/960e81d3-4bff-4a35-b6a8-edcd186c6c44/volumes/kubernetes.io~projected/kube-api-access-jpqvp DeviceMajor:0 DeviceMinor:288 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-303 DeviceMajor:0 DeviceMinor:303 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-336 DeviceMajor:0 DeviceMinor:336 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-233 DeviceMajor:0 DeviceMinor:233 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-270 DeviceMajor:0 DeviceMinor:270 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0e720aa2-db14-40f6-b905-0155bcbd7809/volumes/kubernetes.io~projected/kube-api-access-6sj4s DeviceMajor:0 DeviceMinor:281 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-387 DeviceMajor:0 DeviceMinor:387 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-421 DeviceMajor:0 DeviceMinor:421 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-241 DeviceMajor:0 DeviceMinor:241 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-286 DeviceMajor:0 DeviceMinor:286 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-333 DeviceMajor:0 DeviceMinor:333 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f5da7c0e-2db7-48fd-ac10-bccc095ef79e/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics DeviceMajor:0 DeviceMinor:370 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/f1241d10-9647-4075-9091-19183e105d50/volumes/kubernetes.io~secret/secret-telemeter-client DeviceMajor:0 DeviceMinor:415 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/aae6331f-1f9f-43c8-9610-f554ddebf2e3/volumes/kubernetes.io~projected/kube-api-access-nwhj2 DeviceMajor:0 DeviceMinor:60 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1/volumes/kubernetes.io~projected/kube-api-access-d9272 DeviceMajor:0 DeviceMinor:66 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/30329c02-c760-48d5-86f7-dd265325adb0/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:313 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-436 DeviceMajor:0 DeviceMinor:436 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-447 DeviceMajor:0 DeviceMinor:447 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-215 DeviceMajor:0 DeviceMinor:215 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volumes/kubernetes.io~secret/cluster-tls-config DeviceMajor:0 DeviceMinor:345 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/62a2d16f-a781-4b20-ae3e-323c123f9ac0/volumes/kubernetes.io~secret/prometheus-operator-tls DeviceMajor:0 DeviceMinor:262 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/62a2d16f-a781-4b20-ae3e-323c123f9ac0/volumes/kubernetes.io~projected/kube-api-access-f7l96 DeviceMajor:0 DeviceMinor:263 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-268 DeviceMajor:0 DeviceMinor:268 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:342 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/f5da7c0e-2db7-48fd-ac10-bccc095ef79e/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules DeviceMajor:0 DeviceMinor:368 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d81772f20883761e0d12e5b34bf9bdd2362d6f328a86c68296e817b4d0ecc036/userdata/shm DeviceMajor:0 DeviceMinor:380 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:55 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/98448491-e429-4d6f-a50a-7cb104997edf/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:56 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0c479f18-0308-403a-adf1-42575f8adfa2/volumes/kubernetes.io~secret/tls-certificates DeviceMajor:0 DeviceMinor:219 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/aae6331f-1f9f-43c8-9610-f554ddebf2e3/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:319 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/f5da7c0e-2db7-48fd-ac10-bccc095ef79e/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy DeviceMajor:0 DeviceMinor:372 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/f1241d10-9647-4075-9091-19183e105d50/volumes/kubernetes.io~projected/kube-api-access-r7vcn DeviceMajor:0 DeviceMinor:418 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-463 DeviceMajor:0 DeviceMinor:463 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/19f9860c-9efc-4678-8c1e-393c723b4611/volumes/kubernetes.io~projected/kube-api-access-wc8z5 DeviceMajor:0 DeviceMinor:65 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-81 DeviceMajor:0 DeviceMinor:81 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/bd8a2436-4362-4c11-9e4b-9e20b73094e6/volumes/kubernetes.io~secret/kube-state-metrics-tls DeviceMajor:0 DeviceMinor:289 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-329 DeviceMajor:0 DeviceMinor:329 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:349 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/f5da7c0e-2db7-48fd-ac10-bccc095ef79e/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:369 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-510 DeviceMajor:0 DeviceMinor:510 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9e2aa1c197055a6648b15a76bb70227f6f64f6edfd0b33c3dd7293eeca740aa6/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-246 DeviceMajor:0 DeviceMinor:246 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-307 DeviceMajor:0 DeviceMinor:307 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4dbfce43-ac06-4413-92eb-f123614df91d/volumes/kubernetes.io~secret/client-ca-bundle DeviceMajor:0 DeviceMinor:403 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-147 DeviceMajor:0 DeviceMinor:147 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-266 DeviceMajor:0 DeviceMinor:266 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-360 DeviceMajor:0 DeviceMinor:360 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-423 DeviceMajor:0 DeviceMinor:423 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-489 DeviceMajor:0 DeviceMinor:489 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/eb01d4b7-2af5-4493-af2c-8d90a120851f/volumes/kubernetes.io~secret/node-exporter-tls DeviceMajor:0 DeviceMinor:295 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7adef30e25b1d1a6858159dabdbd1786206e26ef92977685375acffd3caa2053/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-109 DeviceMajor:0 DeviceMinor:109 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9/volumes/kubernetes.io~projected/kube-api-access-jjlrv DeviceMajor:0 DeviceMinor:204 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d5f9d4a516c2641c72f78d01228d85b5ac97190650053ad91869207f58b72259/userdata/shm DeviceMajor:0 DeviceMinor:207 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volumes/kubernetes.io~secret/config-volume DeviceMajor:0 DeviceMinor:338 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-473 DeviceMajor:0 DeviceMinor:473 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406007808 Type:vfs Inodes:1048576 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f5da7c0e-2db7-48fd-ac10-bccc095ef79e/volumes/kubernetes.io~secret/secret-thanos-querier-tls DeviceMajor:0 DeviceMinor:367 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/f5da7c0e-2db7-48fd-ac10-bccc095ef79e/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:371 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a445b335-dfaf-41a2-afb5-e9ee45ec471f/volumes/kubernetes.io~projected/kube-api-access-t7rwr DeviceMajor:0 DeviceMinor:57 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a6944b1f2d00e498ad7cb060325ecc52f29922dde9e0a0add0f38e424d92427e/userdata/shm DeviceMajor:0 DeviceMinor:224 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volume-subpaths/web-config/init-config-reloader/6 DeviceMajor:0 DeviceMinor:342 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:61 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/999ebe89-05a8-4bae-ba5b-b756dd69b073/volumes/kubernetes.io~projected/kube-api-access-77q8n DeviceMajor:0 DeviceMinor:202 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/960e81d3-4bff-4a35-b6a8-edcd186c6c44/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:285 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/eb01d4b7-2af5-4493-af2c-8d90a120851f/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:294 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volume-subpaths/cluster-tls-config/alertmanager/10 DeviceMajor:0 DeviceMinor:345 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-484 DeviceMajor:0 DeviceMinor:484 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d458e523b958bfc654cb0d4513a78242e0f96447453153b462882c3b477ee3f3/userdata/shm DeviceMajor:0 DeviceMinor:70 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-226 DeviceMajor:0 DeviceMinor:226 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/bd8a2436-4362-4c11-9e4b-9e20b73094e6/volumes/kubernetes.io~projected/kube-api-access-9zr4p DeviceMajor:0 DeviceMinor:291 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/bad22f822ef6f404d989cca09a5f8f90d8905bc13e1ec818ba58e3593dcbe504/userdata/shm DeviceMajor:0 DeviceMinor:299 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/4dbfce43-ac06-4413-92eb-f123614df91d/volumes/kubernetes.io~secret/secret-metrics-server-tls DeviceMajor:0 DeviceMinor:404 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-401 DeviceMajor:0 DeviceMinor:401 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-97 DeviceMajor:0 DeviceMinor:97 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-211 DeviceMajor:0 DeviceMinor:211 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-317 DeviceMajor:0 DeviceMinor:317 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f1241d10-9647-4075-9091-19183e105d50/volumes/kubernetes.io~secret/secret-telemeter-client-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:414 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-475 DeviceMajor:0 DeviceMinor:475 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:2e62244c4b8d4f7 MacAddress:1a:16:97:a7:d7:5d Speed:10000 Mtu:8901} {Name:629f3d2fd9e8320 MacAddress:0a:ac:a0:1a:6c:d4 Speed:10000 Mtu:8901} {Name:79a12079c959238 MacAddress:26:b5:ba:c2:9a:3c Speed:10000 Mtu:8901} {Name:7d208722eb470db MacAddress:26:eb:f6:3f:be:17 Speed:10000 Mtu:8901} {Name:88bc9c95b6c532a MacAddress:c6:6f:e5:b0:9c:d9 Speed:10000 Mtu:8901} {Name:8e0075cb87635de MacAddress:96:3b:48:d0:7f:2c Speed:10000 Mtu:8901} {Name:97c9b81f31810c9 MacAddress:5a:77:ae:8f:3f:e0 Speed:10000 Mtu:8901} {Name:a0fbad3549f5a9e MacAddress:0e:df:33:5c:60:59 Speed:10000 Mtu:8901} {Name:a50278cd6c9777d MacAddress:26:10:12:96:1d:c4 Speed:10000 Mtu:8901} {Name:a6944b1f2d00e49 MacAddress:9a:7a:ed:4d:4c:fc Speed:10000 Mtu:8901} {Name:bb581d67b2b27a0 MacAddress:f2:ae:92:48:69:b0 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:03:44:1e:84:67 Speed:0 Mtu:9001} {Name:br-int MacAddress:96:5f:c2:0f:4e:0c Speed:0 Mtu:8901} {Name:d5f9d4a516c2641 MacAddress:f6:f7:7a:1b:56:cd Speed:10000 Mtu:8901} {Name:d81772f20883761 MacAddress:22:ac:bc:96:35:9b Speed:10000 Mtu:8901} {Name:dae873b182bfc3f MacAddress:4e:51:6e:80:63:6d Speed:10000 Mtu:8901} {Name:e95e79534ee3bdc MacAddress:0e:d4:26:8e:fa:71 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:03:44:1e:84:67 Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:6e:8d:77:f0:7e:43 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:86:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:e2:ee:2f:70:dc:af Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812015616 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Nov 03 20:01:30.502132 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.502134 5857 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Nov 03 20:01:30.502477 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.502189 5857 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Nov 03 20:01:30.502522 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.502476 5857 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Nov 03 20:01:30.502677 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.502506 5857 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-181.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Nov 03 20:01:30.502722 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.502679 5857 topology_manager.go:143] "Creating topology manager with none policy" Nov 03 20:01:30.502722 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.502687 5857 container_manager_linux.go:311] "Creating device plugin manager" Nov 03 20:01:30.502722 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.502697 5857 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 03 20:01:30.502722 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.502716 5857 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 03 20:01:30.502866 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.502822 5857 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Nov 03 20:01:30.502994 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.502984 5857 state_mem.go:41] "Initialized" logger="CPUManager state memory" Nov 03 20:01:30.503106 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.503097 5857 server.go:1235] "Using root directory" path="/var/lib/kubelet" Nov 03 20:01:30.503145 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.503133 5857 kubelet.go:493] "Attempting to sync node with API server" Nov 03 20:01:30.503175 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.503146 5857 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Nov 03 20:01:30.503175 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.503157 5857 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Nov 03 20:01:30.503175 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.503165 5857 kubelet.go:405] "Adding apiserver pod source" Nov 03 20:01:30.503175 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.503173 5857 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Nov 03 20:01:30.504100 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.504080 5857 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Nov 03 20:01:30.504100 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.504094 5857 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 03 20:01:30.504727 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.504706 5857 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Nov 03 20:01:30.508492 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.508474 5857 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Nov 03 20:01:30.508492 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.508489 5857 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 03 20:01:30.508672 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.508637 5857 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem" Nov 03 20:01:30.508850 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.508836 5857 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Nov 03 20:01:30.508904 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.508867 5857 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Nov 03 20:01:30.508971 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.508960 5857 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Nov 03 20:01:30.509022 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.508982 5857 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Nov 03 20:01:30.509022 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.508993 5857 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Nov 03 20:01:30.509022 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.509012 5857 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Nov 03 20:01:30.509022 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.509018 5857 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Nov 03 20:01:30.509022 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.509025 5857 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Nov 03 20:01:30.509275 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.509031 5857 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Nov 03 20:01:30.509275 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.509037 5857 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Nov 03 20:01:30.509275 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.509045 5857 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Nov 03 20:01:30.509275 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.509051 5857 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Nov 03 20:01:30.509275 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.509064 5857 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Nov 03 20:01:30.509275 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.509073 5857 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Nov 03 20:01:30.509275 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.509101 5857 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Nov 03 20:01:30.509275 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.509111 5857 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Nov 03 20:01:30.512641 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.512625 5857 server.go:1263] "Started kubelet" Nov 03 20:01:30.512758 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.512705 5857 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Nov 03 20:01:30.513176 ip-10-0-140-181 systemd[1]: Started Kubernetes Kubelet. Nov 03 20:01:30.513463 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.513411 5857 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Nov 03 20:01:30.513545 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.513489 5857 server_v1.go:49] "podresources" method="list" useActivePods=true Nov 03 20:01:30.513815 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.513797 5857 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Nov 03 20:01:30.522098 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.522058 5857 server.go:317] "Adding debug handlers to kubelet server" Nov 03 20:01:30.523991 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.523971 5857 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Nov 03 20:01:30.524095 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.524043 5857 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Nov 03 20:01:30.524160 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.524120 5857 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-02 19:55:19 +0000 UTC" deadline="2028-06-22 16:25:31.212236723 +0000 UTC" Nov 03 20:01:30.524265 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.524161 5857 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14324h24m0.688078853s" Nov 03 20:01:30.524319 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.524295 5857 volume_manager.go:309] "The desired_state_of_world populator starts" Nov 03 20:01:30.524319 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.524312 5857 volume_manager.go:311] "Starting Kubelet Volume Manager" Nov 03 20:01:30.524425 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.524412 5857 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Nov 03 20:01:30.525022 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:01:30.524843 5857 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-181.us-west-1.compute.internal\" not found" Nov 03 20:01:30.527778 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.526666 5857 factory.go:55] Registering systemd factory Nov 03 20:01:30.527778 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.526691 5857 factory.go:223] Registration of the systemd container factory successfully Nov 03 20:01:30.527778 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.527673 5857 factory.go:153] Registering CRI-O factory Nov 03 20:01:30.527778 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.527687 5857 factory.go:223] Registration of the crio container factory successfully Nov 03 20:01:30.527778 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.527734 5857 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Nov 03 20:01:30.528059 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.527736 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="62a2d16f-a781-4b20-ae3e-323c123f9ac0" volumeName="kubernetes.io/configmap/62a2d16f-a781-4b20-ae3e-323c123f9ac0-metrics-client-ca" seLinuxMountContext="" Nov 03 20:01:30.528059 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.527808 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7acfd1d0-46c5-4c12-a419-597cc58d88f1" volumeName="kubernetes.io/configmap/7acfd1d0-46c5-4c12-a419-597cc58d88f1-config-volume" seLinuxMountContext="" Nov 03 20:01:30.528059 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.527828 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="999ebe89-05a8-4bae-ba5b-b756dd69b073" volumeName="kubernetes.io/projected/999ebe89-05a8-4bae-ba5b-b756dd69b073-kube-api-access-77q8n" seLinuxMountContext="" Nov 03 20:01:30.528059 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.527842 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0e720aa2-db14-40f6-b905-0155bcbd7809" volumeName="kubernetes.io/configmap/0e720aa2-db14-40f6-b905-0155bcbd7809-console-config" seLinuxMountContext="" Nov 03 20:01:30.528059 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.527856 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7acfd1d0-46c5-4c12-a419-597cc58d88f1" volumeName="kubernetes.io/projected/7acfd1d0-46c5-4c12-a419-597cc58d88f1-kube-api-access-nqz58" seLinuxMountContext="" Nov 03 20:01:30.528059 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.527869 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aae6331f-1f9f-43c8-9610-f554ddebf2e3" volumeName="kubernetes.io/projected/aae6331f-1f9f-43c8-9610-f554ddebf2e3-kube-api-access-nwhj2" seLinuxMountContext="" Nov 03 20:01:30.528059 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.527882 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bd8a2436-4362-4c11-9e4b-9e20b73094e6" volumeName="kubernetes.io/configmap/bd8a2436-4362-4c11-9e4b-9e20b73094e6-metrics-client-ca" seLinuxMountContext="" Nov 03 20:01:30.528059 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.527896 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bd8a2436-4362-4c11-9e4b-9e20b73094e6" volumeName="kubernetes.io/secret/bd8a2436-4362-4c11-9e4b-9e20b73094e6-kube-state-metrics-tls" seLinuxMountContext="" Nov 03 20:01:30.528059 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.527914 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eb01d4b7-2af5-4493-af2c-8d90a120851f" volumeName="kubernetes.io/projected/eb01d4b7-2af5-4493-af2c-8d90a120851f-kube-api-access-shsdx" seLinuxMountContext="" Nov 03 20:01:30.528059 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.527926 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f1241d10-9647-4075-9091-19183e105d50" volumeName="kubernetes.io/secret/f1241d10-9647-4075-9091-19183e105d50-federate-client-tls" seLinuxMountContext="" Nov 03 20:01:30.528059 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.527940 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0e720aa2-db14-40f6-b905-0155bcbd7809" volumeName="kubernetes.io/secret/0e720aa2-db14-40f6-b905-0155bcbd7809-console-oauth-config" seLinuxMountContext="" Nov 03 20:01:30.528059 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.527953 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3699cbee-ee43-4504-bc3b-c4b3a7efbcbb" volumeName="kubernetes.io/projected/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-kube-api-access-fsxkj" seLinuxMountContext="" Nov 03 20:01:30.528059 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.527966 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3699cbee-ee43-4504-bc3b-c4b3a7efbcbb" volumeName="kubernetes.io/secret/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-ovn-node-metrics-cert" seLinuxMountContext="" Nov 03 20:01:30.528059 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.527981 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="84404c7a-cc47-4e08-861b-a3b417f17e18" volumeName="kubernetes.io/projected/84404c7a-cc47-4e08-861b-a3b417f17e18-kube-api-access-jpcs7" seLinuxMountContext="" Nov 03 20:01:30.528059 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.527997 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bd8a2436-4362-4c11-9e4b-9e20b73094e6" volumeName="kubernetes.io/configmap/bd8a2436-4362-4c11-9e4b-9e20b73094e6-kube-state-metrics-custom-resource-state-configmap" seLinuxMountContext="" Nov 03 20:01:30.528059 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528010 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="98448491-e429-4d6f-a50a-7cb104997edf" volumeName="kubernetes.io/secret/98448491-e429-4d6f-a50a-7cb104997edf-agent-certs" seLinuxMountContext="" Nov 03 20:01:30.528059 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528023 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bd8a2436-4362-4c11-9e4b-9e20b73094e6" volumeName="kubernetes.io/secret/bd8a2436-4362-4c11-9e4b-9e20b73094e6-kube-state-metrics-kube-rbac-proxy-config" seLinuxMountContext="" Nov 03 20:01:30.528059 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528037 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ccbc5713-cd4c-455b-9162-f4ecfedde1f7" volumeName="kubernetes.io/empty-dir/ccbc5713-cd4c-455b-9162-f4ecfedde1f7-tmp-dir" seLinuxMountContext="" Nov 03 20:01:30.528059 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528049 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f1241d10-9647-4075-9091-19183e105d50" volumeName="kubernetes.io/secret/f1241d10-9647-4075-9091-19183e105d50-telemeter-client-tls" seLinuxMountContext="" Nov 03 20:01:30.528059 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528061 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0e720aa2-db14-40f6-b905-0155bcbd7809" volumeName="kubernetes.io/secret/0e720aa2-db14-40f6-b905-0155bcbd7809-console-serving-cert" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528073 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="26c31b1c-c3c5-4676-b71f-f44499e10a3b" volumeName="kubernetes.io/empty-dir/26c31b1c-c3c5-4676-b71f-f44499e10a3b-alertmanager-main-db" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528087 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4dbfce43-ac06-4413-92eb-f123614df91d" volumeName="kubernetes.io/empty-dir/4dbfce43-ac06-4413-92eb-f123614df91d-audit-log" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528102 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="960e81d3-4bff-4a35-b6a8-edcd186c6c44" volumeName="kubernetes.io/secret/960e81d3-4bff-4a35-b6a8-edcd186c6c44-openshift-state-metrics-tls" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528116 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1" volumeName="kubernetes.io/empty-dir/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-tmp" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528128 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f5da7c0e-2db7-48fd-ac10-bccc095ef79e" volumeName="kubernetes.io/projected/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-kube-api-access-z65ln" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528143 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f5da7c0e-2db7-48fd-ac10-bccc095ef79e" volumeName="kubernetes.io/secret/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-secret-thanos-querier-kube-rbac-proxy-web" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528166 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0c479f18-0308-403a-adf1-42575f8adfa2" volumeName="kubernetes.io/secret/0c479f18-0308-403a-adf1-42575f8adfa2-tls-certificates" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528179 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0e720aa2-db14-40f6-b905-0155bcbd7809" volumeName="kubernetes.io/empty-dir/0e720aa2-db14-40f6-b905-0155bcbd7809-tmp" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528197 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="19f9860c-9efc-4678-8c1e-393c723b4611" volumeName="kubernetes.io/configmap/19f9860c-9efc-4678-8c1e-393c723b4611-cni-binary-copy" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.527814 5857 factory.go:103] Registering Raw factory Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528217 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9" volumeName="kubernetes.io/projected/22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9-kube-api-access-jjlrv" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528231 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4dbfce43-ac06-4413-92eb-f123614df91d" volumeName="kubernetes.io/projected/4dbfce43-ac06-4413-92eb-f123614df91d-kube-api-access-r74cx" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528243 5857 manager.go:1199] Started watching for new ooms in manager Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528244 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="999ebe89-05a8-4bae-ba5b-b756dd69b073" volumeName="kubernetes.io/secret/999ebe89-05a8-4bae-ba5b-b756dd69b073-cert" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528256 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a445b335-dfaf-41a2-afb5-e9ee45ec471f" volumeName="kubernetes.io/configmap/a445b335-dfaf-41a2-afb5-e9ee45ec471f-cni-sysctl-allowlist" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528268 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bd8a2436-4362-4c11-9e4b-9e20b73094e6" volumeName="kubernetes.io/empty-dir/bd8a2436-4362-4c11-9e4b-9e20b73094e6-volume-directive-shadow" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528282 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7acfd1d0-46c5-4c12-a419-597cc58d88f1" volumeName="kubernetes.io/empty-dir/7acfd1d0-46c5-4c12-a419-597cc58d88f1-tmp-dir" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528295 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7acfd1d0-46c5-4c12-a419-597cc58d88f1" volumeName="kubernetes.io/secret/7acfd1d0-46c5-4c12-a419-597cc58d88f1-metrics-tls" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528306 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="960e81d3-4bff-4a35-b6a8-edcd186c6c44" volumeName="kubernetes.io/projected/960e81d3-4bff-4a35-b6a8-edcd186c6c44-kube-api-access-jpqvp" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528319 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0e720aa2-db14-40f6-b905-0155bcbd7809" volumeName="kubernetes.io/projected/0e720aa2-db14-40f6-b905-0155bcbd7809-kube-api-access-6sj4s" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528332 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="26c31b1c-c3c5-4676-b71f-f44499e10a3b" volumeName="kubernetes.io/empty-dir/26c31b1c-c3c5-4676-b71f-f44499e10a3b-config-out" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528344 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="62a2d16f-a781-4b20-ae3e-323c123f9ac0" volumeName="kubernetes.io/projected/62a2d16f-a781-4b20-ae3e-323c123f9ac0-kube-api-access-f7l96" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528357 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a445b335-dfaf-41a2-afb5-e9ee45ec471f" volumeName="kubernetes.io/configmap/a445b335-dfaf-41a2-afb5-e9ee45ec471f-cni-binary-copy" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528370 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f1241d10-9647-4075-9091-19183e105d50" volumeName="kubernetes.io/configmap/f1241d10-9647-4075-9091-19183e105d50-telemeter-trusted-ca-bundle" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528382 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="26c31b1c-c3c5-4676-b71f-f44499e10a3b" volumeName="kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-web-config" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528394 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="960e81d3-4bff-4a35-b6a8-edcd186c6c44" volumeName="kubernetes.io/configmap/960e81d3-4bff-4a35-b6a8-edcd186c6c44-metrics-client-ca" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528406 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f5da7c0e-2db7-48fd-ac10-bccc095ef79e" volumeName="kubernetes.io/secret/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-secret-grpc-tls" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528425 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="19f9860c-9efc-4678-8c1e-393c723b4611" volumeName="kubernetes.io/projected/19f9860c-9efc-4678-8c1e-393c723b4611-kube-api-access-wc8z5" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528438 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="26c31b1c-c3c5-4676-b71f-f44499e10a3b" volumeName="kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-config-volume" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528452 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3699cbee-ee43-4504-bc3b-c4b3a7efbcbb" volumeName="kubernetes.io/configmap/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-env-overrides" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528465 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4dbfce43-ac06-4413-92eb-f123614df91d" volumeName="kubernetes.io/secret/4dbfce43-ac06-4413-92eb-f123614df91d-secret-metrics-server-client-certs" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528479 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a445b335-dfaf-41a2-afb5-e9ee45ec471f" volumeName="kubernetes.io/projected/a445b335-dfaf-41a2-afb5-e9ee45ec471f-kube-api-access-t7rwr" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528493 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eb01d4b7-2af5-4493-af2c-8d90a120851f" volumeName="kubernetes.io/empty-dir/eb01d4b7-2af5-4493-af2c-8d90a120851f-node-exporter-textfile" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528507 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f1241d10-9647-4075-9091-19183e105d50" volumeName="kubernetes.io/configmap/f1241d10-9647-4075-9091-19183e105d50-metrics-client-ca" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528521 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f5da7c0e-2db7-48fd-ac10-bccc095ef79e" volumeName="kubernetes.io/configmap/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-metrics-client-ca" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528535 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9" volumeName="kubernetes.io/empty-dir/22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9-data-volume" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528547 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="26c31b1c-c3c5-4676-b71f-f44499e10a3b" volumeName="kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-cluster-tls-config" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528580 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="30329c02-c760-48d5-86f7-dd265325adb0" volumeName="kubernetes.io/secret/30329c02-c760-48d5-86f7-dd265325adb0-original-pull-secret" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528605 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3699cbee-ee43-4504-bc3b-c4b3a7efbcbb" volumeName="kubernetes.io/configmap/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-ovnkube-script-lib" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528618 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4dbfce43-ac06-4413-92eb-f123614df91d" volumeName="kubernetes.io/configmap/4dbfce43-ac06-4413-92eb-f123614df91d-configmap-kubelet-serving-ca-bundle" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528633 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="98448491-e429-4d6f-a50a-7cb104997edf" volumeName="kubernetes.io/configmap/98448491-e429-4d6f-a50a-7cb104997edf-konnectivity-ca" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528647 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aae6331f-1f9f-43c8-9610-f554ddebf2e3" volumeName="kubernetes.io/secret/aae6331f-1f9f-43c8-9610-f554ddebf2e3-metrics-certs" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528659 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1" volumeName="kubernetes.io/empty-dir/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-tuned" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528683 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="26c31b1c-c3c5-4676-b71f-f44499e10a3b" volumeName="kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-kube-rbac-proxy-web" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528696 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0e720aa2-db14-40f6-b905-0155bcbd7809" volumeName="kubernetes.io/configmap/0e720aa2-db14-40f6-b905-0155bcbd7809-oauth-serving-cert" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528710 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9" volumeName="kubernetes.io/secret/22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9-insights-runtime-extractor-tls" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528724 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3" volumeName="kubernetes.io/projected/2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3-kube-api-access-9p6cc" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528737 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4dbfce43-ac06-4413-92eb-f123614df91d" volumeName="kubernetes.io/configmap/4dbfce43-ac06-4413-92eb-f123614df91d-metrics-server-audit-profiles" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528751 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4dbfce43-ac06-4413-92eb-f123614df91d" volumeName="kubernetes.io/secret/4dbfce43-ac06-4413-92eb-f123614df91d-client-ca-bundle" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528763 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="62a2d16f-a781-4b20-ae3e-323c123f9ac0" volumeName="kubernetes.io/secret/62a2d16f-a781-4b20-ae3e-323c123f9ac0-prometheus-operator-kube-rbac-proxy-config" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528776 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f1241d10-9647-4075-9091-19183e105d50" volumeName="kubernetes.io/secret/f1241d10-9647-4075-9091-19183e105d50-secret-telemeter-client-kube-rbac-proxy-config" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528789 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="26c31b1c-c3c5-4676-b71f-f44499e10a3b" volumeName="kubernetes.io/configmap/26c31b1c-c3c5-4676-b71f-f44499e10a3b-metrics-client-ca" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528803 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="26c31b1c-c3c5-4676-b71f-f44499e10a3b" volumeName="kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-kube-rbac-proxy-metric" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528815 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eb01d4b7-2af5-4493-af2c-8d90a120851f" volumeName="kubernetes.io/secret/eb01d4b7-2af5-4493-af2c-8d90a120851f-node-exporter-tls" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528829 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f5da7c0e-2db7-48fd-ac10-bccc095ef79e" volumeName="kubernetes.io/secret/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-secret-thanos-querier-kube-rbac-proxy-rules" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528842 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2" volumeName="kubernetes.io/projected/5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2-kube-api-access-rsbqv" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528854 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="960e81d3-4bff-4a35-b6a8-edcd186c6c44" volumeName="kubernetes.io/secret/960e81d3-4bff-4a35-b6a8-edcd186c6c44-openshift-state-metrics-kube-rbac-proxy-config" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528869 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eb01d4b7-2af5-4493-af2c-8d90a120851f" volumeName="kubernetes.io/configmap/eb01d4b7-2af5-4493-af2c-8d90a120851f-node-exporter-accelerators-collector-config" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528884 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eb01d4b7-2af5-4493-af2c-8d90a120851f" volumeName="kubernetes.io/secret/eb01d4b7-2af5-4493-af2c-8d90a120851f-node-exporter-kube-rbac-proxy-config" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528899 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f1241d10-9647-4075-9091-19183e105d50" volumeName="kubernetes.io/configmap/f1241d10-9647-4075-9091-19183e105d50-serving-certs-ca-bundle" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528913 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f5da7c0e-2db7-48fd-ac10-bccc095ef79e" volumeName="kubernetes.io/secret/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-secret-thanos-querier-tls" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528926 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f5da7c0e-2db7-48fd-ac10-bccc095ef79e" volumeName="kubernetes.io/secret/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-secret-thanos-querier-kube-rbac-proxy" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528938 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="19f9860c-9efc-4678-8c1e-393c723b4611" volumeName="kubernetes.io/configmap/19f9860c-9efc-4678-8c1e-393c723b4611-multus-daemon-config" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528951 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="26c31b1c-c3c5-4676-b71f-f44499e10a3b" volumeName="kubernetes.io/projected/26c31b1c-c3c5-4676-b71f-f44499e10a3b-kube-api-access-5jjfg" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528964 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879" volumeName="kubernetes.io/configmap/b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879-iptables-alerter-script" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528976 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bd8a2436-4362-4c11-9e4b-9e20b73094e6" volumeName="kubernetes.io/projected/bd8a2436-4362-4c11-9e4b-9e20b73094e6-kube-api-access-9zr4p" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.528989 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eb01d4b7-2af5-4493-af2c-8d90a120851f" volumeName="kubernetes.io/configmap/eb01d4b7-2af5-4493-af2c-8d90a120851f-metrics-client-ca" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.529002 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f1241d10-9647-4075-9091-19183e105d50" volumeName="kubernetes.io/secret/f1241d10-9647-4075-9091-19183e105d50-secret-telemeter-client" seLinuxMountContext="" Nov 03 20:01:30.528979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.529014 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="26c31b1c-c3c5-4676-b71f-f44499e10a3b" volumeName="kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-kube-rbac-proxy" seLinuxMountContext="" Nov 03 20:01:30.532474 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.529026 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0e720aa2-db14-40f6-b905-0155bcbd7809" volumeName="kubernetes.io/configmap/0e720aa2-db14-40f6-b905-0155bcbd7809-service-ca" seLinuxMountContext="" Nov 03 20:01:30.532474 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.529040 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9" volumeName="kubernetes.io/configmap/22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9-kube-rbac-proxy-cm" seLinuxMountContext="" Nov 03 20:01:30.532474 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.529057 5857 manager.go:319] Starting recovery of all containers Nov 03 20:01:30.532474 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.529053 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3" volumeName="kubernetes.io/configmap/2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3-serviceca" seLinuxMountContext="" Nov 03 20:01:30.532474 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.531661 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3699cbee-ee43-4504-bc3b-c4b3a7efbcbb" volumeName="kubernetes.io/configmap/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-ovnkube-config" seLinuxMountContext="" Nov 03 20:01:30.532474 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.531691 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a445b335-dfaf-41a2-afb5-e9ee45ec471f" volumeName="kubernetes.io/configmap/a445b335-dfaf-41a2-afb5-e9ee45ec471f-whereabouts-flatfile-configmap" seLinuxMountContext="" Nov 03 20:01:30.532474 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.531706 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ccbc5713-cd4c-455b-9162-f4ecfedde1f7" volumeName="kubernetes.io/projected/ccbc5713-cd4c-455b-9162-f4ecfedde1f7-kube-api-access-ddnm7" seLinuxMountContext="" Nov 03 20:01:30.532474 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.531720 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1" volumeName="kubernetes.io/projected/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-kube-api-access-d9272" seLinuxMountContext="" Nov 03 20:01:30.532474 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.531734 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="26c31b1c-c3c5-4676-b71f-f44499e10a3b" volumeName="kubernetes.io/configmap/26c31b1c-c3c5-4676-b71f-f44499e10a3b-alertmanager-trusted-ca-bundle" seLinuxMountContext="" Nov 03 20:01:30.532474 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.531748 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="26c31b1c-c3c5-4676-b71f-f44499e10a3b" volumeName="kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-main-tls" seLinuxMountContext="" Nov 03 20:01:30.532474 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.531764 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4dbfce43-ac06-4413-92eb-f123614df91d" volumeName="kubernetes.io/secret/4dbfce43-ac06-4413-92eb-f123614df91d-secret-metrics-server-tls" seLinuxMountContext="" Nov 03 20:01:30.532474 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.531778 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="62a2d16f-a781-4b20-ae3e-323c123f9ac0" volumeName="kubernetes.io/secret/62a2d16f-a781-4b20-ae3e-323c123f9ac0-prometheus-operator-tls" seLinuxMountContext="" Nov 03 20:01:30.532474 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.531792 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879" volumeName="kubernetes.io/projected/b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879-kube-api-access-dlv6z" seLinuxMountContext="" Nov 03 20:01:30.532474 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.531807 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f1241d10-9647-4075-9091-19183e105d50" volumeName="kubernetes.io/projected/f1241d10-9647-4075-9091-19183e105d50-kube-api-access-r7vcn" seLinuxMountContext="" Nov 03 20:01:30.532474 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.531821 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f5da7c0e-2db7-48fd-ac10-bccc095ef79e" volumeName="kubernetes.io/empty-dir/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-tmp" seLinuxMountContext="" Nov 03 20:01:30.532474 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.531835 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f5da7c0e-2db7-48fd-ac10-bccc095ef79e" volumeName="kubernetes.io/secret/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-secret-thanos-querier-kube-rbac-proxy-metrics" seLinuxMountContext="" Nov 03 20:01:30.532474 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.531849 5857 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="26c31b1c-c3c5-4676-b71f-f44499e10a3b" volumeName="kubernetes.io/projected/26c31b1c-c3c5-4676-b71f-f44499e10a3b-tls-assets" seLinuxMountContext="" Nov 03 20:01:30.532474 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.531861 5857 reconstruct.go:97] "Volume reconstruction finished" Nov 03 20:01:30.532474 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.531870 5857 reconciler.go:29] "Reconciler: start to sync state" Nov 03 20:01:30.553040 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.553002 5857 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Nov 03 20:01:30.566204 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.566168 5857 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Nov 03 20:01:30.566204 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.566201 5857 status_manager.go:249] "Starting to sync pod status with apiserver" Nov 03 20:01:30.566432 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.566274 5857 kubelet.go:2521] "Starting kubelet main sync loop" Nov 03 20:01:30.566793 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:01:30.566770 5857 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Nov 03 20:01:30.588593 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.584023 5857 generic.go:356] "Generic (PLEG): container finished" podID="26c31b1c-c3c5-4676-b71f-f44499e10a3b" containerID="d9a6fde832579f5d3b441121db3a042fbe6047ba212506a27d8c6934c79f3e9a" exitCode=0 Nov 03 20:01:30.600080 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.594779 5857 generic.go:356] "Generic (PLEG): container finished" podID="a445b335-dfaf-41a2-afb5-e9ee45ec471f" containerID="5ade4eca24c3e38b50a6cebd915bcdff6bbe5eb0fb830fb3d422ea5f88273c69" exitCode=0 Nov 03 20:01:30.600080 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.594812 5857 generic.go:356] "Generic (PLEG): container finished" podID="a445b335-dfaf-41a2-afb5-e9ee45ec471f" containerID="6db0f74ec684981c725f85660daeb3f0251e17371987e51f62b807c09f954955" exitCode=0 Nov 03 20:01:30.600080 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.594822 5857 generic.go:356] "Generic (PLEG): container finished" podID="a445b335-dfaf-41a2-afb5-e9ee45ec471f" containerID="92f1da15d0184ee1adb39f7ae3936e46ea7fd1cd2e5056a619029dd04eebd9d2" exitCode=0 Nov 03 20:01:30.600080 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.594831 5857 generic.go:356] "Generic (PLEG): container finished" podID="a445b335-dfaf-41a2-afb5-e9ee45ec471f" containerID="9d98527b84d5754d670d3cb0163697e826322444cfe68fc3d54dce94d5af0453" exitCode=0 Nov 03 20:01:30.600080 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.594840 5857 generic.go:356] "Generic (PLEG): container finished" podID="a445b335-dfaf-41a2-afb5-e9ee45ec471f" containerID="97726df57cee8efff26d2269eb8411780b736536d5c1958310ca3a36c0b236ef" exitCode=0 Nov 03 20:01:30.600080 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.594849 5857 generic.go:356] "Generic (PLEG): container finished" podID="a445b335-dfaf-41a2-afb5-e9ee45ec471f" containerID="b92425ebe7689e857b7b6642858b9bc75e563f78d92839ef4369ba8bba75643c" exitCode=0 Nov 03 20:01:30.605320 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.605275 5857 generic.go:356] "Generic (PLEG): container finished" podID="d77c2e2c27eea566b26a98b807b65f3e" containerID="37d262e7e18b72993167637adb2b8c69a0ba69d126cf19fbd2b394cfba7d7c18" exitCode=0 Nov 03 20:01:30.624931 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:01:30.624893 5857 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-181.us-west-1.compute.internal\" not found" Nov 03 20:01:30.651496 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.651406 5857 generic.go:356] "Generic (PLEG): container finished" podID="eb01d4b7-2af5-4493-af2c-8d90a120851f" containerID="84f8d55e87f0332659d20132941c35ce4adfa4e7ad8e40403a95cd2658cb417f" exitCode=0 Nov 03 20:01:30.666866 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:01:30.666835 5857 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet" Nov 03 20:01:30.689839 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.689815 5857 manager.go:324] Recovery completed Nov 03 20:01:30.714174 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.714144 5857 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 20:01:30.716189 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.716161 5857 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-181.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 20:01:30.716312 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.716212 5857 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-181.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 20:01:30.716312 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.716230 5857 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-181.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 20:01:30.721405 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.721377 5857 cpu_manager.go:226] "Starting" policy="none" Nov 03 20:01:30.721585 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.721536 5857 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Nov 03 20:01:30.721585 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.721587 5857 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Nov 03 20:01:30.721781 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.721749 5857 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 20:01:30.721838 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.721813 5857 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet="" Nov 03 20:01:30.721890 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.721830 5857 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={} Nov 03 20:01:30.721890 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.721856 5857 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint" Nov 03 20:01:30.721890 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.721864 5857 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet="" Nov 03 20:01:30.721890 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.721872 5857 policy_none.go:50] "Start" Nov 03 20:01:30.722080 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.721901 5857 memory_manager.go:187] "Starting memorymanager" policy="None" Nov 03 20:01:30.722080 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.721906 5857 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 20:01:30.722080 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.721915 5857 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Nov 03 20:01:30.722080 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.721907 5857 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Nov 03 20:01:30.722080 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.721441 5857 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 20:01:30.722491 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.722127 5857 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint" Nov 03 20:01:30.722491 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.722138 5857 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint" Nov 03 20:01:30.722491 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.722146 5857 policy_none.go:44] "Start" Nov 03 20:01:30.725012 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:01:30.724992 5857 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-181.us-west-1.compute.internal\" not found" Nov 03 20:01:30.725873 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.725856 5857 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-181.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 20:01:30.725955 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.725896 5857 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-181.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 20:01:30.725955 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.725909 5857 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-181.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 20:01:30.727899 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.727868 5857 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Nov 03 20:01:30.731794 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.731780 5857 manager.go:341] "Starting Device Plugin manager" Nov 03 20:01:30.731870 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:01:30.731806 5857 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Nov 03 20:01:30.731870 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.731815 5857 server.go:87] "Starting device plugin registration server" Nov 03 20:01:30.732503 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.732490 5857 eviction_manager.go:194] "Eviction manager: starting control loop" Nov 03 20:01:30.732550 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.732505 5857 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Nov 03 20:01:30.732649 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.732629 5857 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Nov 03 20:01:30.732774 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.732742 5857 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Nov 03 20:01:30.732838 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.732785 5857 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Nov 03 20:01:30.732838 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.732792 5857 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Nov 03 20:01:30.732948 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.732850 5857 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-03T20:01:30.732772857Z","UUID":"cd362645-6c19-463b-8cfb-97b4fc1825cb","Handler":null,"Name":"","Endpoint":""} Nov 03 20:01:30.734197 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.734180 5857 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Nov 03 20:01:30.734293 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.734202 5857 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Nov 03 20:01:30.734932 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:01:30.734913 5857 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Nov 03 20:01:30.735019 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:01:30.734954 5857 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-181.us-west-1.compute.internal\" not found" Nov 03 20:01:30.771833 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.771801 5857 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 20:01:30.819023 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.818991 5857 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 20:01:30.832991 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.832963 5857 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 20:01:30.834106 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.834084 5857 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-181.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 20:01:30.834209 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.834119 5857 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-181.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 20:01:30.834209 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.834130 5857 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-181.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 20:01:30.834209 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.834174 5857 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:01:30.867276 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.867215 5857 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-181.us-west-1.compute.internal"] Nov 03 20:01:30.867939 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.867892 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-181.us-west-1.compute.internal" event={"ID":"7433a56a703a69a62fac958fa017ce29","Type":"ContainerStarted","Data":"5b98c5d2396c078eb5969a59936fd77b091874697aeaad2034e1b2a929d7188b"} Nov 03 20:01:30.868037 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.867950 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-181.us-west-1.compute.internal" event={"ID":"7433a56a703a69a62fac958fa017ce29","Type":"ContainerStarted","Data":"7adef30e25b1d1a6858159dabdbd1786206e26ef92977685375acffd3caa2053"} Nov 03 20:01:30.868037 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.867966 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal" event={"ID":"d77c2e2c27eea566b26a98b807b65f3e","Type":"ContainerStarted","Data":"9c0dfcc893e87e0a644512d435c275eb2f6e6ec0757f7904231071320075b517"} Nov 03 20:01:30.868037 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.867986 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal" event={"ID":"d77c2e2c27eea566b26a98b807b65f3e","Type":"ContainerDied","Data":"37d262e7e18b72993167637adb2b8c69a0ba69d126cf19fbd2b394cfba7d7c18"} Nov 03 20:01:30.868037 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.868001 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal" event={"ID":"d77c2e2c27eea566b26a98b807b65f3e","Type":"ContainerStarted","Data":"2f19ee96e0cda5bba4e76a755fc521e9115b493710767b7674583d6b887d66c4"} Nov 03 20:01:30.868236 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.868037 5857 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:01:30.868236 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.868092 5857 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:01:30.932908 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.932832 5857 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 03 20:01:30.932908 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:01:30.932882 5857 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-140-181.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:01:30.932908 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.932896 5857 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 03 20:01:30.933076 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:01:30.932933 5857 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:01:30.942813 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.942785 5857 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:01:30.942913 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:30.942852 5857 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:01:31.023706 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.023675 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d77c2e2c27eea566b26a98b807b65f3e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal\" (UID: \"d77c2e2c27eea566b26a98b807b65f3e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:01:31.023706 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.023707 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d77c2e2c27eea566b26a98b807b65f3e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal\" (UID: \"d77c2e2c27eea566b26a98b807b65f3e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:01:31.023906 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.023737 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7433a56a703a69a62fac958fa017ce29-config\") pod \"kube-apiserver-proxy-ip-10-0-140-181.us-west-1.compute.internal\" (UID: \"7433a56a703a69a62fac958fa017ce29\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:01:31.124895 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.124860 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d77c2e2c27eea566b26a98b807b65f3e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal\" (UID: \"d77c2e2c27eea566b26a98b807b65f3e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:01:31.124895 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.124897 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7433a56a703a69a62fac958fa017ce29-config\") pod \"kube-apiserver-proxy-ip-10-0-140-181.us-west-1.compute.internal\" (UID: \"7433a56a703a69a62fac958fa017ce29\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:01:31.125101 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.124925 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d77c2e2c27eea566b26a98b807b65f3e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal\" (UID: \"d77c2e2c27eea566b26a98b807b65f3e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:01:31.125101 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.124950 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d77c2e2c27eea566b26a98b807b65f3e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal\" (UID: \"d77c2e2c27eea566b26a98b807b65f3e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:01:31.125101 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.124963 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d77c2e2c27eea566b26a98b807b65f3e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal\" (UID: \"d77c2e2c27eea566b26a98b807b65f3e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:01:31.125101 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.124994 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7433a56a703a69a62fac958fa017ce29-config\") pod \"kube-apiserver-proxy-ip-10-0-140-181.us-west-1.compute.internal\" (UID: \"7433a56a703a69a62fac958fa017ce29\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:01:31.503637 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.503596 5857 apiserver.go:52] "Watching apiserver" Nov 03 20:01:31.607780 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.607739 5857 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Nov 03 20:01:31.610193 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.610162 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-sjn97","openshift-cluster-node-tuning-operator/tuned-v224g","openshift-ingress-canary/ingress-canary-pbv28","openshift-monitoring/openshift-state-metrics-7bd7489957-w78q9","openshift-monitoring/prometheus-operator-9cd89b74c-v5lh8","openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp","openshift-network-operator/iptables-alerter-crqkf","openshift-image-registry/node-ca-ts79p","openshift-monitoring/alertmanager-main-0","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9","openshift-dns/node-resolver-8t9mw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal","openshift-monitoring/thanos-querier-75c5c6c675-9tqxn","kube-system/kube-apiserver-proxy-ip-10-0-140-181.us-west-1.compute.internal","openshift-console/console-577678865d-sxpjq","openshift-multus/multus-additional-cni-plugins-t5q7f","openshift-network-diagnostics/network-check-target-x5gxd","kube-system/global-pull-secret-syncer-wz99q","openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kl7g8","openshift-dns/dns-default-s2xtj","openshift-insights/insights-runtime-extractor-gt9b8","openshift-monitoring/node-exporter-pxws5","openshift-monitoring/metrics-server-748b9d444f-gwfk2","openshift-multus/network-metrics-daemon-pslv9","openshift-ovn-kubernetes/ovnkube-node-7246c","kube-system/konnectivity-agent-xgdct","openshift-console/console-5454b99889-gt2tx","openshift-monitoring/telemeter-client-5c75c8599-kcxp6"] Nov 03 20:01:31.627317 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.627283 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e67d41d7-ae93-442b-b376-d6f23173df56-trusted-ca-bundle\") pod \"console-5454b99889-gt2tx\" (UID: \"e67d41d7-ae93-442b-b376-d6f23173df56\") " pod="openshift-console/console-5454b99889-gt2tx" Nov 03 20:01:31.627317 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.627315 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9-data-volume\") pod \"insights-runtime-extractor-gt9b8\" (UID: \"22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9\") " pod="openshift-insights/insights-runtime-extractor-gt9b8" Nov 03 20:01:31.627542 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.627375 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ccbc5713-cd4c-455b-9162-f4ecfedde1f7-tmp-dir\") pod \"node-resolver-8t9mw\" (UID: \"ccbc5713-cd4c-455b-9162-f4ecfedde1f7\") " pod="openshift-dns/node-resolver-8t9mw" Nov 03 20:01:31.627542 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.627398 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9-data-volume\") pod \"insights-runtime-extractor-gt9b8\" (UID: \"22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9\") " pod="openshift-insights/insights-runtime-extractor-gt9b8" Nov 03 20:01:31.627542 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.627425 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddnm7\" (UniqueName: \"kubernetes.io/projected/ccbc5713-cd4c-455b-9162-f4ecfedde1f7-kube-api-access-ddnm7\") pod \"node-resolver-8t9mw\" (UID: \"ccbc5713-cd4c-455b-9162-f4ecfedde1f7\") " pod="openshift-dns/node-resolver-8t9mw" Nov 03 20:01:31.627542 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.627506 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4dbfce43-ac06-4413-92eb-f123614df91d-client-ca-bundle\") pod \"metrics-server-748b9d444f-gwfk2\" (UID: \"4dbfce43-ac06-4413-92eb-f123614df91d\") " pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:01:31.627542 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.627529 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ccbc5713-cd4c-455b-9162-f4ecfedde1f7-tmp-dir\") pod \"node-resolver-8t9mw\" (UID: \"ccbc5713-cd4c-455b-9162-f4ecfedde1f7\") " pod="openshift-dns/node-resolver-8t9mw" Nov 03 20:01:31.627806 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.627594 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-run\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:01:31.627806 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.627688 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd8a2436-4362-4c11-9e4b-9e20b73094e6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-lwkdp\" (UID: \"bd8a2436-4362-4c11-9e4b-9e20b73094e6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp" Nov 03 20:01:31.627806 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.627713 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5454b99889-gt2tx" Nov 03 20:01:31.627806 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.627760 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-run-systemd\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.627983 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.627848 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:31.627983 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.627897 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-sysconfig\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:01:31.627983 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.627958 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4dbfce43-ac06-4413-92eb-f123614df91d-secret-metrics-server-tls\") pod \"metrics-server-748b9d444f-gwfk2\" (UID: \"4dbfce43-ac06-4413-92eb-f123614df91d\") " pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:01:31.628101 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.627994 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e67d41d7-ae93-442b-b376-d6f23173df56-console-serving-cert\") pod \"console-5454b99889-gt2tx\" (UID: \"e67d41d7-ae93-442b-b376-d6f23173df56\") " pod="openshift-console/console-5454b99889-gt2tx" Nov 03 20:01:31.628101 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.628074 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3-serviceca\") pod \"node-ca-ts79p\" (UID: \"2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3\") " pod="openshift-image-registry/node-ca-ts79p" Nov 03 20:01:31.628178 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.628115 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a445b335-dfaf-41a2-afb5-e9ee45ec471f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t5q7f\" (UID: \"a445b335-dfaf-41a2-afb5-e9ee45ec471f\") " pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:01:31.628234 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.628173 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:31.628234 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.628216 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26c31b1c-c3c5-4676-b71f-f44499e10a3b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:31.628332 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.628246 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879-iptables-alerter-script\") pod \"iptables-alerter-crqkf\" (UID: \"b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879\") " pod="openshift-network-operator/iptables-alerter-crqkf" Nov 03 20:01:31.628332 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.628299 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1241d10-9647-4075-9091-19183e105d50-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:31.628432 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.628338 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-kubernetes\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:01:31.628432 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.628366 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-ovnkube-config\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.628432 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.628398 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gt9b8\" (UID: \"22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9\") " pod="openshift-insights/insights-runtime-extractor-gt9b8" Nov 03 20:01:31.628609 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.628424 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:31.628609 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.628477 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:31.628609 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.628508 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1241d10-9647-4075-9091-19183e105d50-metrics-client-ca\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:31.628609 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.628541 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-modprobe-d\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:01:31.628754 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.628594 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/26c31b1c-c3c5-4676-b71f-f44499e10a3b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:31.628754 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.628672 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a445b335-dfaf-41a2-afb5-e9ee45ec471f-cnibin\") pod \"multus-additional-cni-plugins-t5q7f\" (UID: \"a445b335-dfaf-41a2-afb5-e9ee45ec471f\") " pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:01:31.628814 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.628747 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a445b335-dfaf-41a2-afb5-e9ee45ec471f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t5q7f\" (UID: \"a445b335-dfaf-41a2-afb5-e9ee45ec471f\") " pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:01:31.628857 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.628831 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/30329c02-c760-48d5-86f7-dd265325adb0-dbus\") pod \"global-pull-secret-syncer-wz99q\" (UID: \"30329c02-c760-48d5-86f7-dd265325adb0\") " pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:01:31.628906 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.628887 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlv6z\" (UniqueName: \"kubernetes.io/projected/b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879-kube-api-access-dlv6z\") pod \"iptables-alerter-crqkf\" (UID: \"b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879\") " pod="openshift-network-operator/iptables-alerter-crqkf" Nov 03 20:01:31.628970 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.628949 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f1241d10-9647-4075-9091-19183e105d50-federate-client-tls\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:31.629027 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.628993 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1241d10-9647-4075-9091-19183e105d50-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:31.629079 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.629035 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-var-lib-kubelet\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:01:31.629132 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.629095 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e67d41d7-ae93-442b-b376-d6f23173df56-service-ca\") pod \"console-5454b99889-gt2tx\" (UID: \"e67d41d7-ae93-442b-b376-d6f23173df56\") " pod="openshift-console/console-5454b99889-gt2tx" Nov 03 20:01:31.629179 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.629134 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p6cc\" (UniqueName: \"kubernetes.io/projected/2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3-kube-api-access-9p6cc\") pod \"node-ca-ts79p\" (UID: \"2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3\") " pod="openshift-image-registry/node-ca-ts79p" Nov 03 20:01:31.629179 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.629164 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-sysctl-d\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:01:31.629238 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.629192 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-sysctl-conf\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:01:31.629238 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.629208 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-slash\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.629304 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.629251 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a445b335-dfaf-41a2-afb5-e9ee45ec471f-cni-binary-copy\") pod \"multus-additional-cni-plugins-t5q7f\" (UID: \"a445b335-dfaf-41a2-afb5-e9ee45ec471f\") " pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:01:31.629351 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.629302 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/84404c7a-cc47-4e08-861b-a3b417f17e18-device-dir\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:01:31.629403 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.629355 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb01d4b7-2af5-4493-af2c-8d90a120851f-sys\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:31.629403 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.629389 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eb01d4b7-2af5-4493-af2c-8d90a120851f-node-exporter-tls\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:31.629494 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.629436 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpqvp\" (UniqueName: \"kubernetes.io/projected/960e81d3-4bff-4a35-b6a8-edcd186c6c44-kube-api-access-jpqvp\") pod \"openshift-state-metrics-7bd7489957-w78q9\" (UID: \"960e81d3-4bff-4a35-b6a8-edcd186c6c44\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-w78q9" Nov 03 20:01:31.629494 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.629455 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1241d10-9647-4075-9091-19183e105d50-serving-certs-ca-bundle\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:31.629494 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.629472 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7vcn\" (UniqueName: \"kubernetes.io/projected/f1241d10-9647-4075-9091-19183e105d50-kube-api-access-r7vcn\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:31.629661 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.629492 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-config-volume\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:31.629661 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.629520 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:31.629661 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.629558 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-node-log\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.629661 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.629602 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a445b335-dfaf-41a2-afb5-e9ee45ec471f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t5q7f\" (UID: \"a445b335-dfaf-41a2-afb5-e9ee45ec471f\") " pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:01:31.629661 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.629630 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9-crio-socket\") pod \"insights-runtime-extractor-gt9b8\" (UID: \"22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9\") " pod="openshift-insights/insights-runtime-extractor-gt9b8" Nov 03 20:01:31.629877 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.629658 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/eb01d4b7-2af5-4493-af2c-8d90a120851f-node-exporter-textfile\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:31.629877 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.629695 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/98448491-e429-4d6f-a50a-7cb104997edf-konnectivity-ca\") pod \"konnectivity-agent-xgdct\" (UID: \"98448491-e429-4d6f-a50a-7cb104997edf\") " pod="kube-system/konnectivity-agent-xgdct" Nov 03 20:01:31.630124 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.630093 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/eb01d4b7-2af5-4493-af2c-8d90a120851f-node-exporter-textfile\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:31.630193 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.630095 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bd8a2436-4362-4c11-9e4b-9e20b73094e6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-lwkdp\" (UID: \"bd8a2436-4362-4c11-9e4b-9e20b73094e6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp" Nov 03 20:01:31.630237 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.630196 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-sys\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:01:31.630283 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.630236 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-tmp\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:01:31.630283 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.630264 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-systemd-units\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.630375 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.630297 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-var-lib-openvswitch\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.630375 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.630320 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-tmp\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:01:31.630375 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.630336 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7acfd1d0-46c5-4c12-a419-597cc58d88f1-metrics-tls\") pod \"dns-default-s2xtj\" (UID: \"7acfd1d0-46c5-4c12-a419-597cc58d88f1\") " pod="openshift-dns/dns-default-s2xtj" Nov 03 20:01:31.630499 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.630440 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb01d4b7-2af5-4493-af2c-8d90a120851f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:31.630555 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.630525 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/84404c7a-cc47-4e08-861b-a3b417f17e18-kubelet-dir\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:01:31.630632 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.630591 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f1241d10-9647-4075-9091-19183e105d50-secret-telemeter-client\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:31.630632 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.630628 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/98448491-e429-4d6f-a50a-7cb104997edf-agent-certs\") pod \"konnectivity-agent-xgdct\" (UID: \"98448491-e429-4d6f-a50a-7cb104997edf\") " pod="kube-system/konnectivity-agent-xgdct" Nov 03 20:01:31.630731 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.630651 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7acfd1d0-46c5-4c12-a419-597cc58d88f1-config-volume\") pod \"dns-default-s2xtj\" (UID: \"7acfd1d0-46c5-4c12-a419-597cc58d88f1\") " pod="openshift-dns/dns-default-s2xtj" Nov 03 20:01:31.630731 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.630685 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e67d41d7-ae93-442b-b376-d6f23173df56-oauth-serving-cert\") pod \"console-5454b99889-gt2tx\" (UID: \"e67d41d7-ae93-442b-b376-d6f23173df56\") " pod="openshift-console/console-5454b99889-gt2tx" Nov 03 20:01:31.630731 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.630722 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-secret-thanos-querier-tls\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:31.630868 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.630768 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4dbfce43-ac06-4413-92eb-f123614df91d-secret-metrics-server-client-certs\") pod \"metrics-server-748b9d444f-gwfk2\" (UID: \"4dbfce43-ac06-4413-92eb-f123614df91d\") " pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:01:31.630868 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.630805 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-ovn-node-metrics-cert\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.631173 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.631149 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3-host\") pod \"node-ca-ts79p\" (UID: \"2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3\") " pod="openshift-image-registry/node-ca-ts79p" Nov 03 20:01:31.631385 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.631312 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/eb01d4b7-2af5-4493-af2c-8d90a120851f-node-exporter-wtmp\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:31.631436 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.631420 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r74cx\" (UniqueName: \"kubernetes.io/projected/4dbfce43-ac06-4413-92eb-f123614df91d-kube-api-access-r74cx\") pod \"metrics-server-748b9d444f-gwfk2\" (UID: \"4dbfce43-ac06-4413-92eb-f123614df91d\") " pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:01:31.631494 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.631460 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.631539 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.631524 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a445b335-dfaf-41a2-afb5-e9ee45ec471f-system-cni-dir\") pod \"multus-additional-cni-plugins-t5q7f\" (UID: \"a445b335-dfaf-41a2-afb5-e9ee45ec471f\") " pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:01:31.631641 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.631624 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7rwr\" (UniqueName: \"kubernetes.io/projected/a445b335-dfaf-41a2-afb5-e9ee45ec471f-kube-api-access-t7rwr\") pod \"multus-additional-cni-plugins-t5q7f\" (UID: \"a445b335-dfaf-41a2-afb5-e9ee45ec471f\") " pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:01:31.631687 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.631671 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shsdx\" (UniqueName: \"kubernetes.io/projected/eb01d4b7-2af5-4493-af2c-8d90a120851f-kube-api-access-shsdx\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:31.631735 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.631708 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/84404c7a-cc47-4e08-861b-a3b417f17e18-socket-dir\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:01:31.631773 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.631759 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:31.631848 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.631801 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4dbfce43-ac06-4413-92eb-f123614df91d-audit-log\") pod \"metrics-server-748b9d444f-gwfk2\" (UID: \"4dbfce43-ac06-4413-92eb-f123614df91d\") " pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:01:31.631848 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.631836 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-run-netns\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.631941 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.631866 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879-host-slash\") pod \"iptables-alerter-crqkf\" (UID: \"b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879\") " pod="openshift-network-operator/iptables-alerter-crqkf" Nov 03 20:01:31.631941 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.631908 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77q8n\" (UniqueName: \"kubernetes.io/projected/999ebe89-05a8-4bae-ba5b-b756dd69b073-kube-api-access-77q8n\") pod \"ingress-canary-pbv28\" (UID: \"999ebe89-05a8-4bae-ba5b-b756dd69b073\") " pod="openshift-ingress-canary/ingress-canary-pbv28" Nov 03 20:01:31.632041 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.631958 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-run-ovn-kubernetes\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.632091 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.632017 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gt9b8\" (UID: \"22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9\") " pod="openshift-insights/insights-runtime-extractor-gt9b8" Nov 03 20:01:31.632139 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.632124 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb01d4b7-2af5-4493-af2c-8d90a120851f-metrics-client-ca\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:31.632192 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.632161 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/960e81d3-4bff-4a35-b6a8-edcd186c6c44-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-w78q9\" (UID: \"960e81d3-4bff-4a35-b6a8-edcd186c6c44\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-w78q9" Nov 03 20:01:31.632365 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.632344 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4dbfce43-ac06-4413-92eb-f123614df91d-audit-log\") pod \"metrics-server-748b9d444f-gwfk2\" (UID: \"4dbfce43-ac06-4413-92eb-f123614df91d\") " pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:01:31.632932 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.632913 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-systemd\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:01:31.632991 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.632948 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-log-socket\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.633056 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.633029 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/eb01d4b7-2af5-4493-af2c-8d90a120851f-node-exporter-accelerators-collector-config\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:31.633116 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.633097 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwhj2\" (UniqueName: \"kubernetes.io/projected/aae6331f-1f9f-43c8-9610-f554ddebf2e3-kube-api-access-nwhj2\") pod \"network-metrics-daemon-pslv9\" (UID: \"aae6331f-1f9f-43c8-9610-f554ddebf2e3\") " pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:01:31.633379 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.633357 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-tmp\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:31.633487 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.633451 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-tmp\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:31.633541 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.633493 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/999ebe89-05a8-4bae-ba5b-b756dd69b073-cert\") pod \"ingress-canary-pbv28\" (UID: \"999ebe89-05a8-4bae-ba5b-b756dd69b073\") " pod="openshift-ingress-canary/ingress-canary-pbv28" Nov 03 20:01:31.633661 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.633643 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bd8a2436-4362-4c11-9e4b-9e20b73094e6-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-lwkdp\" (UID: \"bd8a2436-4362-4c11-9e4b-9e20b73094e6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp" Nov 03 20:01:31.633736 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.633689 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/84404c7a-cc47-4e08-861b-a3b417f17e18-etc-selinux\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:01:31.633736 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.633716 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-lib-modules\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:01:31.633836 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.633752 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9272\" (UniqueName: \"kubernetes.io/projected/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-kube-api-access-d9272\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:01:31.633836 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.633787 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ccbc5713-cd4c-455b-9162-f4ecfedde1f7-hosts-file\") pod \"node-resolver-8t9mw\" (UID: \"ccbc5713-cd4c-455b-9162-f4ecfedde1f7\") " pod="openshift-dns/node-resolver-8t9mw" Nov 03 20:01:31.633926 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.633837 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-kubelet\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.633926 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.633873 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsxkj\" (UniqueName: \"kubernetes.io/projected/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-kube-api-access-fsxkj\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.634023 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.633934 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfd9g\" (UniqueName: \"kubernetes.io/projected/e67d41d7-ae93-442b-b376-d6f23173df56-kube-api-access-hfd9g\") pod \"console-5454b99889-gt2tx\" (UID: \"e67d41d7-ae93-442b-b376-d6f23173df56\") " pod="openshift-console/console-5454b99889-gt2tx" Nov 03 20:01:31.634023 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.633969 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/960e81d3-4bff-4a35-b6a8-edcd186c6c44-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-w78q9\" (UID: \"960e81d3-4bff-4a35-b6a8-edcd186c6c44\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-w78q9" Nov 03 20:01:31.634023 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.634004 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:31.634165 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.634039 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:31.634165 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.634068 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jjfg\" (UniqueName: \"kubernetes.io/projected/26c31b1c-c3c5-4676-b71f-f44499e10a3b-kube-api-access-5jjfg\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:31.634165 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.634101 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsbqv\" (UniqueName: \"kubernetes.io/projected/5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2-kube-api-access-rsbqv\") pod \"network-check-target-x5gxd\" (UID: \"5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2\") " pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:01:31.634165 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.634133 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/eb01d4b7-2af5-4493-af2c-8d90a120851f-root\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:31.634378 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.634167 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/26c31b1c-c3c5-4676-b71f-f44499e10a3b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:31.634378 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.634199 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-run-ovn\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.634378 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.634228 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/30329c02-c760-48d5-86f7-dd265325adb0-kubelet-config\") pod \"global-pull-secret-syncer-wz99q\" (UID: \"30329c02-c760-48d5-86f7-dd265325adb0\") " pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:01:31.634378 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.634260 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-host\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:01:31.634378 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.634303 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:31.634378 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.634337 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-cni-bin\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.634378 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.634363 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e67d41d7-ae93-442b-b376-d6f23173df56-tmp\") pod \"console-5454b99889-gt2tx\" (UID: \"e67d41d7-ae93-442b-b376-d6f23173df56\") " pod="openshift-console/console-5454b99889-gt2tx" Nov 03 20:01:31.636372 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.634394 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-cni-netd\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.636372 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.634439 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-ovnkube-script-lib\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.636372 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.634471 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7acfd1d0-46c5-4c12-a419-597cc58d88f1-tmp-dir\") pod \"dns-default-s2xtj\" (UID: \"7acfd1d0-46c5-4c12-a419-597cc58d88f1\") " pod="openshift-dns/dns-default-s2xtj" Nov 03 20:01:31.636372 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.634497 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/84404c7a-cc47-4e08-861b-a3b417f17e18-sys-fs\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:01:31.636372 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.634541 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpcs7\" (UniqueName: \"kubernetes.io/projected/84404c7a-cc47-4e08-861b-a3b417f17e18-kube-api-access-jpcs7\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:01:31.636372 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.634627 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z65ln\" (UniqueName: \"kubernetes.io/projected/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-kube-api-access-z65ln\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:31.636372 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.634666 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zr4p\" (UniqueName: \"kubernetes.io/projected/bd8a2436-4362-4c11-9e4b-9e20b73094e6-kube-api-access-9zr4p\") pod \"kube-state-metrics-5dc8d7d89b-lwkdp\" (UID: \"bd8a2436-4362-4c11-9e4b-9e20b73094e6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp" Nov 03 20:01:31.636372 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.634698 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4dbfce43-ac06-4413-92eb-f123614df91d-metrics-server-audit-profiles\") pod \"metrics-server-748b9d444f-gwfk2\" (UID: \"4dbfce43-ac06-4413-92eb-f123614df91d\") " pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:01:31.636372 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.634727 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e67d41d7-ae93-442b-b376-d6f23173df56-console-oauth-config\") pod \"console-5454b99889-gt2tx\" (UID: \"e67d41d7-ae93-442b-b376-d6f23173df56\") " pod="openshift-console/console-5454b99889-gt2tx" Nov 03 20:01:31.636372 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.634760 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30329c02-c760-48d5-86f7-dd265325adb0-original-pull-secret\") pod \"global-pull-secret-syncer-wz99q\" (UID: \"30329c02-c760-48d5-86f7-dd265325adb0\") " pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:01:31.636372 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.634794 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/84404c7a-cc47-4e08-861b-a3b417f17e18-registration-dir\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:01:31.636372 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.634828 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-metrics-client-ca\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:31.636372 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.634862 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-secret-grpc-tls\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:31.636372 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.634890 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd8a2436-4362-4c11-9e4b-9e20b73094e6-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-lwkdp\" (UID: \"bd8a2436-4362-4c11-9e4b-9e20b73094e6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp" Nov 03 20:01:31.636372 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.634926 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26c31b1c-c3c5-4676-b71f-f44499e10a3b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:31.636372 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.634959 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/960e81d3-4bff-4a35-b6a8-edcd186c6c44-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-w78q9\" (UID: \"960e81d3-4bff-4a35-b6a8-edcd186c6c44\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-w78q9" Nov 03 20:01:31.636372 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.634993 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f1241d10-9647-4075-9091-19183e105d50-telemeter-client-tls\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:31.636372 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.635026 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd8a2436-4362-4c11-9e4b-9e20b73094e6-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-lwkdp\" (UID: \"bd8a2436-4362-4c11-9e4b-9e20b73094e6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp" Nov 03 20:01:31.636372 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.635056 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-etc-openvswitch\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.636372 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.635089 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-run-openvswitch\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.636372 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.635122 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e67d41d7-ae93-442b-b376-d6f23173df56-console-config\") pod \"console-5454b99889-gt2tx\" (UID: \"e67d41d7-ae93-442b-b376-d6f23173df56\") " pod="openshift-console/console-5454b99889-gt2tx" Nov 03 20:01:31.636372 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.635158 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjlrv\" (UniqueName: \"kubernetes.io/projected/22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9-kube-api-access-jjlrv\") pod \"insights-runtime-extractor-gt9b8\" (UID: \"22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9\") " pod="openshift-insights/insights-runtime-extractor-gt9b8" Nov 03 20:01:31.636372 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.635191 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqz58\" (UniqueName: \"kubernetes.io/projected/7acfd1d0-46c5-4c12-a419-597cc58d88f1-kube-api-access-nqz58\") pod \"dns-default-s2xtj\" (UID: \"7acfd1d0-46c5-4c12-a419-597cc58d88f1\") " pod="openshift-dns/dns-default-s2xtj" Nov 03 20:01:31.636372 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.635225 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aae6331f-1f9f-43c8-9610-f554ddebf2e3-metrics-certs\") pod \"network-metrics-daemon-pslv9\" (UID: \"aae6331f-1f9f-43c8-9610-f554ddebf2e3\") " pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:01:31.636372 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.635257 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-tuned\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:01:31.636372 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.635293 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/26c31b1c-c3c5-4676-b71f-f44499e10a3b-config-out\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:31.636372 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.635328 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-web-config\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:31.636372 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.635359 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dbfce43-ac06-4413-92eb-f123614df91d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-748b9d444f-gwfk2\" (UID: \"4dbfce43-ac06-4413-92eb-f123614df91d\") " pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:01:31.636372 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.635399 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-env-overrides\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.636372 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.635532 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bd8a2436-4362-4c11-9e4b-9e20b73094e6-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-lwkdp\" (UID: \"bd8a2436-4362-4c11-9e4b-9e20b73094e6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp" Nov 03 20:01:31.636372 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.636031 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7acfd1d0-46c5-4c12-a419-597cc58d88f1-tmp-dir\") pod \"dns-default-s2xtj\" (UID: \"7acfd1d0-46c5-4c12-a419-597cc58d88f1\") " pod="openshift-dns/dns-default-s2xtj" Nov 03 20:01:31.636372 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.636202 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/26c31b1c-c3c5-4676-b71f-f44499e10a3b-config-out\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:31.636372 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.636353 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-tuned\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:01:31.638123 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.636509 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/26c31b1c-c3c5-4676-b71f-f44499e10a3b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:31.667553 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.667519 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lbpb4\"" Nov 03 20:01:31.668108 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.668084 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lnw8t\"" Nov 03 20:01:31.668691 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.668676 5857 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:01:31.668819 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.668802 5857 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:01:31.669271 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.669256 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-gh2n7\"" Nov 03 20:01:31.669271 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.669264 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zzr9t\"" Nov 03 20:01:31.669980 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.669964 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Nov 03 20:01:31.670051 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.670031 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-h5q7m\"" Nov 03 20:01:31.671092 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.671080 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Nov 03 20:01:31.671443 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.671422 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Nov 03 20:01:31.671534 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.671457 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Nov 03 20:01:31.671534 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.671470 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Nov 03 20:01:31.671615 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.671593 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Nov 03 20:01:31.671615 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.671604 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Nov 03 20:01:31.671676 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.671648 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Nov 03 20:01:31.671676 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.671665 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Nov 03 20:01:31.671770 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.671700 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Nov 03 20:01:31.671770 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.671723 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Nov 03 20:01:31.671770 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.671729 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Nov 03 20:01:31.671770 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.671762 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Nov 03 20:01:31.671928 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.671780 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-nw9hw\"" Nov 03 20:01:31.671928 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.671881 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Nov 03 20:01:31.671928 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.671905 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Nov 03 20:01:31.672050 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.671982 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Nov 03 20:01:31.672050 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.672004 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Nov 03 20:01:31.672050 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.672003 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Nov 03 20:01:31.672050 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.672016 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Nov 03 20:01:31.672050 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.672045 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Nov 03 20:01:31.672207 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.672053 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vw2xk\"" Nov 03 20:01:31.672207 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.672067 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Nov 03 20:01:31.672207 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.672089 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-nwkgp\"" Nov 03 20:01:31.672207 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.672103 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Nov 03 20:01:31.672207 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.672156 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-kbkmq\"" Nov 03 20:01:31.672407 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.672397 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Nov 03 20:01:31.675735 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.675718 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-env-overrides\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.676943 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.676927 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-ovnkube-script-lib\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.678012 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.677998 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aae6331f-1f9f-43c8-9610-f554ddebf2e3-metrics-certs\") pod \"network-metrics-daemon-pslv9\" (UID: \"aae6331f-1f9f-43c8-9610-f554ddebf2e3\") " pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:01:31.678093 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.678079 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30329c02-c760-48d5-86f7-dd265325adb0-original-pull-secret\") pod \"global-pull-secret-syncer-wz99q\" (UID: \"30329c02-c760-48d5-86f7-dd265325adb0\") " pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:01:31.679112 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.679095 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a445b335-dfaf-41a2-afb5-e9ee45ec471f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t5q7f\" (UID: \"a445b335-dfaf-41a2-afb5-e9ee45ec471f\") " pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:01:31.679112 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.679106 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a445b335-dfaf-41a2-afb5-e9ee45ec471f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t5q7f\" (UID: \"a445b335-dfaf-41a2-afb5-e9ee45ec471f\") " pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:01:31.679215 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.679122 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-ovnkube-config\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.679215 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.679182 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879-iptables-alerter-script\") pod \"iptables-alerter-crqkf\" (UID: \"b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879\") " pod="openshift-network-operator/iptables-alerter-crqkf" Nov 03 20:01:31.680347 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.680331 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a445b335-dfaf-41a2-afb5-e9ee45ec471f-cni-binary-copy\") pod \"multus-additional-cni-plugins-t5q7f\" (UID: \"a445b335-dfaf-41a2-afb5-e9ee45ec471f\") " pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:01:31.680389 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.680346 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/98448491-e429-4d6f-a50a-7cb104997edf-konnectivity-ca\") pod \"konnectivity-agent-xgdct\" (UID: \"98448491-e429-4d6f-a50a-7cb104997edf\") " pod="kube-system/konnectivity-agent-xgdct" Nov 03 20:01:31.681589 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.681556 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-ovn-node-metrics-cert\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.681645 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.681577 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/98448491-e429-4d6f-a50a-7cb104997edf-agent-certs\") pod \"konnectivity-agent-xgdct\" (UID: \"98448491-e429-4d6f-a50a-7cb104997edf\") " pod="kube-system/konnectivity-agent-xgdct" Nov 03 20:01:31.703467 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.703449 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Nov 03 20:01:31.704517 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.704498 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Nov 03 20:01:31.704837 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.704821 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Nov 03 20:01:31.704934 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.704858 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Nov 03 20:01:31.704934 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.704884 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7694h\"" Nov 03 20:01:31.704934 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.704894 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Nov 03 20:01:31.704934 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.704907 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Nov 03 20:01:31.704934 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.704898 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-p4th4\"" Nov 03 20:01:31.704934 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.704906 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-q62cb\"" Nov 03 20:01:31.705184 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.704951 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Nov 03 20:01:31.705184 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.704974 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Nov 03 20:01:31.705184 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.705023 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Nov 03 20:01:31.705184 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.705037 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fddp8\"" Nov 03 20:01:31.706914 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.706901 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Nov 03 20:01:31.708408 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.708394 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Nov 03 20:01:31.708692 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.708675 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3-serviceca\") pod \"node-ca-ts79p\" (UID: \"2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3\") " pod="openshift-image-registry/node-ca-ts79p" Nov 03 20:01:31.708922 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.708903 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gt9b8\" (UID: \"22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9\") " pod="openshift-insights/insights-runtime-extractor-gt9b8" Nov 03 20:01:31.713930 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.713913 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gt9b8\" (UID: \"22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9\") " pod="openshift-insights/insights-runtime-extractor-gt9b8" Nov 03 20:01:31.713985 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.713931 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/eb01d4b7-2af5-4493-af2c-8d90a120851f-node-exporter-accelerators-collector-config\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:31.724429 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.724413 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Nov 03 20:01:31.724549 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.724536 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Nov 03 20:01:31.724804 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.724790 5857 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Nov 03 20:01:31.724966 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.724950 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Nov 03 20:01:31.725036 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.724955 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Nov 03 20:01:31.725036 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.725030 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Nov 03 20:01:31.725100 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.725041 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Nov 03 20:01:31.725100 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.725059 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Nov 03 20:01:31.725100 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.725074 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Nov 03 20:01:31.725193 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.725129 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Nov 03 20:01:31.725732 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.725718 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Nov 03 20:01:31.726427 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.726411 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Nov 03 20:01:31.726499 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.726485 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4dbfce43-ac06-4413-92eb-f123614df91d-metrics-server-audit-profiles\") pod \"metrics-server-748b9d444f-gwfk2\" (UID: \"4dbfce43-ac06-4413-92eb-f123614df91d\") " pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:01:31.726620 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.726601 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dbfce43-ac06-4413-92eb-f123614df91d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-748b9d444f-gwfk2\" (UID: \"4dbfce43-ac06-4413-92eb-f123614df91d\") " pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:01:31.727252 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.727240 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Nov 03 20:01:31.727290 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.727281 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Nov 03 20:01:31.727642 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.727630 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Nov 03 20:01:31.727675 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.727632 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Nov 03 20:01:31.727675 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.727652 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Nov 03 20:01:31.727905 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.727888 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Nov 03 20:01:31.727993 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.727904 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Nov 03 20:01:31.727993 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.727911 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Nov 03 20:01:31.728059 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.728029 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\"" Nov 03 20:01:31.728123 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.728108 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Nov 03 20:01:31.728165 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.728118 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Nov 03 20:01:31.728368 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.728345 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Nov 03 20:01:31.728463 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.728385 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Nov 03 20:01:31.728463 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.728406 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Nov 03 20:01:31.728602 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.728470 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Nov 03 20:01:31.728602 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.728485 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Nov 03 20:01:31.728602 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.728493 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Nov 03 20:01:31.728749 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.728608 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26c31b1c-c3c5-4676-b71f-f44499e10a3b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:31.728749 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.728631 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:31.728749 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.728672 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Nov 03 20:01:31.728749 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.728685 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Nov 03 20:01:31.728749 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.728693 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Nov 03 20:01:31.728749 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.728710 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Nov 03 20:01:31.728956 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.728795 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1241d10-9647-4075-9091-19183e105d50-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:31.728956 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.728837 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:31.728956 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.728833 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:31.728956 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.728908 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1241d10-9647-4075-9091-19183e105d50-metrics-client-ca\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:31.729208 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.729190 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1241d10-9647-4075-9091-19183e105d50-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:31.729208 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.729206 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f1241d10-9647-4075-9091-19183e105d50-federate-client-tls\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:31.729828 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.729811 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:31.729899 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.729886 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1241d10-9647-4075-9091-19183e105d50-serving-certs-ca-bundle\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:31.731053 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.731037 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bd8a2436-4362-4c11-9e4b-9e20b73094e6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-lwkdp\" (UID: \"bd8a2436-4362-4c11-9e4b-9e20b73094e6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp" Nov 03 20:01:31.732174 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.732158 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7acfd1d0-46c5-4c12-a419-597cc58d88f1-config-volume\") pod \"dns-default-s2xtj\" (UID: \"7acfd1d0-46c5-4c12-a419-597cc58d88f1\") " pod="openshift-dns/dns-default-s2xtj" Nov 03 20:01:31.732256 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.732222 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4dbfce43-ac06-4413-92eb-f123614df91d-secret-metrics-server-client-certs\") pod \"metrics-server-748b9d444f-gwfk2\" (UID: \"4dbfce43-ac06-4413-92eb-f123614df91d\") " pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:01:31.733268 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.733253 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb01d4b7-2af5-4493-af2c-8d90a120851f-metrics-client-ca\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:31.733325 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.733253 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/960e81d3-4bff-4a35-b6a8-edcd186c6c44-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-w78q9\" (UID: \"960e81d3-4bff-4a35-b6a8-edcd186c6c44\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-w78q9" Nov 03 20:01:31.734410 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.734398 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/999ebe89-05a8-4bae-ba5b-b756dd69b073-cert\") pod \"ingress-canary-pbv28\" (UID: \"999ebe89-05a8-4bae-ba5b-b756dd69b073\") " pod="openshift-ingress-canary/ingress-canary-pbv28" Nov 03 20:01:31.735708 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.735693 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/62a2d16f-a781-4b20-ae3e-323c123f9ac0-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-v5lh8\" (UID: \"62a2d16f-a781-4b20-ae3e-323c123f9ac0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-v5lh8" Nov 03 20:01:31.735754 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.735718 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-run\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:01:31.735754 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.735735 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-run-systemd\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.735842 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.735765 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-multus-socket-dir-parent\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.735842 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.735782 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-sysconfig\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:01:31.735842 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.735826 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-run-systemd\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.735967 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.735825 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-run\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:01:31.735967 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.735854 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-sysconfig\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:01:31.735967 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.735854 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-host-var-lib-cni-bin\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.735967 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.735910 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e67d41d7-ae93-442b-b376-d6f23173df56-console-serving-cert\") pod \"console-5454b99889-gt2tx\" (UID: \"e67d41d7-ae93-442b-b376-d6f23173df56\") " pod="openshift-console/console-5454b99889-gt2tx" Nov 03 20:01:31.735967 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.735950 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/62a2d16f-a781-4b20-ae3e-323c123f9ac0-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-v5lh8\" (UID: \"62a2d16f-a781-4b20-ae3e-323c123f9ac0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-v5lh8" Nov 03 20:01:31.736118 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.735967 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-kubernetes\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:01:31.736118 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.735991 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-etc-kubernetes\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.736118 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736010 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-kubernetes\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:01:31.736118 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736031 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62a2d16f-a781-4b20-ae3e-323c123f9ac0-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-v5lh8\" (UID: \"62a2d16f-a781-4b20-ae3e-323c123f9ac0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-v5lh8" Nov 03 20:01:31.736118 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736057 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-modprobe-d\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:01:31.736118 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736076 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7l96\" (UniqueName: \"kubernetes.io/projected/62a2d16f-a781-4b20-ae3e-323c123f9ac0-kube-api-access-f7l96\") pod \"prometheus-operator-9cd89b74c-v5lh8\" (UID: \"62a2d16f-a781-4b20-ae3e-323c123f9ac0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-v5lh8" Nov 03 20:01:31.736353 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736121 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a445b335-dfaf-41a2-afb5-e9ee45ec471f-cnibin\") pod \"multus-additional-cni-plugins-t5q7f\" (UID: \"a445b335-dfaf-41a2-afb5-e9ee45ec471f\") " pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:01:31.736353 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736151 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/30329c02-c760-48d5-86f7-dd265325adb0-dbus\") pod \"global-pull-secret-syncer-wz99q\" (UID: \"30329c02-c760-48d5-86f7-dd265325adb0\") " pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:01:31.736353 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736165 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-modprobe-d\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:01:31.736353 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736179 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-var-lib-kubelet\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:01:31.736353 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736205 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a445b335-dfaf-41a2-afb5-e9ee45ec471f-cnibin\") pod \"multus-additional-cni-plugins-t5q7f\" (UID: \"a445b335-dfaf-41a2-afb5-e9ee45ec471f\") " pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:01:31.736353 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736211 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-host-var-lib-kubelet\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.736353 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736207 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62a2d16f-a781-4b20-ae3e-323c123f9ac0-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-v5lh8\" (UID: \"62a2d16f-a781-4b20-ae3e-323c123f9ac0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-v5lh8" Nov 03 20:01:31.736353 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736215 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:31.736353 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736226 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/30329c02-c760-48d5-86f7-dd265325adb0-dbus\") pod \"global-pull-secret-syncer-wz99q\" (UID: \"30329c02-c760-48d5-86f7-dd265325adb0\") " pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:01:31.736353 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736238 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-var-lib-kubelet\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:01:31.736353 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736258 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e67d41d7-ae93-442b-b376-d6f23173df56-service-ca\") pod \"console-5454b99889-gt2tx\" (UID: \"e67d41d7-ae93-442b-b376-d6f23173df56\") " pod="openshift-console/console-5454b99889-gt2tx" Nov 03 20:01:31.736353 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736305 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-sysctl-d\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:01:31.736353 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736333 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-sysctl-conf\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:01:31.736870 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736383 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-slash\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.736870 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736429 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62a2d16f-a781-4b20-ae3e-323c123f9ac0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-v5lh8\" (UID: \"62a2d16f-a781-4b20-ae3e-323c123f9ac0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-v5lh8" Nov 03 20:01:31.736870 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736399 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd8a2436-4362-4c11-9e4b-9e20b73094e6-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-lwkdp\" (UID: \"bd8a2436-4362-4c11-9e4b-9e20b73094e6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp" Nov 03 20:01:31.736870 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736446 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-sysctl-d\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:01:31.736870 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736455 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e720aa2-db14-40f6-b905-0155bcbd7809-oauth-serving-cert\") pod \"console-577678865d-sxpjq\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:31.736870 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736465 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-slash\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.736870 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736476 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:31.736870 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736503 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/84404c7a-cc47-4e08-861b-a3b417f17e18-device-dir\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:01:31.736870 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736528 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-sysctl-conf\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:01:31.736870 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736531 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/19f9860c-9efc-4678-8c1e-393c723b4611-multus-daemon-config\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.736870 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736593 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb01d4b7-2af5-4493-af2c-8d90a120851f-sys\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:31.736870 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736610 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/84404c7a-cc47-4e08-861b-a3b417f17e18-device-dir\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:01:31.736870 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736629 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-node-log\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.736870 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736639 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e720aa2-db14-40f6-b905-0155bcbd7809-oauth-serving-cert\") pod \"console-577678865d-sxpjq\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:31.736870 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736656 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a445b335-dfaf-41a2-afb5-e9ee45ec471f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t5q7f\" (UID: \"a445b335-dfaf-41a2-afb5-e9ee45ec471f\") " pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:01:31.736870 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736666 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62a2d16f-a781-4b20-ae3e-323c123f9ac0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-v5lh8\" (UID: \"62a2d16f-a781-4b20-ae3e-323c123f9ac0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-v5lh8" Nov 03 20:01:31.736870 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736682 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/19f9860c-9efc-4678-8c1e-393c723b4611-multus-daemon-config\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.736870 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736689 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-node-log\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.736870 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736684 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9-crio-socket\") pod \"insights-runtime-extractor-gt9b8\" (UID: \"22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9\") " pod="openshift-insights/insights-runtime-extractor-gt9b8" Nov 03 20:01:31.736870 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736657 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb01d4b7-2af5-4493-af2c-8d90a120851f-sys\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:31.736870 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736708 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a445b335-dfaf-41a2-afb5-e9ee45ec471f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t5q7f\" (UID: \"a445b335-dfaf-41a2-afb5-e9ee45ec471f\") " pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:01:31.736870 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736730 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9-crio-socket\") pod \"insights-runtime-extractor-gt9b8\" (UID: \"22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9\") " pod="openshift-insights/insights-runtime-extractor-gt9b8" Nov 03 20:01:31.736870 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736752 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-multus-cni-dir\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.736870 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736784 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc8z5\" (UniqueName: \"kubernetes.io/projected/19f9860c-9efc-4678-8c1e-393c723b4611-kube-api-access-wc8z5\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.736870 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736825 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0c479f18-0308-403a-adf1-42575f8adfa2-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-kl7g8\" (UID: \"0c479f18-0308-403a-adf1-42575f8adfa2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kl7g8" Nov 03 20:01:31.736870 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736846 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-metrics-client-ca\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:31.736870 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736856 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-sys\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736885 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-systemd-units\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736929 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-sys\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736938 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-var-lib-openvswitch\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736941 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/960e81d3-4bff-4a35-b6a8-edcd186c6c44-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-w78q9\" (UID: \"960e81d3-4bff-4a35-b6a8-edcd186c6c44\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-w78q9" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736932 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e67d41d7-ae93-442b-b376-d6f23173df56-service-ca\") pod \"console-5454b99889-gt2tx\" (UID: \"e67d41d7-ae93-442b-b376-d6f23173df56\") " pod="openshift-console/console-5454b99889-gt2tx" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736966 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-systemd-units\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736976 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-var-lib-openvswitch\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.736956 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/19f9860c-9efc-4678-8c1e-393c723b4611-cni-binary-copy\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737008 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-host-run-k8s-cni-cncf-io\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737024 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-host-run-multus-certs\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737065 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/84404c7a-cc47-4e08-861b-a3b417f17e18-kubelet-dir\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737112 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/19f9860c-9efc-4678-8c1e-393c723b4611-cni-binary-copy\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737110 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-host-run-netns\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737122 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/84404c7a-cc47-4e08-861b-a3b417f17e18-kubelet-dir\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737141 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e720aa2-db14-40f6-b905-0155bcbd7809-console-oauth-config\") pod \"console-577678865d-sxpjq\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737161 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-multus-conf-dir\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737177 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e720aa2-db14-40f6-b905-0155bcbd7809-service-ca\") pod \"console-577678865d-sxpjq\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737202 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e67d41d7-ae93-442b-b376-d6f23173df56-oauth-serving-cert\") pod \"console-5454b99889-gt2tx\" (UID: \"e67d41d7-ae93-442b-b376-d6f23173df56\") " pod="openshift-console/console-5454b99889-gt2tx" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737234 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-host-var-lib-cni-multus\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737261 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3-host\") pod \"node-ca-ts79p\" (UID: \"2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3\") " pod="openshift-image-registry/node-ca-ts79p" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737278 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/eb01d4b7-2af5-4493-af2c-8d90a120851f-node-exporter-wtmp\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737309 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737314 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e720aa2-db14-40f6-b905-0155bcbd7809-console-oauth-config\") pod \"console-577678865d-sxpjq\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737330 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e720aa2-db14-40f6-b905-0155bcbd7809-service-ca\") pod \"console-577678865d-sxpjq\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737343 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3-host\") pod \"node-ca-ts79p\" (UID: \"2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3\") " pod="openshift-image-registry/node-ca-ts79p" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737365 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a445b335-dfaf-41a2-afb5-e9ee45ec471f-system-cni-dir\") pod \"multus-additional-cni-plugins-t5q7f\" (UID: \"a445b335-dfaf-41a2-afb5-e9ee45ec471f\") " pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737389 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/84404c7a-cc47-4e08-861b-a3b417f17e18-socket-dir\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737407 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-run-netns\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737428 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879-host-slash\") pod \"iptables-alerter-crqkf\" (UID: \"b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879\") " pod="openshift-network-operator/iptables-alerter-crqkf" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737444 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-run-ovn-kubernetes\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737445 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a445b335-dfaf-41a2-afb5-e9ee45ec471f-system-cni-dir\") pod \"multus-additional-cni-plugins-t5q7f\" (UID: \"a445b335-dfaf-41a2-afb5-e9ee45ec471f\") " pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737458 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/84404c7a-cc47-4e08-861b-a3b417f17e18-socket-dir\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737465 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-hostroot\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737497 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737520 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-run-netns\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737521 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-run-ovn-kubernetes\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737533 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-systemd\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737556 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879-host-slash\") pod \"iptables-alerter-crqkf\" (UID: \"b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879\") " pod="openshift-network-operator/iptables-alerter-crqkf" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737603 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-log-socket\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737618 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-etc-systemd\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737605 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/eb01d4b7-2af5-4493-af2c-8d90a120851f-node-exporter-wtmp\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737641 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-log-socket\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737643 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/84404c7a-cc47-4e08-861b-a3b417f17e18-etc-selinux\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737686 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/84404c7a-cc47-4e08-861b-a3b417f17e18-etc-selinux\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737689 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-lib-modules\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737713 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ccbc5713-cd4c-455b-9162-f4ecfedde1f7-hosts-file\") pod \"node-resolver-8t9mw\" (UID: \"ccbc5713-cd4c-455b-9162-f4ecfedde1f7\") " pod="openshift-dns/node-resolver-8t9mw" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737728 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-kubelet\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737744 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e720aa2-db14-40f6-b905-0155bcbd7809-console-serving-cert\") pod \"console-577678865d-sxpjq\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737766 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfd9g\" (UniqueName: \"kubernetes.io/projected/e67d41d7-ae93-442b-b376-d6f23173df56-kube-api-access-hfd9g\") pod \"console-5454b99889-gt2tx\" (UID: \"e67d41d7-ae93-442b-b376-d6f23173df56\") " pod="openshift-console/console-5454b99889-gt2tx" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737776 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ccbc5713-cd4c-455b-9162-f4ecfedde1f7-hosts-file\") pod \"node-resolver-8t9mw\" (UID: \"ccbc5713-cd4c-455b-9162-f4ecfedde1f7\") " pod="openshift-dns/node-resolver-8t9mw" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737743 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e67d41d7-ae93-442b-b376-d6f23173df56-oauth-serving-cert\") pod \"console-5454b99889-gt2tx\" (UID: \"e67d41d7-ae93-442b-b376-d6f23173df56\") " pod="openshift-console/console-5454b99889-gt2tx" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737794 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/eb01d4b7-2af5-4493-af2c-8d90a120851f-root\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737804 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-kubelet\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737805 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-lib-modules\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737837 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/eb01d4b7-2af5-4493-af2c-8d90a120851f-root\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737899 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-run-ovn\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737939 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/30329c02-c760-48d5-86f7-dd265325adb0-kubelet-config\") pod \"global-pull-secret-syncer-wz99q\" (UID: \"30329c02-c760-48d5-86f7-dd265325adb0\") " pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737963 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-run-ovn\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737963 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-host\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737992 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-cni-bin\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.738000 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-host\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.737992 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/30329c02-c760-48d5-86f7-dd265325adb0-kubelet-config\") pod \"global-pull-secret-syncer-wz99q\" (UID: \"30329c02-c760-48d5-86f7-dd265325adb0\") " pod="kube-system/global-pull-secret-syncer-wz99q" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.738009 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e720aa2-db14-40f6-b905-0155bcbd7809-console-config\") pod \"console-577678865d-sxpjq\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:31.737982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.738032 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-cni-bin\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.740009 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.738047 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:31.740009 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.738054 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e67d41d7-ae93-442b-b376-d6f23173df56-tmp\") pod \"console-5454b99889-gt2tx\" (UID: \"e67d41d7-ae93-442b-b376-d6f23173df56\") " pod="openshift-console/console-5454b99889-gt2tx" Nov 03 20:01:31.740009 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.738089 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-cni-netd\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.740009 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.738112 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e720aa2-db14-40f6-b905-0155bcbd7809-tmp\") pod \"console-577678865d-sxpjq\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:31.740009 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.738129 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/84404c7a-cc47-4e08-861b-a3b417f17e18-sys-fs\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:01:31.740009 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.738151 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-system-cni-dir\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.740009 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.738182 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sj4s\" (UniqueName: \"kubernetes.io/projected/0e720aa2-db14-40f6-b905-0155bcbd7809-kube-api-access-6sj4s\") pod \"console-577678865d-sxpjq\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:31.740009 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.738199 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e720aa2-db14-40f6-b905-0155bcbd7809-tmp\") pod \"console-577678865d-sxpjq\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:31.740009 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.738207 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/84404c7a-cc47-4e08-861b-a3b417f17e18-sys-fs\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:01:31.740009 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.738204 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-host-cni-netd\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.740009 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.738257 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e67d41d7-ae93-442b-b376-d6f23173df56-console-oauth-config\") pod \"console-5454b99889-gt2tx\" (UID: \"e67d41d7-ae93-442b-b376-d6f23173df56\") " pod="openshift-console/console-5454b99889-gt2tx" Nov 03 20:01:31.740009 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.738331 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e67d41d7-ae93-442b-b376-d6f23173df56-tmp\") pod \"console-5454b99889-gt2tx\" (UID: \"e67d41d7-ae93-442b-b376-d6f23173df56\") " pod="openshift-console/console-5454b99889-gt2tx" Nov 03 20:01:31.740009 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.738347 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/84404c7a-cc47-4e08-861b-a3b417f17e18-registration-dir\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:01:31.740009 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.738385 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/84404c7a-cc47-4e08-861b-a3b417f17e18-registration-dir\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:01:31.740009 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.738402 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-etc-openvswitch\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.740009 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.738424 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-run-openvswitch\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.740009 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.738440 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e67d41d7-ae93-442b-b376-d6f23173df56-console-config\") pod \"console-5454b99889-gt2tx\" (UID: \"e67d41d7-ae93-442b-b376-d6f23173df56\") " pod="openshift-console/console-5454b99889-gt2tx" Nov 03 20:01:31.740009 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.738443 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-etc-openvswitch\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.740009 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.738470 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-cnibin\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.740009 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.738490 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-run-openvswitch\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.740009 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.738500 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e67d41d7-ae93-442b-b376-d6f23173df56-trusted-ca-bundle\") pod \"console-5454b99889-gt2tx\" (UID: \"e67d41d7-ae93-442b-b376-d6f23173df56\") " pod="openshift-console/console-5454b99889-gt2tx" Nov 03 20:01:31.740009 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.738617 5857 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Nov 03 20:01:31.740890 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.740874 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e67d41d7-ae93-442b-b376-d6f23173df56-console-oauth-config\") pod \"console-5454b99889-gt2tx\" (UID: \"e67d41d7-ae93-442b-b376-d6f23173df56\") " pod="openshift-console/console-5454b99889-gt2tx" Nov 03 20:01:31.753780 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.753731 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Nov 03 20:01:31.753780 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.753733 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Nov 03 20:01:31.753909 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.753776 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Nov 03 20:01:31.753909 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.753747 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Nov 03 20:01:31.753909 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.753776 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Nov 03 20:01:31.754116 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.754100 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-4hs22\"" Nov 03 20:01:31.754159 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.754117 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Nov 03 20:01:31.754159 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.754148 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Nov 03 20:01:31.754240 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.754227 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Nov 03 20:01:31.754499 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.754478 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-6zq2q\"" Nov 03 20:01:31.754559 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.754543 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Nov 03 20:01:31.754639 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.754608 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Nov 03 20:01:31.754639 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.754615 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Nov 03 20:01:31.754639 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.754630 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-s9vpg\"" Nov 03 20:01:31.754765 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.754640 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-swft6\"" Nov 03 20:01:31.754765 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.754649 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-95hcs\"" Nov 03 20:01:31.754765 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.754657 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Nov 03 20:01:31.754765 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.754664 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-sbl24\"" Nov 03 20:01:31.754765 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.754677 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Nov 03 20:01:31.754765 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.754680 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Nov 03 20:01:31.754765 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.754711 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Nov 03 20:01:31.754979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.754811 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Nov 03 20:01:31.754979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.754849 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-zqcfj\"" Nov 03 20:01:31.754979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.754867 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-ktbdc\"" Nov 03 20:01:31.754979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.754884 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-4uep8qniusafg\"" Nov 03 20:01:31.754979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.754908 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3he3nqfq319mg\"" Nov 03 20:01:31.755107 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.754981 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Nov 03 20:01:31.756534 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.756521 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-web-config\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:31.756723 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.756707 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd8a2436-4362-4c11-9e4b-9e20b73094e6-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-lwkdp\" (UID: \"bd8a2436-4362-4c11-9e4b-9e20b73094e6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp" Nov 03 20:01:31.756843 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.756819 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/960e81d3-4bff-4a35-b6a8-edcd186c6c44-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-w78q9\" (UID: \"960e81d3-4bff-4a35-b6a8-edcd186c6c44\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-w78q9" Nov 03 20:01:31.757703 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.757685 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:31.757786 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.757770 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0c479f18-0308-403a-adf1-42575f8adfa2-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-kl7g8\" (UID: \"0c479f18-0308-403a-adf1-42575f8adfa2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kl7g8" Nov 03 20:01:31.757846 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.757772 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f1241d10-9647-4075-9091-19183e105d50-telemeter-client-tls\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:31.757921 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.757902 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-secret-grpc-tls\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:31.758124 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.758105 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e720aa2-db14-40f6-b905-0155bcbd7809-console-serving-cert\") pod \"console-577678865d-sxpjq\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:31.758387 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.758365 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4dbfce43-ac06-4413-92eb-f123614df91d-secret-metrics-server-tls\") pod \"metrics-server-748b9d444f-gwfk2\" (UID: \"4dbfce43-ac06-4413-92eb-f123614df91d\") " pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:01:31.758387 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.758380 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4dbfce43-ac06-4413-92eb-f123614df91d-client-ca-bundle\") pod \"metrics-server-748b9d444f-gwfk2\" (UID: \"4dbfce43-ac06-4413-92eb-f123614df91d\") " pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:01:31.758519 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.757998 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd8a2436-4362-4c11-9e4b-9e20b73094e6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-lwkdp\" (UID: \"bd8a2436-4362-4c11-9e4b-9e20b73094e6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp" Nov 03 20:01:31.758598 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.758549 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e67d41d7-ae93-442b-b376-d6f23173df56-console-serving-cert\") pod \"console-5454b99889-gt2tx\" (UID: \"e67d41d7-ae93-442b-b376-d6f23173df56\") " pod="openshift-console/console-5454b99889-gt2tx" Nov 03 20:01:31.759024 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.758994 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e720aa2-db14-40f6-b905-0155bcbd7809-console-config\") pod \"console-577678865d-sxpjq\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:31.759024 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.759017 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e67d41d7-ae93-442b-b376-d6f23173df56-console-config\") pod \"console-5454b99889-gt2tx\" (UID: \"e67d41d7-ae93-442b-b376-d6f23173df56\") " pod="openshift-console/console-5454b99889-gt2tx" Nov 03 20:01:31.759125 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.759117 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/26c31b1c-c3c5-4676-b71f-f44499e10a3b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:31.760499 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.760483 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-config-volume\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:31.760499 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.760491 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eb01d4b7-2af5-4493-af2c-8d90a120851f-node-exporter-tls\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:31.761688 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.761674 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f1241d10-9647-4075-9091-19183e105d50-secret-telemeter-client\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:31.761732 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.761704 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb01d4b7-2af5-4493-af2c-8d90a120851f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:31.761763 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.761744 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-secret-thanos-querier-tls\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:31.762815 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.762797 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:31.770259 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.770240 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2r7jg\"" Nov 03 20:01:31.772139 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.772122 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Nov 03 20:01:31.773597 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.772584 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-sd4tl\"" Nov 03 20:01:31.773597 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.772614 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rmlxz\"" Nov 03 20:01:31.773597 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.772897 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-d6hfg\"" Nov 03 20:01:31.777589 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.776405 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlv6z\" (UniqueName: \"kubernetes.io/projected/b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879-kube-api-access-dlv6z\") pod \"iptables-alerter-crqkf\" (UID: \"b7f8ead7-9bb3-4ac5-abaa-e92ee0e1a879\") " pod="openshift-network-operator/iptables-alerter-crqkf" Nov 03 20:01:31.777589 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.776647 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsxkj\" (UniqueName: \"kubernetes.io/projected/3699cbee-ee43-4504-bc3b-c4b3a7efbcbb-kube-api-access-fsxkj\") pod \"ovnkube-node-7246c\" (UID: \"3699cbee-ee43-4504-bc3b-c4b3a7efbcbb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:31.777589 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.777408 5857 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 03 20:01:31.777589 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:01:31.777454 5857 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-140-181.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:01:31.777589 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.777464 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddnm7\" (UniqueName: \"kubernetes.io/projected/ccbc5713-cd4c-455b-9162-f4ecfedde1f7-kube-api-access-ddnm7\") pod \"node-resolver-8t9mw\" (UID: \"ccbc5713-cd4c-455b-9162-f4ecfedde1f7\") " pod="openshift-dns/node-resolver-8t9mw" Nov 03 20:01:31.777908 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.777737 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7rwr\" (UniqueName: \"kubernetes.io/projected/a445b335-dfaf-41a2-afb5-e9ee45ec471f-kube-api-access-t7rwr\") pod \"multus-additional-cni-plugins-t5q7f\" (UID: \"a445b335-dfaf-41a2-afb5-e9ee45ec471f\") " pod="openshift-multus/multus-additional-cni-plugins-t5q7f" Nov 03 20:01:31.778814 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.777970 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7vcn\" (UniqueName: \"kubernetes.io/projected/f1241d10-9647-4075-9091-19183e105d50-kube-api-access-r7vcn\") pod \"telemeter-client-5c75c8599-kcxp6\" (UID: \"f1241d10-9647-4075-9091-19183e105d50\") " pod="openshift-monitoring/telemeter-client-5c75c8599-kcxp6" Nov 03 20:01:31.778814 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.777999 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r74cx\" (UniqueName: \"kubernetes.io/projected/4dbfce43-ac06-4413-92eb-f123614df91d-kube-api-access-r74cx\") pod \"metrics-server-748b9d444f-gwfk2\" (UID: \"4dbfce43-ac06-4413-92eb-f123614df91d\") " pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:01:31.778814 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.777974 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwhj2\" (UniqueName: \"kubernetes.io/projected/aae6331f-1f9f-43c8-9610-f554ddebf2e3-kube-api-access-nwhj2\") pod \"network-metrics-daemon-pslv9\" (UID: \"aae6331f-1f9f-43c8-9610-f554ddebf2e3\") " pod="openshift-multus/network-metrics-daemon-pslv9" Nov 03 20:01:31.778814 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.778089 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpcs7\" (UniqueName: \"kubernetes.io/projected/84404c7a-cc47-4e08-861b-a3b417f17e18-kube-api-access-jpcs7\") pod \"aws-ebs-csi-driver-node-96tv9\" (UID: \"84404c7a-cc47-4e08-861b-a3b417f17e18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-96tv9" Nov 03 20:01:31.778814 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.778209 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77q8n\" (UniqueName: \"kubernetes.io/projected/999ebe89-05a8-4bae-ba5b-b756dd69b073-kube-api-access-77q8n\") pod \"ingress-canary-pbv28\" (UID: \"999ebe89-05a8-4bae-ba5b-b756dd69b073\") " pod="openshift-ingress-canary/ingress-canary-pbv28" Nov 03 20:01:31.778814 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.778668 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsbqv\" (UniqueName: \"kubernetes.io/projected/5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2-kube-api-access-rsbqv\") pod \"network-check-target-x5gxd\" (UID: \"5ba2d30a-cdd9-47c3-a1fe-8bbd8b1110d2\") " pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:01:31.778814 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.778720 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjlrv\" (UniqueName: \"kubernetes.io/projected/22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9-kube-api-access-jjlrv\") pod \"insights-runtime-extractor-gt9b8\" (UID: \"22f4ca73-ade8-44d0-a45d-62ca0a9bcfb9\") " pod="openshift-insights/insights-runtime-extractor-gt9b8" Nov 03 20:01:31.778814 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.778730 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpqvp\" (UniqueName: \"kubernetes.io/projected/960e81d3-4bff-4a35-b6a8-edcd186c6c44-kube-api-access-jpqvp\") pod \"openshift-state-metrics-7bd7489957-w78q9\" (UID: \"960e81d3-4bff-4a35-b6a8-edcd186c6c44\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-w78q9" Nov 03 20:01:31.778814 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.778783 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqz58\" (UniqueName: \"kubernetes.io/projected/7acfd1d0-46c5-4c12-a419-597cc58d88f1-kube-api-access-nqz58\") pod \"dns-default-s2xtj\" (UID: \"7acfd1d0-46c5-4c12-a419-597cc58d88f1\") " pod="openshift-dns/dns-default-s2xtj" Nov 03 20:01:31.779264 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.779057 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zr4p\" (UniqueName: \"kubernetes.io/projected/bd8a2436-4362-4c11-9e4b-9e20b73094e6-kube-api-access-9zr4p\") pod \"kube-state-metrics-5dc8d7d89b-lwkdp\" (UID: \"bd8a2436-4362-4c11-9e4b-9e20b73094e6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lwkdp" Nov 03 20:01:31.779264 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.779087 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jjfg\" (UniqueName: \"kubernetes.io/projected/26c31b1c-c3c5-4676-b71f-f44499e10a3b-kube-api-access-5jjfg\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:31.779264 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.778978 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p6cc\" (UniqueName: \"kubernetes.io/projected/2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3-kube-api-access-9p6cc\") pod \"node-ca-ts79p\" (UID: \"2ae13e8f-66b1-4be0-a0fe-dd414d2ee6d3\") " pod="openshift-image-registry/node-ca-ts79p" Nov 03 20:01:31.779264 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.779182 5857 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 03 20:01:31.779264 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:01:31.779238 5857 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:01:31.779422 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.779153 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z65ln\" (UniqueName: \"kubernetes.io/projected/f5da7c0e-2db7-48fd-ac10-bccc095ef79e-kube-api-access-z65ln\") pod \"thanos-querier-75c5c6c675-9tqxn\" (UID: \"f5da7c0e-2db7-48fd-ac10-bccc095ef79e\") " pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:31.779422 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.779323 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Nov 03 20:01:31.779484 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.779418 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9272\" (UniqueName: \"kubernetes.io/projected/ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1-kube-api-access-d9272\") pod \"tuned-v224g\" (UID: \"ecfe1b48-bc22-471d-8a9e-f7f9cbc227d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v224g" Nov 03 20:01:31.779614 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.779586 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Nov 03 20:01:31.780198 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.780185 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shsdx\" (UniqueName: \"kubernetes.io/projected/eb01d4b7-2af5-4493-af2c-8d90a120851f-kube-api-access-shsdx\") pod \"node-exporter-pxws5\" (UID: \"eb01d4b7-2af5-4493-af2c-8d90a120851f\") " pod="openshift-monitoring/node-exporter-pxws5" Nov 03 20:01:31.780869 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.780854 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7acfd1d0-46c5-4c12-a419-597cc58d88f1-metrics-tls\") pod \"dns-default-s2xtj\" (UID: \"7acfd1d0-46c5-4c12-a419-597cc58d88f1\") " pod="openshift-dns/dns-default-s2xtj" Nov 03 20:01:31.787738 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.787717 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26c31b1c-c3c5-4676-b71f-f44499e10a3b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:01:31.790341 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.790322 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e67d41d7-ae93-442b-b376-d6f23173df56-trusted-ca-bundle\") pod \"console-5454b99889-gt2tx\" (UID: \"e67d41d7-ae93-442b-b376-d6f23173df56\") " pod="openshift-console/console-5454b99889-gt2tx" Nov 03 20:01:31.795869 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.795851 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc8z5\" (UniqueName: \"kubernetes.io/projected/19f9860c-9efc-4678-8c1e-393c723b4611-kube-api-access-wc8z5\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.796221 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.796201 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sj4s\" (UniqueName: \"kubernetes.io/projected/0e720aa2-db14-40f6-b905-0155bcbd7809-kube-api-access-6sj4s\") pod \"console-577678865d-sxpjq\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:31.797912 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.797894 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfd9g\" (UniqueName: \"kubernetes.io/projected/e67d41d7-ae93-442b-b376-d6f23173df56-kube-api-access-hfd9g\") pod \"console-5454b99889-gt2tx\" (UID: \"e67d41d7-ae93-442b-b376-d6f23173df56\") " pod="openshift-console/console-5454b99889-gt2tx" Nov 03 20:01:31.800886 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.800865 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7l96\" (UniqueName: \"kubernetes.io/projected/62a2d16f-a781-4b20-ae3e-323c123f9ac0-kube-api-access-f7l96\") pod \"prometheus-operator-9cd89b74c-v5lh8\" (UID: \"62a2d16f-a781-4b20-ae3e-323c123f9ac0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-v5lh8" Nov 03 20:01:31.839017 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.838990 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-system-cni-dir\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.839143 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.839024 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-cnibin\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.839143 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.839043 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-multus-socket-dir-parent\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.839143 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.839057 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-host-var-lib-cni-bin\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.839143 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.839075 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-etc-kubernetes\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.839143 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.839094 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-host-var-lib-kubelet\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.839143 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.839119 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-multus-cni-dir\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.839143 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.839126 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-system-cni-dir\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.839143 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.839134 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-cnibin\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.839499 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.839147 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-host-run-k8s-cni-cncf-io\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.839499 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.839152 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-multus-socket-dir-parent\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.839499 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.839170 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-host-run-multus-certs\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.839499 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.839152 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-etc-kubernetes\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.839499 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.839191 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-host-run-k8s-cni-cncf-io\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.839499 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.839157 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-host-var-lib-kubelet\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.839499 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.839193 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-multus-cni-dir\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.839499 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.839134 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-host-var-lib-cni-bin\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.839499 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.839225 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-host-run-netns\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.839499 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.839230 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-host-run-multus-certs\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.839499 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.839249 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-multus-conf-dir\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.839499 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.839251 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-host-run-netns\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.839499 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.839298 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-multus-conf-dir\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.839499 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.839339 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-host-var-lib-cni-multus\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.839499 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.839365 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-hostroot\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.839499 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.839436 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-host-var-lib-cni-multus\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.839499 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.839470 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/19f9860c-9efc-4678-8c1e-393c723b4611-hostroot\") pod \"multus-sjn97\" (UID: \"19f9860c-9efc-4678-8c1e-393c723b4611\") " pod="openshift-multus/multus-sjn97" Nov 03 20:01:31.941943 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:31.941917 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5454b99889-gt2tx" Nov 03 20:01:32.311967 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:32.311932 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5454b99889-gt2tx"] Nov 03 20:01:32.315751 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:32.315708 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode67d41d7_ae93_442b_b376_d6f23173df56.slice/crio-50f350061ac54703021b6f161dc9d34664f2b104d56ed91859769618cdad76c2 WatchSource:0}: Error finding container 50f350061ac54703021b6f161dc9d34664f2b104d56ed91859769618cdad76c2: Status 404 returned error can't find the container with id 50f350061ac54703021b6f161dc9d34664f2b104d56ed91859769618cdad76c2 Nov 03 20:01:32.674273 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:32.674202 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5454b99889-gt2tx" event={"ID":"e67d41d7-ae93-442b-b376-d6f23173df56","Type":"ContainerStarted","Data":"1e0808b5774630fdedeb4006f747efcf267f42f5757f7e882a8188a32232b57f"} Nov 03 20:01:32.674273 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:32.674257 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5454b99889-gt2tx" event={"ID":"e67d41d7-ae93-442b-b376-d6f23173df56","Type":"ContainerStarted","Data":"50f350061ac54703021b6f161dc9d34664f2b104d56ed91859769618cdad76c2"} Nov 03 20:01:32.715474 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:32.715447 5857 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xgdct" Nov 03 20:01:33.494781 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:33.494752 5857 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-s2xtj" Nov 03 20:01:33.538794 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:33.538770 5857 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5454b99889-gt2tx" Nov 03 20:01:33.544329 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:33.544307 5857 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5454b99889-gt2tx" Nov 03 20:01:33.679259 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:33.679234 5857 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5454b99889-gt2tx" Nov 03 20:01:33.683039 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:33.683020 5857 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5454b99889-gt2tx" Nov 03 20:01:33.851519 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:33.851448 5857 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:33.862354 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:33.862295 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-5454b99889-gt2tx" podStartSLOduration=3.862278433 podStartE2EDuration="3.862278433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:01:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:01:33.861629019 +0000 UTC m=+3.428519167" watchObservedRunningTime="2026-11-03 20:01:33.862278433 +0000 UTC m=+3.429168582" Nov 03 20:01:33.900315 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:33.900281 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-577678865d-sxpjq"] Nov 03 20:01:34.418500 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:34.418467 5857 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kl7g8" Nov 03 20:01:34.650235 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:34.650201 5857 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:34.655902 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:34.655880 5857 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-75c5c6c675-9tqxn" Nov 03 20:01:36.400831 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:36.400795 5857 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:01:36.982826 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:36.982793 5857 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:37.669079 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:37.669045 5857 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:01:37.957779 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:37.957732 5857 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:38.091861 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:38.091836 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-59fc69cc99-ktxbb"] Nov 03 20:01:38.095341 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:38.095324 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59fc69cc99-ktxbb" Nov 03 20:01:38.193323 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:38.193294 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59fc69cc99-ktxbb"] Nov 03 20:01:38.197837 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:38.197811 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/291938d2-446e-4474-af93-1ac6e8bc6207-service-ca\") pod \"console-59fc69cc99-ktxbb\" (UID: \"291938d2-446e-4474-af93-1ac6e8bc6207\") " pod="openshift-console/console-59fc69cc99-ktxbb" Nov 03 20:01:38.197991 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:38.197851 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/291938d2-446e-4474-af93-1ac6e8bc6207-console-oauth-config\") pod \"console-59fc69cc99-ktxbb\" (UID: \"291938d2-446e-4474-af93-1ac6e8bc6207\") " pod="openshift-console/console-59fc69cc99-ktxbb" Nov 03 20:01:38.197991 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:38.197939 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/291938d2-446e-4474-af93-1ac6e8bc6207-console-config\") pod \"console-59fc69cc99-ktxbb\" (UID: \"291938d2-446e-4474-af93-1ac6e8bc6207\") " pod="openshift-console/console-59fc69cc99-ktxbb" Nov 03 20:01:38.197991 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:38.197982 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/291938d2-446e-4474-af93-1ac6e8bc6207-tmp\") pod \"console-59fc69cc99-ktxbb\" (UID: \"291938d2-446e-4474-af93-1ac6e8bc6207\") " pod="openshift-console/console-59fc69cc99-ktxbb" Nov 03 20:01:38.198140 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:38.198001 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/291938d2-446e-4474-af93-1ac6e8bc6207-oauth-serving-cert\") pod \"console-59fc69cc99-ktxbb\" (UID: \"291938d2-446e-4474-af93-1ac6e8bc6207\") " pod="openshift-console/console-59fc69cc99-ktxbb" Nov 03 20:01:38.198140 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:38.198125 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/291938d2-446e-4474-af93-1ac6e8bc6207-trusted-ca-bundle\") pod \"console-59fc69cc99-ktxbb\" (UID: \"291938d2-446e-4474-af93-1ac6e8bc6207\") " pod="openshift-console/console-59fc69cc99-ktxbb" Nov 03 20:01:38.198249 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:38.198155 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkhts\" (UniqueName: \"kubernetes.io/projected/291938d2-446e-4474-af93-1ac6e8bc6207-kube-api-access-bkhts\") pod \"console-59fc69cc99-ktxbb\" (UID: \"291938d2-446e-4474-af93-1ac6e8bc6207\") " pod="openshift-console/console-59fc69cc99-ktxbb" Nov 03 20:01:38.198249 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:38.198177 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/291938d2-446e-4474-af93-1ac6e8bc6207-console-serving-cert\") pod \"console-59fc69cc99-ktxbb\" (UID: \"291938d2-446e-4474-af93-1ac6e8bc6207\") " pod="openshift-console/console-59fc69cc99-ktxbb" Nov 03 20:01:38.299307 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:38.299225 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/291938d2-446e-4474-af93-1ac6e8bc6207-console-config\") pod \"console-59fc69cc99-ktxbb\" (UID: \"291938d2-446e-4474-af93-1ac6e8bc6207\") " pod="openshift-console/console-59fc69cc99-ktxbb" Nov 03 20:01:38.299307 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:38.299265 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/291938d2-446e-4474-af93-1ac6e8bc6207-tmp\") pod \"console-59fc69cc99-ktxbb\" (UID: \"291938d2-446e-4474-af93-1ac6e8bc6207\") " pod="openshift-console/console-59fc69cc99-ktxbb" Nov 03 20:01:38.299307 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:38.299283 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/291938d2-446e-4474-af93-1ac6e8bc6207-oauth-serving-cert\") pod \"console-59fc69cc99-ktxbb\" (UID: \"291938d2-446e-4474-af93-1ac6e8bc6207\") " pod="openshift-console/console-59fc69cc99-ktxbb" Nov 03 20:01:38.299553 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:38.299325 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/291938d2-446e-4474-af93-1ac6e8bc6207-trusted-ca-bundle\") pod \"console-59fc69cc99-ktxbb\" (UID: \"291938d2-446e-4474-af93-1ac6e8bc6207\") " pod="openshift-console/console-59fc69cc99-ktxbb" Nov 03 20:01:38.299553 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:38.299357 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkhts\" (UniqueName: \"kubernetes.io/projected/291938d2-446e-4474-af93-1ac6e8bc6207-kube-api-access-bkhts\") pod \"console-59fc69cc99-ktxbb\" (UID: \"291938d2-446e-4474-af93-1ac6e8bc6207\") " pod="openshift-console/console-59fc69cc99-ktxbb" Nov 03 20:01:38.299553 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:38.299388 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/291938d2-446e-4474-af93-1ac6e8bc6207-console-serving-cert\") pod \"console-59fc69cc99-ktxbb\" (UID: \"291938d2-446e-4474-af93-1ac6e8bc6207\") " pod="openshift-console/console-59fc69cc99-ktxbb" Nov 03 20:01:38.299553 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:38.299427 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/291938d2-446e-4474-af93-1ac6e8bc6207-service-ca\") pod \"console-59fc69cc99-ktxbb\" (UID: \"291938d2-446e-4474-af93-1ac6e8bc6207\") " pod="openshift-console/console-59fc69cc99-ktxbb" Nov 03 20:01:38.299918 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:38.299887 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/291938d2-446e-4474-af93-1ac6e8bc6207-console-oauth-config\") pod \"console-59fc69cc99-ktxbb\" (UID: \"291938d2-446e-4474-af93-1ac6e8bc6207\") " pod="openshift-console/console-59fc69cc99-ktxbb" Nov 03 20:01:38.300189 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:38.300115 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/291938d2-446e-4474-af93-1ac6e8bc6207-tmp\") pod \"console-59fc69cc99-ktxbb\" (UID: \"291938d2-446e-4474-af93-1ac6e8bc6207\") " pod="openshift-console/console-59fc69cc99-ktxbb" Nov 03 20:01:38.300546 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:38.300519 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/291938d2-446e-4474-af93-1ac6e8bc6207-console-config\") pod \"console-59fc69cc99-ktxbb\" (UID: \"291938d2-446e-4474-af93-1ac6e8bc6207\") " pod="openshift-console/console-59fc69cc99-ktxbb" Nov 03 20:01:38.300714 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:38.300619 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/291938d2-446e-4474-af93-1ac6e8bc6207-oauth-serving-cert\") pod \"console-59fc69cc99-ktxbb\" (UID: \"291938d2-446e-4474-af93-1ac6e8bc6207\") " pod="openshift-console/console-59fc69cc99-ktxbb" Nov 03 20:01:38.301235 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:38.300937 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/291938d2-446e-4474-af93-1ac6e8bc6207-service-ca\") pod \"console-59fc69cc99-ktxbb\" (UID: \"291938d2-446e-4474-af93-1ac6e8bc6207\") " pod="openshift-console/console-59fc69cc99-ktxbb" Nov 03 20:01:38.301235 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:38.300935 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/291938d2-446e-4474-af93-1ac6e8bc6207-trusted-ca-bundle\") pod \"console-59fc69cc99-ktxbb\" (UID: \"291938d2-446e-4474-af93-1ac6e8bc6207\") " pod="openshift-console/console-59fc69cc99-ktxbb" Nov 03 20:01:38.305356 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:38.305323 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/291938d2-446e-4474-af93-1ac6e8bc6207-console-serving-cert\") pod \"console-59fc69cc99-ktxbb\" (UID: \"291938d2-446e-4474-af93-1ac6e8bc6207\") " pod="openshift-console/console-59fc69cc99-ktxbb" Nov 03 20:01:38.306805 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:38.306785 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/291938d2-446e-4474-af93-1ac6e8bc6207-console-oauth-config\") pod \"console-59fc69cc99-ktxbb\" (UID: \"291938d2-446e-4474-af93-1ac6e8bc6207\") " pod="openshift-console/console-59fc69cc99-ktxbb" Nov 03 20:01:38.369649 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:38.369629 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkhts\" (UniqueName: \"kubernetes.io/projected/291938d2-446e-4474-af93-1ac6e8bc6207-kube-api-access-bkhts\") pod \"console-59fc69cc99-ktxbb\" (UID: \"291938d2-446e-4474-af93-1ac6e8bc6207\") " pod="openshift-console/console-59fc69cc99-ktxbb" Nov 03 20:01:38.406794 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:38.406767 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59fc69cc99-ktxbb" Nov 03 20:01:38.789585 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:38.789536 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59fc69cc99-ktxbb"] Nov 03 20:01:38.792236 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:01:38.792211 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod291938d2_446e_4474_af93_1ac6e8bc6207.slice/crio-ae3236195a50b31bbb75267d594e869e57f85c8e47167e35215721bccf312aa8 WatchSource:0}: Error finding container ae3236195a50b31bbb75267d594e869e57f85c8e47167e35215721bccf312aa8: Status 404 returned error can't find the container with id ae3236195a50b31bbb75267d594e869e57f85c8e47167e35215721bccf312aa8 Nov 03 20:01:39.700896 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:39.700871 5857 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:39.701118 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:39.701052 5857 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 03 20:01:39.705217 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:39.705177 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59fc69cc99-ktxbb" event={"ID":"291938d2-446e-4474-af93-1ac6e8bc6207","Type":"ContainerStarted","Data":"69af7f1347bee5f8664ec90c50e9007ee55afddb754f7eb2a5d02b257a315059"} Nov 03 20:01:39.705345 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:39.705240 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59fc69cc99-ktxbb" event={"ID":"291938d2-446e-4474-af93-1ac6e8bc6207","Type":"ContainerStarted","Data":"ae3236195a50b31bbb75267d594e869e57f85c8e47167e35215721bccf312aa8"} Nov 03 20:01:39.823857 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:39.823768 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-59fc69cc99-ktxbb" podStartSLOduration=1.823723566 podStartE2EDuration="1.823723566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:01:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:01:39.823004377 +0000 UTC m=+9.389894518" watchObservedRunningTime="2026-11-03 20:01:39.823723566 +0000 UTC m=+9.390613715" Nov 03 20:01:40.896900 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:40.896869 5857 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:01:43.816711 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:43.816681 5857 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59fc69cc99-ktxbb" Nov 03 20:01:46.793210 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:46.793179 5857 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59fc69cc99-ktxbb" Nov 03 20:01:46.797827 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:46.797803 5857 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59fc69cc99-ktxbb" Nov 03 20:01:47.690197 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:47.690162 5857 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7246c" Nov 03 20:01:47.740083 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:47.740059 5857 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59fc69cc99-ktxbb" Nov 03 20:01:47.910041 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:47.910008 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5454b99889-gt2tx"] Nov 03 20:01:49.499054 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:01:49.499021 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:01:58.920775 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:58.920728 5857 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-577678865d-sxpjq" podUID="0e720aa2-db14-40f6-b905-0155bcbd7809" containerName="console" containerID="cri-o://826225c582774b96e2b4de92800d0ea0d12e7b7353107890337a0a2160334020" gracePeriod=15 Nov 03 20:01:59.181315 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:59.181257 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:59.287504 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:59.287461 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0e720aa2-db14-40f6-b905-0155bcbd7809-console-config\" (UniqueName: \"kubernetes.io/configmap/0e720aa2-db14-40f6-b905-0155bcbd7809-console-config\") pod \"0e720aa2-db14-40f6-b905-0155bcbd7809\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " Nov 03 20:01:59.287504 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:59.287510 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0e720aa2-db14-40f6-b905-0155bcbd7809-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e720aa2-db14-40f6-b905-0155bcbd7809-console-serving-cert\") pod \"0e720aa2-db14-40f6-b905-0155bcbd7809\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " Nov 03 20:01:59.287772 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:59.287580 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0e720aa2-db14-40f6-b905-0155bcbd7809-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e720aa2-db14-40f6-b905-0155bcbd7809-console-oauth-config\") pod \"0e720aa2-db14-40f6-b905-0155bcbd7809\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " Nov 03 20:01:59.287772 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:59.287636 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0e720aa2-db14-40f6-b905-0155bcbd7809-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e720aa2-db14-40f6-b905-0155bcbd7809-oauth-serving-cert\") pod \"0e720aa2-db14-40f6-b905-0155bcbd7809\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " Nov 03 20:01:59.287772 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:59.287663 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0e720aa2-db14-40f6-b905-0155bcbd7809-tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e720aa2-db14-40f6-b905-0155bcbd7809-tmp\") pod \"0e720aa2-db14-40f6-b905-0155bcbd7809\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " Nov 03 20:01:59.287772 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:59.287705 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0e720aa2-db14-40f6-b905-0155bcbd7809-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e720aa2-db14-40f6-b905-0155bcbd7809-service-ca\") pod \"0e720aa2-db14-40f6-b905-0155bcbd7809\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " Nov 03 20:01:59.287978 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:59.287878 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0e720aa2-db14-40f6-b905-0155bcbd7809-kube-api-access-6sj4s\" (UniqueName: \"kubernetes.io/projected/0e720aa2-db14-40f6-b905-0155bcbd7809-kube-api-access-6sj4s\") pod \"0e720aa2-db14-40f6-b905-0155bcbd7809\" (UID: \"0e720aa2-db14-40f6-b905-0155bcbd7809\") " Nov 03 20:01:59.288034 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:59.287964 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e720aa2-db14-40f6-b905-0155bcbd7809-tmp" pod "0e720aa2-db14-40f6-b905-0155bcbd7809" (UID: "0e720aa2-db14-40f6-b905-0155bcbd7809"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:01:59.288034 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:59.288002 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e720aa2-db14-40f6-b905-0155bcbd7809-console-config" pod "0e720aa2-db14-40f6-b905-0155bcbd7809" (UID: "0e720aa2-db14-40f6-b905-0155bcbd7809"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:01:59.288107 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:59.288077 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e720aa2-db14-40f6-b905-0155bcbd7809-service-ca" pod "0e720aa2-db14-40f6-b905-0155bcbd7809" (UID: "0e720aa2-db14-40f6-b905-0155bcbd7809"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:01:59.288107 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:59.288090 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e720aa2-db14-40f6-b905-0155bcbd7809-oauth-serving-cert" pod "0e720aa2-db14-40f6-b905-0155bcbd7809" (UID: "0e720aa2-db14-40f6-b905-0155bcbd7809"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:01:59.288260 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:59.288237 5857 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e720aa2-db14-40f6-b905-0155bcbd7809-console-config\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:01:59.288322 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:59.288266 5857 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e720aa2-db14-40f6-b905-0155bcbd7809-oauth-serving-cert\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:01:59.288322 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:59.288278 5857 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e720aa2-db14-40f6-b905-0155bcbd7809-tmp\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:01:59.288322 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:59.288286 5857 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e720aa2-db14-40f6-b905-0155bcbd7809-service-ca\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:01:59.290071 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:59.290039 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e720aa2-db14-40f6-b905-0155bcbd7809-console-oauth-config" pod "0e720aa2-db14-40f6-b905-0155bcbd7809" (UID: "0e720aa2-db14-40f6-b905-0155bcbd7809"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:01:59.290170 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:59.290074 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e720aa2-db14-40f6-b905-0155bcbd7809-kube-api-access-6sj4s" pod "0e720aa2-db14-40f6-b905-0155bcbd7809" (UID: "0e720aa2-db14-40f6-b905-0155bcbd7809"). InnerVolumeSpecName "kube-api-access-6sj4s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:01:59.290170 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:59.290088 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e720aa2-db14-40f6-b905-0155bcbd7809-console-serving-cert" pod "0e720aa2-db14-40f6-b905-0155bcbd7809" (UID: "0e720aa2-db14-40f6-b905-0155bcbd7809"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:01:59.389243 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:59.389208 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6sj4s\" (UniqueName: \"kubernetes.io/projected/0e720aa2-db14-40f6-b905-0155bcbd7809-kube-api-access-6sj4s\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:01:59.389243 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:59.389238 5857 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e720aa2-db14-40f6-b905-0155bcbd7809-console-serving-cert\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:01:59.389456 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:59.389251 5857 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e720aa2-db14-40f6-b905-0155bcbd7809-console-oauth-config\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:01:59.780762 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:59.780720 5857 generic.go:356] "Generic (PLEG): container finished" podID="0e720aa2-db14-40f6-b905-0155bcbd7809" containerID="826225c582774b96e2b4de92800d0ea0d12e7b7353107890337a0a2160334020" exitCode=0 Nov 03 20:01:59.780932 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:59.780778 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-577678865d-sxpjq" Nov 03 20:01:59.780932 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:59.780769 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-577678865d-sxpjq" event={"ID":"0e720aa2-db14-40f6-b905-0155bcbd7809","Type":"ContainerDied","Data":"826225c582774b96e2b4de92800d0ea0d12e7b7353107890337a0a2160334020"} Nov 03 20:01:59.780932 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:59.780895 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-577678865d-sxpjq" event={"ID":"0e720aa2-db14-40f6-b905-0155bcbd7809","Type":"ContainerDied","Data":"a0fbad3549f5a9ee433e12d0ecb908c828d95b925fe17e43123d72f87a9485db"} Nov 03 20:01:59.780932 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:59.780918 5857 scope.go:122] "RemoveContainer" containerID="826225c582774b96e2b4de92800d0ea0d12e7b7353107890337a0a2160334020" Nov 03 20:01:59.789673 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:59.789654 5857 scope.go:122] "RemoveContainer" containerID="826225c582774b96e2b4de92800d0ea0d12e7b7353107890337a0a2160334020" Nov 03 20:01:59.789965 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:01:59.789945 5857 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"826225c582774b96e2b4de92800d0ea0d12e7b7353107890337a0a2160334020\": container with ID starting with 826225c582774b96e2b4de92800d0ea0d12e7b7353107890337a0a2160334020 not found: ID does not exist" containerID="826225c582774b96e2b4de92800d0ea0d12e7b7353107890337a0a2160334020" Nov 03 20:01:59.790017 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:59.789974 5857 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"826225c582774b96e2b4de92800d0ea0d12e7b7353107890337a0a2160334020"} err="failed to get container status \"826225c582774b96e2b4de92800d0ea0d12e7b7353107890337a0a2160334020\": rpc error: code = NotFound desc = could not find container \"826225c582774b96e2b4de92800d0ea0d12e7b7353107890337a0a2160334020\": container with ID starting with 826225c582774b96e2b4de92800d0ea0d12e7b7353107890337a0a2160334020 not found: ID does not exist" Nov 03 20:01:59.942742 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:59.942706 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-577678865d-sxpjq"] Nov 03 20:01:59.992246 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:01:59.992222 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-577678865d-sxpjq"] Nov 03 20:02:00.572009 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:00.571967 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0e720aa2-db14-40f6-b905-0155bcbd7809" path="/var/lib/kubelet/pods/0e720aa2-db14-40f6-b905-0155bcbd7809/volumes" Nov 03 20:02:00.901412 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:00.901329 5857 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:02:00.905122 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:00.905098 5857 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-748b9d444f-gwfk2" Nov 03 20:02:06.404008 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:06.403974 5857 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-x5gxd" Nov 03 20:02:12.930288 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:12.930242 5857 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-5454b99889-gt2tx" podUID="e67d41d7-ae93-442b-b376-d6f23173df56" containerName="console" containerID="cri-o://1e0808b5774630fdedeb4006f747efcf267f42f5757f7e882a8188a32232b57f" gracePeriod=15 Nov 03 20:02:13.180874 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.180817 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5454b99889-gt2tx" Nov 03 20:02:13.197151 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.197130 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e67d41d7-ae93-442b-b376-d6f23173df56-tmp\" (UniqueName: \"kubernetes.io/empty-dir/e67d41d7-ae93-442b-b376-d6f23173df56-tmp\") pod \"e67d41d7-ae93-442b-b376-d6f23173df56\" (UID: \"e67d41d7-ae93-442b-b376-d6f23173df56\") " Nov 03 20:02:13.197228 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.197168 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e67d41d7-ae93-442b-b376-d6f23173df56-console-config\" (UniqueName: \"kubernetes.io/configmap/e67d41d7-ae93-442b-b376-d6f23173df56-console-config\") pod \"e67d41d7-ae93-442b-b376-d6f23173df56\" (UID: \"e67d41d7-ae93-442b-b376-d6f23173df56\") " Nov 03 20:02:13.197228 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.197194 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e67d41d7-ae93-442b-b376-d6f23173df56-kube-api-access-hfd9g\" (UniqueName: \"kubernetes.io/projected/e67d41d7-ae93-442b-b376-d6f23173df56-kube-api-access-hfd9g\") pod \"e67d41d7-ae93-442b-b376-d6f23173df56\" (UID: \"e67d41d7-ae93-442b-b376-d6f23173df56\") " Nov 03 20:02:13.197336 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.197240 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e67d41d7-ae93-442b-b376-d6f23173df56-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e67d41d7-ae93-442b-b376-d6f23173df56-console-oauth-config\") pod \"e67d41d7-ae93-442b-b376-d6f23173df56\" (UID: \"e67d41d7-ae93-442b-b376-d6f23173df56\") " Nov 03 20:02:13.197336 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.197308 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e67d41d7-ae93-442b-b376-d6f23173df56-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e67d41d7-ae93-442b-b376-d6f23173df56-console-serving-cert\") pod \"e67d41d7-ae93-442b-b376-d6f23173df56\" (UID: \"e67d41d7-ae93-442b-b376-d6f23173df56\") " Nov 03 20:02:13.197499 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.197339 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e67d41d7-ae93-442b-b376-d6f23173df56-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e67d41d7-ae93-442b-b376-d6f23173df56-oauth-serving-cert\") pod \"e67d41d7-ae93-442b-b376-d6f23173df56\" (UID: \"e67d41d7-ae93-442b-b376-d6f23173df56\") " Nov 03 20:02:13.197499 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.197383 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e67d41d7-ae93-442b-b376-d6f23173df56-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e67d41d7-ae93-442b-b376-d6f23173df56-trusted-ca-bundle\") pod \"e67d41d7-ae93-442b-b376-d6f23173df56\" (UID: \"e67d41d7-ae93-442b-b376-d6f23173df56\") " Nov 03 20:02:13.197499 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.197435 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e67d41d7-ae93-442b-b376-d6f23173df56-tmp" pod "e67d41d7-ae93-442b-b376-d6f23173df56" (UID: "e67d41d7-ae93-442b-b376-d6f23173df56"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:02:13.197680 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.197517 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e67d41d7-ae93-442b-b376-d6f23173df56-console-config" pod "e67d41d7-ae93-442b-b376-d6f23173df56" (UID: "e67d41d7-ae93-442b-b376-d6f23173df56"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:02:13.197680 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.197542 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e67d41d7-ae93-442b-b376-d6f23173df56-service-ca\" (UniqueName: \"kubernetes.io/configmap/e67d41d7-ae93-442b-b376-d6f23173df56-service-ca\") pod \"e67d41d7-ae93-442b-b376-d6f23173df56\" (UID: \"e67d41d7-ae93-442b-b376-d6f23173df56\") " Nov 03 20:02:13.197839 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.197814 5857 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e67d41d7-ae93-442b-b376-d6f23173df56-tmp\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:02:13.197907 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.197847 5857 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e67d41d7-ae93-442b-b376-d6f23173df56-console-config\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:02:13.197907 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.197882 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e67d41d7-ae93-442b-b376-d6f23173df56-trusted-ca-bundle" pod "e67d41d7-ae93-442b-b376-d6f23173df56" (UID: "e67d41d7-ae93-442b-b376-d6f23173df56"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:02:13.198004 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.197923 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e67d41d7-ae93-442b-b376-d6f23173df56-service-ca" pod "e67d41d7-ae93-442b-b376-d6f23173df56" (UID: "e67d41d7-ae93-442b-b376-d6f23173df56"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:02:13.198293 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.198040 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e67d41d7-ae93-442b-b376-d6f23173df56-oauth-serving-cert" pod "e67d41d7-ae93-442b-b376-d6f23173df56" (UID: "e67d41d7-ae93-442b-b376-d6f23173df56"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:02:13.201685 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.201654 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e67d41d7-ae93-442b-b376-d6f23173df56-console-oauth-config" pod "e67d41d7-ae93-442b-b376-d6f23173df56" (UID: "e67d41d7-ae93-442b-b376-d6f23173df56"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:02:13.201791 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.201710 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e67d41d7-ae93-442b-b376-d6f23173df56-kube-api-access-hfd9g" pod "e67d41d7-ae93-442b-b376-d6f23173df56" (UID: "e67d41d7-ae93-442b-b376-d6f23173df56"). InnerVolumeSpecName "kube-api-access-hfd9g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:02:13.203069 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.203023 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e67d41d7-ae93-442b-b376-d6f23173df56-console-serving-cert" pod "e67d41d7-ae93-442b-b376-d6f23173df56" (UID: "e67d41d7-ae93-442b-b376-d6f23173df56"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:02:13.298549 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.298490 5857 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e67d41d7-ae93-442b-b376-d6f23173df56-trusted-ca-bundle\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:02:13.298549 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.298529 5857 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e67d41d7-ae93-442b-b376-d6f23173df56-service-ca\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:02:13.298549 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.298544 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfd9g\" (UniqueName: \"kubernetes.io/projected/e67d41d7-ae93-442b-b376-d6f23173df56-kube-api-access-hfd9g\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:02:13.299379 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.298559 5857 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e67d41d7-ae93-442b-b376-d6f23173df56-console-oauth-config\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:02:13.299379 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.298603 5857 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e67d41d7-ae93-442b-b376-d6f23173df56-console-serving-cert\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:02:13.299379 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.298617 5857 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e67d41d7-ae93-442b-b376-d6f23173df56-oauth-serving-cert\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:02:13.691391 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.691358 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f4d987d9c-tl2cx"] Nov 03 20:02:13.691747 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.691732 5857 cpu_manager.go:414] "containerMap: removing container" podUID="e67d41d7-ae93-442b-b376-d6f23173df56" containerName="console" Nov 03 20:02:13.691799 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.691749 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e67d41d7-ae93-442b-b376-d6f23173df56" containerName="console" Nov 03 20:02:13.691799 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.691763 5857 cpu_manager.go:414] "containerMap: removing container" podUID="0e720aa2-db14-40f6-b905-0155bcbd7809" containerName="console" Nov 03 20:02:13.691799 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.691768 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0e720aa2-db14-40f6-b905-0155bcbd7809" containerName="console" Nov 03 20:02:13.691889 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.691831 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="e67d41d7-ae93-442b-b376-d6f23173df56" containerName="console" Nov 03 20:02:13.691889 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.691841 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="0e720aa2-db14-40f6-b905-0155bcbd7809" containerName="console" Nov 03 20:02:13.693726 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.693709 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4d987d9c-tl2cx" Nov 03 20:02:13.795911 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.795871 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f4d987d9c-tl2cx"] Nov 03 20:02:13.803255 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.803219 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e21a273-b5cb-4359-a833-ee8ef222504c-service-ca\") pod \"console-6f4d987d9c-tl2cx\" (UID: \"5e21a273-b5cb-4359-a833-ee8ef222504c\") " pod="openshift-console/console-6f4d987d9c-tl2cx" Nov 03 20:02:13.803255 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.803251 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e21a273-b5cb-4359-a833-ee8ef222504c-tmp\") pod \"console-6f4d987d9c-tl2cx\" (UID: \"5e21a273-b5cb-4359-a833-ee8ef222504c\") " pod="openshift-console/console-6f4d987d9c-tl2cx" Nov 03 20:02:13.803428 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.803306 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e21a273-b5cb-4359-a833-ee8ef222504c-console-serving-cert\") pod \"console-6f4d987d9c-tl2cx\" (UID: \"5e21a273-b5cb-4359-a833-ee8ef222504c\") " pod="openshift-console/console-6f4d987d9c-tl2cx" Nov 03 20:02:13.803463 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.803420 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e21a273-b5cb-4359-a833-ee8ef222504c-console-config\") pod \"console-6f4d987d9c-tl2cx\" (UID: \"5e21a273-b5cb-4359-a833-ee8ef222504c\") " pod="openshift-console/console-6f4d987d9c-tl2cx" Nov 03 20:02:13.803556 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.803536 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e21a273-b5cb-4359-a833-ee8ef222504c-trusted-ca-bundle\") pod \"console-6f4d987d9c-tl2cx\" (UID: \"5e21a273-b5cb-4359-a833-ee8ef222504c\") " pod="openshift-console/console-6f4d987d9c-tl2cx" Nov 03 20:02:13.803632 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.803588 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e21a273-b5cb-4359-a833-ee8ef222504c-console-oauth-config\") pod \"console-6f4d987d9c-tl2cx\" (UID: \"5e21a273-b5cb-4359-a833-ee8ef222504c\") " pod="openshift-console/console-6f4d987d9c-tl2cx" Nov 03 20:02:13.803632 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.803607 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2647\" (UniqueName: \"kubernetes.io/projected/5e21a273-b5cb-4359-a833-ee8ef222504c-kube-api-access-s2647\") pod \"console-6f4d987d9c-tl2cx\" (UID: \"5e21a273-b5cb-4359-a833-ee8ef222504c\") " pod="openshift-console/console-6f4d987d9c-tl2cx" Nov 03 20:02:13.803740 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.803722 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e21a273-b5cb-4359-a833-ee8ef222504c-oauth-serving-cert\") pod \"console-6f4d987d9c-tl2cx\" (UID: \"5e21a273-b5cb-4359-a833-ee8ef222504c\") " pod="openshift-console/console-6f4d987d9c-tl2cx" Nov 03 20:02:13.834225 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.834193 5857 generic.go:356] "Generic (PLEG): container finished" podID="e67d41d7-ae93-442b-b376-d6f23173df56" containerID="1e0808b5774630fdedeb4006f747efcf267f42f5757f7e882a8188a32232b57f" exitCode=0 Nov 03 20:02:13.834387 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.834261 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5454b99889-gt2tx" Nov 03 20:02:13.834387 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.834286 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5454b99889-gt2tx" event={"ID":"e67d41d7-ae93-442b-b376-d6f23173df56","Type":"ContainerDied","Data":"1e0808b5774630fdedeb4006f747efcf267f42f5757f7e882a8188a32232b57f"} Nov 03 20:02:13.834387 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.834349 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5454b99889-gt2tx" event={"ID":"e67d41d7-ae93-442b-b376-d6f23173df56","Type":"ContainerDied","Data":"50f350061ac54703021b6f161dc9d34664f2b104d56ed91859769618cdad76c2"} Nov 03 20:02:13.834387 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.834372 5857 scope.go:122] "RemoveContainer" containerID="1e0808b5774630fdedeb4006f747efcf267f42f5757f7e882a8188a32232b57f" Nov 03 20:02:13.843627 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.843603 5857 scope.go:122] "RemoveContainer" containerID="1e0808b5774630fdedeb4006f747efcf267f42f5757f7e882a8188a32232b57f" Nov 03 20:02:13.843891 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:02:13.843873 5857 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e0808b5774630fdedeb4006f747efcf267f42f5757f7e882a8188a32232b57f\": container with ID starting with 1e0808b5774630fdedeb4006f747efcf267f42f5757f7e882a8188a32232b57f not found: ID does not exist" containerID="1e0808b5774630fdedeb4006f747efcf267f42f5757f7e882a8188a32232b57f" Nov 03 20:02:13.843965 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.843904 5857 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e0808b5774630fdedeb4006f747efcf267f42f5757f7e882a8188a32232b57f"} err="failed to get container status \"1e0808b5774630fdedeb4006f747efcf267f42f5757f7e882a8188a32232b57f\": rpc error: code = NotFound desc = could not find container \"1e0808b5774630fdedeb4006f747efcf267f42f5757f7e882a8188a32232b57f\": container with ID starting with 1e0808b5774630fdedeb4006f747efcf267f42f5757f7e882a8188a32232b57f not found: ID does not exist" Nov 03 20:02:13.904649 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.904620 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e21a273-b5cb-4359-a833-ee8ef222504c-console-serving-cert\") pod \"console-6f4d987d9c-tl2cx\" (UID: \"5e21a273-b5cb-4359-a833-ee8ef222504c\") " pod="openshift-console/console-6f4d987d9c-tl2cx" Nov 03 20:02:13.904832 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.904656 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e21a273-b5cb-4359-a833-ee8ef222504c-console-config\") pod \"console-6f4d987d9c-tl2cx\" (UID: \"5e21a273-b5cb-4359-a833-ee8ef222504c\") " pod="openshift-console/console-6f4d987d9c-tl2cx" Nov 03 20:02:13.904832 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.904693 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e21a273-b5cb-4359-a833-ee8ef222504c-trusted-ca-bundle\") pod \"console-6f4d987d9c-tl2cx\" (UID: \"5e21a273-b5cb-4359-a833-ee8ef222504c\") " pod="openshift-console/console-6f4d987d9c-tl2cx" Nov 03 20:02:13.904949 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.904821 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e21a273-b5cb-4359-a833-ee8ef222504c-console-oauth-config\") pod \"console-6f4d987d9c-tl2cx\" (UID: \"5e21a273-b5cb-4359-a833-ee8ef222504c\") " pod="openshift-console/console-6f4d987d9c-tl2cx" Nov 03 20:02:13.904949 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.904864 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2647\" (UniqueName: \"kubernetes.io/projected/5e21a273-b5cb-4359-a833-ee8ef222504c-kube-api-access-s2647\") pod \"console-6f4d987d9c-tl2cx\" (UID: \"5e21a273-b5cb-4359-a833-ee8ef222504c\") " pod="openshift-console/console-6f4d987d9c-tl2cx" Nov 03 20:02:13.904949 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.904916 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e21a273-b5cb-4359-a833-ee8ef222504c-oauth-serving-cert\") pod \"console-6f4d987d9c-tl2cx\" (UID: \"5e21a273-b5cb-4359-a833-ee8ef222504c\") " pod="openshift-console/console-6f4d987d9c-tl2cx" Nov 03 20:02:13.905096 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.904969 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e21a273-b5cb-4359-a833-ee8ef222504c-service-ca\") pod \"console-6f4d987d9c-tl2cx\" (UID: \"5e21a273-b5cb-4359-a833-ee8ef222504c\") " pod="openshift-console/console-6f4d987d9c-tl2cx" Nov 03 20:02:13.905096 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.904998 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e21a273-b5cb-4359-a833-ee8ef222504c-tmp\") pod \"console-6f4d987d9c-tl2cx\" (UID: \"5e21a273-b5cb-4359-a833-ee8ef222504c\") " pod="openshift-console/console-6f4d987d9c-tl2cx" Nov 03 20:02:13.905448 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.905395 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e21a273-b5cb-4359-a833-ee8ef222504c-tmp\") pod \"console-6f4d987d9c-tl2cx\" (UID: \"5e21a273-b5cb-4359-a833-ee8ef222504c\") " pod="openshift-console/console-6f4d987d9c-tl2cx" Nov 03 20:02:13.905448 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.905437 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e21a273-b5cb-4359-a833-ee8ef222504c-console-config\") pod \"console-6f4d987d9c-tl2cx\" (UID: \"5e21a273-b5cb-4359-a833-ee8ef222504c\") " pod="openshift-console/console-6f4d987d9c-tl2cx" Nov 03 20:02:13.905669 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.905624 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e21a273-b5cb-4359-a833-ee8ef222504c-oauth-serving-cert\") pod \"console-6f4d987d9c-tl2cx\" (UID: \"5e21a273-b5cb-4359-a833-ee8ef222504c\") " pod="openshift-console/console-6f4d987d9c-tl2cx" Nov 03 20:02:13.905814 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.905792 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e21a273-b5cb-4359-a833-ee8ef222504c-service-ca\") pod \"console-6f4d987d9c-tl2cx\" (UID: \"5e21a273-b5cb-4359-a833-ee8ef222504c\") " pod="openshift-console/console-6f4d987d9c-tl2cx" Nov 03 20:02:13.905912 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.905844 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e21a273-b5cb-4359-a833-ee8ef222504c-trusted-ca-bundle\") pod \"console-6f4d987d9c-tl2cx\" (UID: \"5e21a273-b5cb-4359-a833-ee8ef222504c\") " pod="openshift-console/console-6f4d987d9c-tl2cx" Nov 03 20:02:13.907499 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.907479 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e21a273-b5cb-4359-a833-ee8ef222504c-console-oauth-config\") pod \"console-6f4d987d9c-tl2cx\" (UID: \"5e21a273-b5cb-4359-a833-ee8ef222504c\") " pod="openshift-console/console-6f4d987d9c-tl2cx" Nov 03 20:02:13.907753 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.907734 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e21a273-b5cb-4359-a833-ee8ef222504c-console-serving-cert\") pod \"console-6f4d987d9c-tl2cx\" (UID: \"5e21a273-b5cb-4359-a833-ee8ef222504c\") " pod="openshift-console/console-6f4d987d9c-tl2cx" Nov 03 20:02:13.965496 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.965466 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2647\" (UniqueName: \"kubernetes.io/projected/5e21a273-b5cb-4359-a833-ee8ef222504c-kube-api-access-s2647\") pod \"console-6f4d987d9c-tl2cx\" (UID: \"5e21a273-b5cb-4359-a833-ee8ef222504c\") " pod="openshift-console/console-6f4d987d9c-tl2cx" Nov 03 20:02:13.996718 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:13.996689 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5454b99889-gt2tx"] Nov 03 20:02:14.000773 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:14.000751 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5454b99889-gt2tx"] Nov 03 20:02:14.004096 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:14.004076 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4d987d9c-tl2cx" Nov 03 20:02:14.374130 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:14.374045 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f4d987d9c-tl2cx"] Nov 03 20:02:14.378065 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:02:14.378042 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e21a273_b5cb_4359_a833_ee8ef222504c.slice/crio-7d3f68a89bb772d58fcb82c9de687a5a34550ead73d3ded02cdb778bdb5b4d90 WatchSource:0}: Error finding container 7d3f68a89bb772d58fcb82c9de687a5a34550ead73d3ded02cdb778bdb5b4d90: Status 404 returned error can't find the container with id 7d3f68a89bb772d58fcb82c9de687a5a34550ead73d3ded02cdb778bdb5b4d90 Nov 03 20:02:14.572295 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:14.572261 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e67d41d7-ae93-442b-b376-d6f23173df56" path="/var/lib/kubelet/pods/e67d41d7-ae93-442b-b376-d6f23173df56/volumes" Nov 03 20:02:14.840516 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:14.840476 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4d987d9c-tl2cx" event={"ID":"5e21a273-b5cb-4359-a833-ee8ef222504c","Type":"ContainerStarted","Data":"515a13241e78ba728c610b2c3aae25d0ea6cf2ffbd63874d4fbf4eda52c16dc6"} Nov 03 20:02:14.840755 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:14.840586 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4d987d9c-tl2cx" event={"ID":"5e21a273-b5cb-4359-a833-ee8ef222504c","Type":"ContainerStarted","Data":"7d3f68a89bb772d58fcb82c9de687a5a34550ead73d3ded02cdb778bdb5b4d90"} Nov 03 20:02:14.958644 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:14.958553 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-6f4d987d9c-tl2cx" podStartSLOduration=1.958387154 podStartE2EDuration="1.958387154s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:02:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:02:14.95818251 +0000 UTC m=+44.525072657" watchObservedRunningTime="2026-11-03 20:02:14.958387154 +0000 UTC m=+44.525277303" Nov 03 20:02:16.886962 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:16.886930 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 03 20:02:16.887401 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:16.887236 5857 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="26c31b1c-c3c5-4676-b71f-f44499e10a3b" containerName="alertmanager" containerID="cri-o://ca32ffc835bab4a15726b4c13a81687d7e95fd59b5b9dcb93b1dad9e868b60dd" gracePeriod=120 Nov 03 20:02:16.887401 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:16.887268 5857 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="26c31b1c-c3c5-4676-b71f-f44499e10a3b" containerName="kube-rbac-proxy-metric" containerID="cri-o://0e50aab9b670d17e900f506d647135307d7e71fc459b3fe945eb3041ffa40c85" gracePeriod=120 Nov 03 20:02:16.887401 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:16.887318 5857 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="26c31b1c-c3c5-4676-b71f-f44499e10a3b" containerName="kube-rbac-proxy-web" containerID="cri-o://c716c75d1aef47b81dc36fc7507c8bfb5e7eaf85366802c6231271b0c5d91188" gracePeriod=120 Nov 03 20:02:16.887401 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:16.887337 5857 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="26c31b1c-c3c5-4676-b71f-f44499e10a3b" containerName="config-reloader" containerID="cri-o://9eb3b256043614bcc0883ab53936170e3232b11734e321aa055bbd703e72166c" gracePeriod=120 Nov 03 20:02:16.887401 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:16.887393 5857 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="26c31b1c-c3c5-4676-b71f-f44499e10a3b" containerName="kube-rbac-proxy" containerID="cri-o://f792768c003a7d7cb9b4dcdf1cf49218d8ec68ddc8baf89f3c20a7be2d867375" gracePeriod=120 Nov 03 20:02:16.887916 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:16.887416 5857 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="26c31b1c-c3c5-4676-b71f-f44499e10a3b" containerName="prom-label-proxy" containerID="cri-o://0d817fa96bbc573fbc89e48560eb6b13575a92968d78b1841cbf09c9d9356355" gracePeriod=120 Nov 03 20:02:17.857682 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:17.857646 5857 generic.go:356] "Generic (PLEG): container finished" podID="26c31b1c-c3c5-4676-b71f-f44499e10a3b" containerID="0d817fa96bbc573fbc89e48560eb6b13575a92968d78b1841cbf09c9d9356355" exitCode=0 Nov 03 20:02:17.857682 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:17.857676 5857 generic.go:356] "Generic (PLEG): container finished" podID="26c31b1c-c3c5-4676-b71f-f44499e10a3b" containerID="0e50aab9b670d17e900f506d647135307d7e71fc459b3fe945eb3041ffa40c85" exitCode=0 Nov 03 20:02:17.857682 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:17.857684 5857 generic.go:356] "Generic (PLEG): container finished" podID="26c31b1c-c3c5-4676-b71f-f44499e10a3b" containerID="f792768c003a7d7cb9b4dcdf1cf49218d8ec68ddc8baf89f3c20a7be2d867375" exitCode=0 Nov 03 20:02:17.857682 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:17.857691 5857 generic.go:356] "Generic (PLEG): container finished" podID="26c31b1c-c3c5-4676-b71f-f44499e10a3b" containerID="9eb3b256043614bcc0883ab53936170e3232b11734e321aa055bbd703e72166c" exitCode=0 Nov 03 20:02:17.857981 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:17.857698 5857 generic.go:356] "Generic (PLEG): container finished" podID="26c31b1c-c3c5-4676-b71f-f44499e10a3b" containerID="ca32ffc835bab4a15726b4c13a81687d7e95fd59b5b9dcb93b1dad9e868b60dd" exitCode=0 Nov 03 20:02:17.857981 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:17.857723 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"26c31b1c-c3c5-4676-b71f-f44499e10a3b","Type":"ContainerDied","Data":"0d817fa96bbc573fbc89e48560eb6b13575a92968d78b1841cbf09c9d9356355"} Nov 03 20:02:17.857981 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:17.857794 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"26c31b1c-c3c5-4676-b71f-f44499e10a3b","Type":"ContainerDied","Data":"0e50aab9b670d17e900f506d647135307d7e71fc459b3fe945eb3041ffa40c85"} Nov 03 20:02:17.857981 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:17.857829 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"26c31b1c-c3c5-4676-b71f-f44499e10a3b","Type":"ContainerDied","Data":"f792768c003a7d7cb9b4dcdf1cf49218d8ec68ddc8baf89f3c20a7be2d867375"} Nov 03 20:02:17.857981 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:17.857856 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"26c31b1c-c3c5-4676-b71f-f44499e10a3b","Type":"ContainerDied","Data":"9eb3b256043614bcc0883ab53936170e3232b11734e321aa055bbd703e72166c"} Nov 03 20:02:17.857981 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:17.857883 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"26c31b1c-c3c5-4676-b71f-f44499e10a3b","Type":"ContainerDied","Data":"ca32ffc835bab4a15726b4c13a81687d7e95fd59b5b9dcb93b1dad9e868b60dd"} Nov 03 20:02:18.139724 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.139697 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:18.240609 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.240549 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-kube-rbac-proxy\") pod \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " Nov 03 20:02:18.240773 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.240621 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-web-config\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-web-config\") pod \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " Nov 03 20:02:18.240773 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.240639 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-cluster-tls-config\") pod \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " Nov 03 20:02:18.240773 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.240667 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-config-volume\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-config-volume\") pod \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " Nov 03 20:02:18.240773 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.240694 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/26c31b1c-c3c5-4676-b71f-f44499e10a3b-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26c31b1c-c3c5-4676-b71f-f44499e10a3b-metrics-client-ca\") pod \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " Nov 03 20:02:18.240773 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.240714 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/26c31b1c-c3c5-4676-b71f-f44499e10a3b-tls-assets\" (UniqueName: \"kubernetes.io/projected/26c31b1c-c3c5-4676-b71f-f44499e10a3b-tls-assets\") pod \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " Nov 03 20:02:18.240773 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.240734 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/26c31b1c-c3c5-4676-b71f-f44499e10a3b-alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/26c31b1c-c3c5-4676-b71f-f44499e10a3b-alertmanager-main-db\") pod \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " Nov 03 20:02:18.241098 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.240806 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/26c31b1c-c3c5-4676-b71f-f44499e10a3b-config-out\" (UniqueName: \"kubernetes.io/empty-dir/26c31b1c-c3c5-4676-b71f-f44499e10a3b-config-out\") pod \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " Nov 03 20:02:18.241098 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.240840 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " Nov 03 20:02:18.241098 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.240890 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/26c31b1c-c3c5-4676-b71f-f44499e10a3b-alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26c31b1c-c3c5-4676-b71f-f44499e10a3b-alertmanager-trusted-ca-bundle\") pod \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " Nov 03 20:02:18.241098 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.240919 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-main-tls\") pod \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " Nov 03 20:02:18.241098 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.240964 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-kube-rbac-proxy-web\") pod \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " Nov 03 20:02:18.241098 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.241006 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/26c31b1c-c3c5-4676-b71f-f44499e10a3b-kube-api-access-5jjfg\" (UniqueName: \"kubernetes.io/projected/26c31b1c-c3c5-4676-b71f-f44499e10a3b-kube-api-access-5jjfg\") pod \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\" (UID: \"26c31b1c-c3c5-4676-b71f-f44499e10a3b\") " Nov 03 20:02:18.241383 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.241120 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26c31b1c-c3c5-4676-b71f-f44499e10a3b-metrics-client-ca" pod "26c31b1c-c3c5-4676-b71f-f44499e10a3b" (UID: "26c31b1c-c3c5-4676-b71f-f44499e10a3b"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:02:18.241383 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.241283 5857 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26c31b1c-c3c5-4676-b71f-f44499e10a3b-metrics-client-ca\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:02:18.243353 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.241634 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26c31b1c-c3c5-4676-b71f-f44499e10a3b-alertmanager-main-db" pod "26c31b1c-c3c5-4676-b71f-f44499e10a3b" (UID: "26c31b1c-c3c5-4676-b71f-f44499e10a3b"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:02:18.244324 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.244278 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-kube-rbac-proxy" pod "26c31b1c-c3c5-4676-b71f-f44499e10a3b" (UID: "26c31b1c-c3c5-4676-b71f-f44499e10a3b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:02:18.244424 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.244362 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26c31b1c-c3c5-4676-b71f-f44499e10a3b-tls-assets" pod "26c31b1c-c3c5-4676-b71f-f44499e10a3b" (UID: "26c31b1c-c3c5-4676-b71f-f44499e10a3b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:02:18.244713 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.244629 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-kube-rbac-proxy-metric" pod "26c31b1c-c3c5-4676-b71f-f44499e10a3b" (UID: "26c31b1c-c3c5-4676-b71f-f44499e10a3b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:02:18.244713 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.244686 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26c31b1c-c3c5-4676-b71f-f44499e10a3b-kube-api-access-5jjfg" pod "26c31b1c-c3c5-4676-b71f-f44499e10a3b" (UID: "26c31b1c-c3c5-4676-b71f-f44499e10a3b"). InnerVolumeSpecName "kube-api-access-5jjfg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:02:18.244713 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.244694 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-config-volume" pod "26c31b1c-c3c5-4676-b71f-f44499e10a3b" (UID: "26c31b1c-c3c5-4676-b71f-f44499e10a3b"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:02:18.245066 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.245013 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26c31b1c-c3c5-4676-b71f-f44499e10a3b-alertmanager-trusted-ca-bundle" pod "26c31b1c-c3c5-4676-b71f-f44499e10a3b" (UID: "26c31b1c-c3c5-4676-b71f-f44499e10a3b"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:02:18.246433 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.246408 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26c31b1c-c3c5-4676-b71f-f44499e10a3b-config-out" pod "26c31b1c-c3c5-4676-b71f-f44499e10a3b" (UID: "26c31b1c-c3c5-4676-b71f-f44499e10a3b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:02:18.246800 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.246771 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-kube-rbac-proxy-web" pod "26c31b1c-c3c5-4676-b71f-f44499e10a3b" (UID: "26c31b1c-c3c5-4676-b71f-f44499e10a3b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:02:18.246909 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.246890 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-main-tls" pod "26c31b1c-c3c5-4676-b71f-f44499e10a3b" (UID: "26c31b1c-c3c5-4676-b71f-f44499e10a3b"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:02:18.248998 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.248974 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-cluster-tls-config" pod "26c31b1c-c3c5-4676-b71f-f44499e10a3b" (UID: "26c31b1c-c3c5-4676-b71f-f44499e10a3b"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:02:18.255467 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.255442 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-web-config" pod "26c31b1c-c3c5-4676-b71f-f44499e10a3b" (UID: "26c31b1c-c3c5-4676-b71f-f44499e10a3b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:02:18.341856 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.341823 5857 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:02:18.341856 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.341850 5857 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-web-config\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:02:18.341856 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.341862 5857 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-cluster-tls-config\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:02:18.342093 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.341872 5857 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-config-volume\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:02:18.342093 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.341881 5857 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/26c31b1c-c3c5-4676-b71f-f44499e10a3b-tls-assets\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:02:18.342093 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.341890 5857 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/26c31b1c-c3c5-4676-b71f-f44499e10a3b-alertmanager-main-db\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:02:18.342093 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.341899 5857 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/26c31b1c-c3c5-4676-b71f-f44499e10a3b-config-out\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:02:18.342093 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.341908 5857 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:02:18.342093 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.341917 5857 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26c31b1c-c3c5-4676-b71f-f44499e10a3b-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:02:18.342093 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.341926 5857 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-main-tls\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:02:18.342093 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.341935 5857 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26c31b1c-c3c5-4676-b71f-f44499e10a3b-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:02:18.342093 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.341943 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jjfg\" (UniqueName: \"kubernetes.io/projected/26c31b1c-c3c5-4676-b71f-f44499e10a3b-kube-api-access-5jjfg\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:02:18.865113 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.865014 5857 generic.go:356] "Generic (PLEG): container finished" podID="26c31b1c-c3c5-4676-b71f-f44499e10a3b" containerID="c716c75d1aef47b81dc36fc7507c8bfb5e7eaf85366802c6231271b0c5d91188" exitCode=0 Nov 03 20:02:18.865113 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.865083 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"26c31b1c-c3c5-4676-b71f-f44499e10a3b","Type":"ContainerDied","Data":"c716c75d1aef47b81dc36fc7507c8bfb5e7eaf85366802c6231271b0c5d91188"} Nov 03 20:02:18.865335 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.865154 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"26c31b1c-c3c5-4676-b71f-f44499e10a3b","Type":"ContainerDied","Data":"97c9b81f31810c9510cb064f7bf6b901b40808abef6a684b99accaea77411965"} Nov 03 20:02:18.865335 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.865187 5857 scope.go:122] "RemoveContainer" containerID="0d817fa96bbc573fbc89e48560eb6b13575a92968d78b1841cbf09c9d9356355" Nov 03 20:02:18.865335 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.865217 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:18.872918 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.872899 5857 scope.go:122] "RemoveContainer" containerID="0e50aab9b670d17e900f506d647135307d7e71fc459b3fe945eb3041ffa40c85" Nov 03 20:02:18.879989 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.879967 5857 scope.go:122] "RemoveContainer" containerID="f792768c003a7d7cb9b4dcdf1cf49218d8ec68ddc8baf89f3c20a7be2d867375" Nov 03 20:02:18.887009 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.886991 5857 scope.go:122] "RemoveContainer" containerID="c716c75d1aef47b81dc36fc7507c8bfb5e7eaf85366802c6231271b0c5d91188" Nov 03 20:02:18.893643 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.893623 5857 scope.go:122] "RemoveContainer" containerID="9eb3b256043614bcc0883ab53936170e3232b11734e321aa055bbd703e72166c" Nov 03 20:02:18.900586 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.900545 5857 scope.go:122] "RemoveContainer" containerID="ca32ffc835bab4a15726b4c13a81687d7e95fd59b5b9dcb93b1dad9e868b60dd" Nov 03 20:02:18.907465 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.907447 5857 scope.go:122] "RemoveContainer" containerID="d9a6fde832579f5d3b441121db3a042fbe6047ba212506a27d8c6934c79f3e9a" Nov 03 20:02:18.914331 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.914314 5857 scope.go:122] "RemoveContainer" containerID="0d817fa96bbc573fbc89e48560eb6b13575a92968d78b1841cbf09c9d9356355" Nov 03 20:02:18.914632 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:02:18.914612 5857 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d817fa96bbc573fbc89e48560eb6b13575a92968d78b1841cbf09c9d9356355\": container with ID starting with 0d817fa96bbc573fbc89e48560eb6b13575a92968d78b1841cbf09c9d9356355 not found: ID does not exist" containerID="0d817fa96bbc573fbc89e48560eb6b13575a92968d78b1841cbf09c9d9356355" Nov 03 20:02:18.914706 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.914643 5857 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d817fa96bbc573fbc89e48560eb6b13575a92968d78b1841cbf09c9d9356355"} err="failed to get container status \"0d817fa96bbc573fbc89e48560eb6b13575a92968d78b1841cbf09c9d9356355\": rpc error: code = NotFound desc = could not find container \"0d817fa96bbc573fbc89e48560eb6b13575a92968d78b1841cbf09c9d9356355\": container with ID starting with 0d817fa96bbc573fbc89e48560eb6b13575a92968d78b1841cbf09c9d9356355 not found: ID does not exist" Nov 03 20:02:18.914706 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.914662 5857 scope.go:122] "RemoveContainer" containerID="0e50aab9b670d17e900f506d647135307d7e71fc459b3fe945eb3041ffa40c85" Nov 03 20:02:18.914932 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:02:18.914914 5857 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e50aab9b670d17e900f506d647135307d7e71fc459b3fe945eb3041ffa40c85\": container with ID starting with 0e50aab9b670d17e900f506d647135307d7e71fc459b3fe945eb3041ffa40c85 not found: ID does not exist" containerID="0e50aab9b670d17e900f506d647135307d7e71fc459b3fe945eb3041ffa40c85" Nov 03 20:02:18.914986 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.914942 5857 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e50aab9b670d17e900f506d647135307d7e71fc459b3fe945eb3041ffa40c85"} err="failed to get container status \"0e50aab9b670d17e900f506d647135307d7e71fc459b3fe945eb3041ffa40c85\": rpc error: code = NotFound desc = could not find container \"0e50aab9b670d17e900f506d647135307d7e71fc459b3fe945eb3041ffa40c85\": container with ID starting with 0e50aab9b670d17e900f506d647135307d7e71fc459b3fe945eb3041ffa40c85 not found: ID does not exist" Nov 03 20:02:18.914986 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.914964 5857 scope.go:122] "RemoveContainer" containerID="f792768c003a7d7cb9b4dcdf1cf49218d8ec68ddc8baf89f3c20a7be2d867375" Nov 03 20:02:18.915203 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:02:18.915187 5857 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f792768c003a7d7cb9b4dcdf1cf49218d8ec68ddc8baf89f3c20a7be2d867375\": container with ID starting with f792768c003a7d7cb9b4dcdf1cf49218d8ec68ddc8baf89f3c20a7be2d867375 not found: ID does not exist" containerID="f792768c003a7d7cb9b4dcdf1cf49218d8ec68ddc8baf89f3c20a7be2d867375" Nov 03 20:02:18.915248 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.915208 5857 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f792768c003a7d7cb9b4dcdf1cf49218d8ec68ddc8baf89f3c20a7be2d867375"} err="failed to get container status \"f792768c003a7d7cb9b4dcdf1cf49218d8ec68ddc8baf89f3c20a7be2d867375\": rpc error: code = NotFound desc = could not find container \"f792768c003a7d7cb9b4dcdf1cf49218d8ec68ddc8baf89f3c20a7be2d867375\": container with ID starting with f792768c003a7d7cb9b4dcdf1cf49218d8ec68ddc8baf89f3c20a7be2d867375 not found: ID does not exist" Nov 03 20:02:18.915248 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.915223 5857 scope.go:122] "RemoveContainer" containerID="c716c75d1aef47b81dc36fc7507c8bfb5e7eaf85366802c6231271b0c5d91188" Nov 03 20:02:18.915438 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:02:18.915419 5857 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c716c75d1aef47b81dc36fc7507c8bfb5e7eaf85366802c6231271b0c5d91188\": container with ID starting with c716c75d1aef47b81dc36fc7507c8bfb5e7eaf85366802c6231271b0c5d91188 not found: ID does not exist" containerID="c716c75d1aef47b81dc36fc7507c8bfb5e7eaf85366802c6231271b0c5d91188" Nov 03 20:02:18.915493 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.915447 5857 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c716c75d1aef47b81dc36fc7507c8bfb5e7eaf85366802c6231271b0c5d91188"} err="failed to get container status \"c716c75d1aef47b81dc36fc7507c8bfb5e7eaf85366802c6231271b0c5d91188\": rpc error: code = NotFound desc = could not find container \"c716c75d1aef47b81dc36fc7507c8bfb5e7eaf85366802c6231271b0c5d91188\": container with ID starting with c716c75d1aef47b81dc36fc7507c8bfb5e7eaf85366802c6231271b0c5d91188 not found: ID does not exist" Nov 03 20:02:18.915493 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.915468 5857 scope.go:122] "RemoveContainer" containerID="9eb3b256043614bcc0883ab53936170e3232b11734e321aa055bbd703e72166c" Nov 03 20:02:18.915743 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:02:18.915728 5857 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9eb3b256043614bcc0883ab53936170e3232b11734e321aa055bbd703e72166c\": container with ID starting with 9eb3b256043614bcc0883ab53936170e3232b11734e321aa055bbd703e72166c not found: ID does not exist" containerID="9eb3b256043614bcc0883ab53936170e3232b11734e321aa055bbd703e72166c" Nov 03 20:02:18.915813 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.915750 5857 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9eb3b256043614bcc0883ab53936170e3232b11734e321aa055bbd703e72166c"} err="failed to get container status \"9eb3b256043614bcc0883ab53936170e3232b11734e321aa055bbd703e72166c\": rpc error: code = NotFound desc = could not find container \"9eb3b256043614bcc0883ab53936170e3232b11734e321aa055bbd703e72166c\": container with ID starting with 9eb3b256043614bcc0883ab53936170e3232b11734e321aa055bbd703e72166c not found: ID does not exist" Nov 03 20:02:18.915813 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.915793 5857 scope.go:122] "RemoveContainer" containerID="ca32ffc835bab4a15726b4c13a81687d7e95fd59b5b9dcb93b1dad9e868b60dd" Nov 03 20:02:18.916053 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:02:18.916034 5857 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca32ffc835bab4a15726b4c13a81687d7e95fd59b5b9dcb93b1dad9e868b60dd\": container with ID starting with ca32ffc835bab4a15726b4c13a81687d7e95fd59b5b9dcb93b1dad9e868b60dd not found: ID does not exist" containerID="ca32ffc835bab4a15726b4c13a81687d7e95fd59b5b9dcb93b1dad9e868b60dd" Nov 03 20:02:18.916101 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.916058 5857 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca32ffc835bab4a15726b4c13a81687d7e95fd59b5b9dcb93b1dad9e868b60dd"} err="failed to get container status \"ca32ffc835bab4a15726b4c13a81687d7e95fd59b5b9dcb93b1dad9e868b60dd\": rpc error: code = NotFound desc = could not find container \"ca32ffc835bab4a15726b4c13a81687d7e95fd59b5b9dcb93b1dad9e868b60dd\": container with ID starting with ca32ffc835bab4a15726b4c13a81687d7e95fd59b5b9dcb93b1dad9e868b60dd not found: ID does not exist" Nov 03 20:02:18.916101 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.916078 5857 scope.go:122] "RemoveContainer" containerID="d9a6fde832579f5d3b441121db3a042fbe6047ba212506a27d8c6934c79f3e9a" Nov 03 20:02:18.916288 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:02:18.916273 5857 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9a6fde832579f5d3b441121db3a042fbe6047ba212506a27d8c6934c79f3e9a\": container with ID starting with d9a6fde832579f5d3b441121db3a042fbe6047ba212506a27d8c6934c79f3e9a not found: ID does not exist" containerID="d9a6fde832579f5d3b441121db3a042fbe6047ba212506a27d8c6934c79f3e9a" Nov 03 20:02:18.916332 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:18.916292 5857 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9a6fde832579f5d3b441121db3a042fbe6047ba212506a27d8c6934c79f3e9a"} err="failed to get container status \"d9a6fde832579f5d3b441121db3a042fbe6047ba212506a27d8c6934c79f3e9a\": rpc error: code = NotFound desc = could not find container \"d9a6fde832579f5d3b441121db3a042fbe6047ba212506a27d8c6934c79f3e9a\": container with ID starting with d9a6fde832579f5d3b441121db3a042fbe6047ba212506a27d8c6934c79f3e9a not found: ID does not exist" Nov 03 20:02:19.031524 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.031497 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 03 20:02:19.081078 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.081019 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 03 20:02:19.081527 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.081508 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 03 20:02:19.081828 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.081815 5857 cpu_manager.go:414] "containerMap: removing container" podUID="26c31b1c-c3c5-4676-b71f-f44499e10a3b" containerName="init-config-reloader" Nov 03 20:02:19.081872 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.081830 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="26c31b1c-c3c5-4676-b71f-f44499e10a3b" containerName="init-config-reloader" Nov 03 20:02:19.081872 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.081845 5857 cpu_manager.go:414] "containerMap: removing container" podUID="26c31b1c-c3c5-4676-b71f-f44499e10a3b" containerName="prom-label-proxy" Nov 03 20:02:19.081872 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.081852 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="26c31b1c-c3c5-4676-b71f-f44499e10a3b" containerName="prom-label-proxy" Nov 03 20:02:19.081872 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.081868 5857 cpu_manager.go:414] "containerMap: removing container" podUID="26c31b1c-c3c5-4676-b71f-f44499e10a3b" containerName="kube-rbac-proxy-web" Nov 03 20:02:19.081990 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.081873 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="26c31b1c-c3c5-4676-b71f-f44499e10a3b" containerName="kube-rbac-proxy-web" Nov 03 20:02:19.081990 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.081883 5857 cpu_manager.go:414] "containerMap: removing container" podUID="26c31b1c-c3c5-4676-b71f-f44499e10a3b" containerName="kube-rbac-proxy-metric" Nov 03 20:02:19.081990 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.081887 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="26c31b1c-c3c5-4676-b71f-f44499e10a3b" containerName="kube-rbac-proxy-metric" Nov 03 20:02:19.081990 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.081897 5857 cpu_manager.go:414] "containerMap: removing container" podUID="26c31b1c-c3c5-4676-b71f-f44499e10a3b" containerName="alertmanager" Nov 03 20:02:19.081990 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.081901 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="26c31b1c-c3c5-4676-b71f-f44499e10a3b" containerName="alertmanager" Nov 03 20:02:19.081990 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.081907 5857 cpu_manager.go:414] "containerMap: removing container" podUID="26c31b1c-c3c5-4676-b71f-f44499e10a3b" containerName="config-reloader" Nov 03 20:02:19.081990 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.081911 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="26c31b1c-c3c5-4676-b71f-f44499e10a3b" containerName="config-reloader" Nov 03 20:02:19.081990 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.081917 5857 cpu_manager.go:414] "containerMap: removing container" podUID="26c31b1c-c3c5-4676-b71f-f44499e10a3b" containerName="kube-rbac-proxy" Nov 03 20:02:19.081990 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.081921 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="26c31b1c-c3c5-4676-b71f-f44499e10a3b" containerName="kube-rbac-proxy" Nov 03 20:02:19.081990 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.081969 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="26c31b1c-c3c5-4676-b71f-f44499e10a3b" containerName="prom-label-proxy" Nov 03 20:02:19.081990 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.081979 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="26c31b1c-c3c5-4676-b71f-f44499e10a3b" containerName="kube-rbac-proxy-web" Nov 03 20:02:19.081990 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.081986 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="26c31b1c-c3c5-4676-b71f-f44499e10a3b" containerName="kube-rbac-proxy-metric" Nov 03 20:02:19.081990 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.081992 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="26c31b1c-c3c5-4676-b71f-f44499e10a3b" containerName="alertmanager" Nov 03 20:02:19.082355 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.081997 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="26c31b1c-c3c5-4676-b71f-f44499e10a3b" containerName="config-reloader" Nov 03 20:02:19.082355 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.082002 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="26c31b1c-c3c5-4676-b71f-f44499e10a3b" containerName="kube-rbac-proxy" Nov 03 20:02:19.082355 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.082008 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="26c31b1c-c3c5-4676-b71f-f44499e10a3b" containerName="init-config-reloader" Nov 03 20:02:19.085155 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.085139 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.137728 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.137653 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Nov 03 20:02:19.137861 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.137816 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-sbl24\"" Nov 03 20:02:19.137861 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.137816 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Nov 03 20:02:19.137955 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.137871 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Nov 03 20:02:19.137955 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.137885 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Nov 03 20:02:19.138072 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.138053 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Nov 03 20:02:19.138131 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.138053 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Nov 03 20:02:19.138131 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.138091 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Nov 03 20:02:19.138192 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.138150 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Nov 03 20:02:19.147944 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.147913 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/53fe6e0a-d024-4b39-acfb-027b7f48922e-web-config\") pod \"alertmanager-main-0\" (UID: \"53fe6e0a-d024-4b39-acfb-027b7f48922e\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.148216 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.147964 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53fe6e0a-d024-4b39-acfb-027b7f48922e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"53fe6e0a-d024-4b39-acfb-027b7f48922e\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.148216 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.147987 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/53fe6e0a-d024-4b39-acfb-027b7f48922e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"53fe6e0a-d024-4b39-acfb-027b7f48922e\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.148216 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.148109 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/53fe6e0a-d024-4b39-acfb-027b7f48922e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"53fe6e0a-d024-4b39-acfb-027b7f48922e\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.148216 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.148132 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/53fe6e0a-d024-4b39-acfb-027b7f48922e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"53fe6e0a-d024-4b39-acfb-027b7f48922e\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.148216 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.148148 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53fe6e0a-d024-4b39-acfb-027b7f48922e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"53fe6e0a-d024-4b39-acfb-027b7f48922e\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.148373 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.148226 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/53fe6e0a-d024-4b39-acfb-027b7f48922e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"53fe6e0a-d024-4b39-acfb-027b7f48922e\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.148373 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.148246 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/53fe6e0a-d024-4b39-acfb-027b7f48922e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"53fe6e0a-d024-4b39-acfb-027b7f48922e\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.148373 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.148265 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/53fe6e0a-d024-4b39-acfb-027b7f48922e-config-volume\") pod \"alertmanager-main-0\" (UID: \"53fe6e0a-d024-4b39-acfb-027b7f48922e\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.148373 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.148282 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/53fe6e0a-d024-4b39-acfb-027b7f48922e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"53fe6e0a-d024-4b39-acfb-027b7f48922e\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.148373 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.148312 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/53fe6e0a-d024-4b39-acfb-027b7f48922e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"53fe6e0a-d024-4b39-acfb-027b7f48922e\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.148373 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.148361 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/53fe6e0a-d024-4b39-acfb-027b7f48922e-config-out\") pod \"alertmanager-main-0\" (UID: \"53fe6e0a-d024-4b39-acfb-027b7f48922e\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.148588 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.148386 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd4k7\" (UniqueName: \"kubernetes.io/projected/53fe6e0a-d024-4b39-acfb-027b7f48922e-kube-api-access-dd4k7\") pod \"alertmanager-main-0\" (UID: \"53fe6e0a-d024-4b39-acfb-027b7f48922e\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.187101 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.187076 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Nov 03 20:02:19.248772 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.248747 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/53fe6e0a-d024-4b39-acfb-027b7f48922e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"53fe6e0a-d024-4b39-acfb-027b7f48922e\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.248926 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.248778 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/53fe6e0a-d024-4b39-acfb-027b7f48922e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"53fe6e0a-d024-4b39-acfb-027b7f48922e\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.248926 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.248801 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/53fe6e0a-d024-4b39-acfb-027b7f48922e-config-volume\") pod \"alertmanager-main-0\" (UID: \"53fe6e0a-d024-4b39-acfb-027b7f48922e\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.248926 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.248817 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/53fe6e0a-d024-4b39-acfb-027b7f48922e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"53fe6e0a-d024-4b39-acfb-027b7f48922e\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.249096 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.248942 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/53fe6e0a-d024-4b39-acfb-027b7f48922e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"53fe6e0a-d024-4b39-acfb-027b7f48922e\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.249096 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.248985 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/53fe6e0a-d024-4b39-acfb-027b7f48922e-config-out\") pod \"alertmanager-main-0\" (UID: \"53fe6e0a-d024-4b39-acfb-027b7f48922e\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.249096 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.249014 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd4k7\" (UniqueName: \"kubernetes.io/projected/53fe6e0a-d024-4b39-acfb-027b7f48922e-kube-api-access-dd4k7\") pod \"alertmanager-main-0\" (UID: \"53fe6e0a-d024-4b39-acfb-027b7f48922e\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.249096 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.249061 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/53fe6e0a-d024-4b39-acfb-027b7f48922e-web-config\") pod \"alertmanager-main-0\" (UID: \"53fe6e0a-d024-4b39-acfb-027b7f48922e\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.249284 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.249115 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53fe6e0a-d024-4b39-acfb-027b7f48922e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"53fe6e0a-d024-4b39-acfb-027b7f48922e\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.249284 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.249151 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/53fe6e0a-d024-4b39-acfb-027b7f48922e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"53fe6e0a-d024-4b39-acfb-027b7f48922e\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.249284 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.249185 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/53fe6e0a-d024-4b39-acfb-027b7f48922e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"53fe6e0a-d024-4b39-acfb-027b7f48922e\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.249284 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.249237 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/53fe6e0a-d024-4b39-acfb-027b7f48922e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"53fe6e0a-d024-4b39-acfb-027b7f48922e\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.249284 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.249268 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/53fe6e0a-d024-4b39-acfb-027b7f48922e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"53fe6e0a-d024-4b39-acfb-027b7f48922e\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.249520 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.249293 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53fe6e0a-d024-4b39-acfb-027b7f48922e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"53fe6e0a-d024-4b39-acfb-027b7f48922e\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.250051 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.250025 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53fe6e0a-d024-4b39-acfb-027b7f48922e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"53fe6e0a-d024-4b39-acfb-027b7f48922e\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.252502 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.252156 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/53fe6e0a-d024-4b39-acfb-027b7f48922e-config-volume\") pod \"alertmanager-main-0\" (UID: \"53fe6e0a-d024-4b39-acfb-027b7f48922e\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.252502 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.252237 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/53fe6e0a-d024-4b39-acfb-027b7f48922e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"53fe6e0a-d024-4b39-acfb-027b7f48922e\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.252502 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.252377 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/53fe6e0a-d024-4b39-acfb-027b7f48922e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"53fe6e0a-d024-4b39-acfb-027b7f48922e\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.252502 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.252462 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53fe6e0a-d024-4b39-acfb-027b7f48922e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"53fe6e0a-d024-4b39-acfb-027b7f48922e\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.252791 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.252657 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/53fe6e0a-d024-4b39-acfb-027b7f48922e-web-config\") pod \"alertmanager-main-0\" (UID: \"53fe6e0a-d024-4b39-acfb-027b7f48922e\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.252891 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.252870 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/53fe6e0a-d024-4b39-acfb-027b7f48922e-config-out\") pod \"alertmanager-main-0\" (UID: \"53fe6e0a-d024-4b39-acfb-027b7f48922e\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.252970 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.252948 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/53fe6e0a-d024-4b39-acfb-027b7f48922e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"53fe6e0a-d024-4b39-acfb-027b7f48922e\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.253132 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.253113 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/53fe6e0a-d024-4b39-acfb-027b7f48922e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"53fe6e0a-d024-4b39-acfb-027b7f48922e\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.253254 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.253239 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/53fe6e0a-d024-4b39-acfb-027b7f48922e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"53fe6e0a-d024-4b39-acfb-027b7f48922e\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.254532 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.254517 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/53fe6e0a-d024-4b39-acfb-027b7f48922e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"53fe6e0a-d024-4b39-acfb-027b7f48922e\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.311783 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.311758 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd4k7\" (UniqueName: \"kubernetes.io/projected/53fe6e0a-d024-4b39-acfb-027b7f48922e-kube-api-access-dd4k7\") pod \"alertmanager-main-0\" (UID: \"53fe6e0a-d024-4b39-acfb-027b7f48922e\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.320851 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.320830 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 03 20:02:19.399961 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.399886 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Nov 03 20:02:19.499011 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:02:19.498968 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:02:19.827781 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.827748 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 03 20:02:19.830823 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:02:19.830795 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53fe6e0a_d024_4b39_acfb_027b7f48922e.slice/crio-bab884e1c6dd179c1c8d1185e5559512392d27e9fa9a5e5348ba179cc9a065c5 WatchSource:0}: Error finding container bab884e1c6dd179c1c8d1185e5559512392d27e9fa9a5e5348ba179cc9a065c5: Status 404 returned error can't find the container with id bab884e1c6dd179c1c8d1185e5559512392d27e9fa9a5e5348ba179cc9a065c5 Nov 03 20:02:19.870081 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:19.870057 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"53fe6e0a-d024-4b39-acfb-027b7f48922e","Type":"ContainerStarted","Data":"bab884e1c6dd179c1c8d1185e5559512392d27e9fa9a5e5348ba179cc9a065c5"} Nov 03 20:02:20.574730 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:20.572188 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="26c31b1c-c3c5-4676-b71f-f44499e10a3b" path="/var/lib/kubelet/pods/26c31b1c-c3c5-4676-b71f-f44499e10a3b/volumes" Nov 03 20:02:20.875947 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:20.875866 5857 generic.go:356] "Generic (PLEG): container finished" podID="53fe6e0a-d024-4b39-acfb-027b7f48922e" containerID="7238c64bd6c7e07dc24cc59b126f9b193247cbec8cba8394a3d31011a443e223" exitCode=0 Nov 03 20:02:20.875947 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:20.875920 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"53fe6e0a-d024-4b39-acfb-027b7f48922e","Type":"ContainerDied","Data":"7238c64bd6c7e07dc24cc59b126f9b193247cbec8cba8394a3d31011a443e223"} Nov 03 20:02:21.883320 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:21.883281 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"53fe6e0a-d024-4b39-acfb-027b7f48922e","Type":"ContainerStarted","Data":"2acc260942500eaa30997d9448394c46a6a7578aef44ad554e5b7bd06bc60989"} Nov 03 20:02:21.883739 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:21.883363 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"53fe6e0a-d024-4b39-acfb-027b7f48922e","Type":"ContainerStarted","Data":"8108dbfa913d39df342a071ae0edfcec1b4ebf9c14a7b79c9763d4ecd0b4eee5"} Nov 03 20:02:21.883739 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:21.883403 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"53fe6e0a-d024-4b39-acfb-027b7f48922e","Type":"ContainerStarted","Data":"7ccd19e3deb4169f5d9e823174d495cdcfdf30cab38ab28018a3685dd8e0ac5b"} Nov 03 20:02:21.883739 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:21.883447 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"53fe6e0a-d024-4b39-acfb-027b7f48922e","Type":"ContainerStarted","Data":"800d04db4a28bae40affe8b68f94ab90450854be36d06d72a18a64201a5abf9e"} Nov 03 20:02:21.883739 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:21.883484 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"53fe6e0a-d024-4b39-acfb-027b7f48922e","Type":"ContainerStarted","Data":"b59a32306009e7b3c17f0c262014e6b186b94be6ce852867085c5530cfb8da7c"} Nov 03 20:02:21.883739 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:21.883519 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"53fe6e0a-d024-4b39-acfb-027b7f48922e","Type":"ContainerStarted","Data":"938b399021f2e077a8439dc1e56961e2b4fc344c38a5f720975bf7b77e874e5d"} Nov 03 20:02:22.012023 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:22.011955 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.998762904 podStartE2EDuration="3.011940073s" totalImagesPullingTime="0s" totalInitContainerRuntime="13.177169ms" isStatefulPod=false podCreationTimestamp="2026-11-03 20:02:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:02:22.011373283 +0000 UTC m=+51.578263433" watchObservedRunningTime="2026-11-03 20:02:22.011940073 +0000 UTC m=+51.578830215" Nov 03 20:02:24.004617 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:24.004557 5857 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f4d987d9c-tl2cx" Nov 03 20:02:24.005017 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:24.004686 5857 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f4d987d9c-tl2cx" Nov 03 20:02:24.009250 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:24.009229 5857 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f4d987d9c-tl2cx" Nov 03 20:02:24.898384 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:24.898357 5857 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f4d987d9c-tl2cx" Nov 03 20:02:25.066152 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:25.066116 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59fc69cc99-ktxbb"] Nov 03 20:02:49.498606 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:02:49.498549 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:02:50.086657 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:50.086611 5857 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-59fc69cc99-ktxbb" podUID="291938d2-446e-4474-af93-1ac6e8bc6207" containerName="console" containerID="cri-o://69af7f1347bee5f8664ec90c50e9007ee55afddb754f7eb2a5d02b257a315059" gracePeriod=15 Nov 03 20:02:50.337981 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:50.337926 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59fc69cc99-ktxbb" Nov 03 20:02:50.432128 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:50.432103 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/291938d2-446e-4474-af93-1ac6e8bc6207-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/291938d2-446e-4474-af93-1ac6e8bc6207-console-oauth-config\") pod \"291938d2-446e-4474-af93-1ac6e8bc6207\" (UID: \"291938d2-446e-4474-af93-1ac6e8bc6207\") " Nov 03 20:02:50.432281 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:50.432147 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/291938d2-446e-4474-af93-1ac6e8bc6207-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/291938d2-446e-4474-af93-1ac6e8bc6207-oauth-serving-cert\") pod \"291938d2-446e-4474-af93-1ac6e8bc6207\" (UID: \"291938d2-446e-4474-af93-1ac6e8bc6207\") " Nov 03 20:02:50.432281 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:50.432180 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/291938d2-446e-4474-af93-1ac6e8bc6207-tmp\" (UniqueName: \"kubernetes.io/empty-dir/291938d2-446e-4474-af93-1ac6e8bc6207-tmp\") pod \"291938d2-446e-4474-af93-1ac6e8bc6207\" (UID: \"291938d2-446e-4474-af93-1ac6e8bc6207\") " Nov 03 20:02:50.432281 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:50.432213 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/291938d2-446e-4474-af93-1ac6e8bc6207-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/291938d2-446e-4474-af93-1ac6e8bc6207-console-serving-cert\") pod \"291938d2-446e-4474-af93-1ac6e8bc6207\" (UID: \"291938d2-446e-4474-af93-1ac6e8bc6207\") " Nov 03 20:02:50.432281 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:50.432230 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/291938d2-446e-4474-af93-1ac6e8bc6207-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/291938d2-446e-4474-af93-1ac6e8bc6207-trusted-ca-bundle\") pod \"291938d2-446e-4474-af93-1ac6e8bc6207\" (UID: \"291938d2-446e-4474-af93-1ac6e8bc6207\") " Nov 03 20:02:50.432281 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:50.432248 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/291938d2-446e-4474-af93-1ac6e8bc6207-console-config\" (UniqueName: \"kubernetes.io/configmap/291938d2-446e-4474-af93-1ac6e8bc6207-console-config\") pod \"291938d2-446e-4474-af93-1ac6e8bc6207\" (UID: \"291938d2-446e-4474-af93-1ac6e8bc6207\") " Nov 03 20:02:50.432281 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:50.432265 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/291938d2-446e-4474-af93-1ac6e8bc6207-service-ca\" (UniqueName: \"kubernetes.io/configmap/291938d2-446e-4474-af93-1ac6e8bc6207-service-ca\") pod \"291938d2-446e-4474-af93-1ac6e8bc6207\" (UID: \"291938d2-446e-4474-af93-1ac6e8bc6207\") " Nov 03 20:02:50.432634 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:50.432302 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/291938d2-446e-4474-af93-1ac6e8bc6207-kube-api-access-bkhts\" (UniqueName: \"kubernetes.io/projected/291938d2-446e-4474-af93-1ac6e8bc6207-kube-api-access-bkhts\") pod \"291938d2-446e-4474-af93-1ac6e8bc6207\" (UID: \"291938d2-446e-4474-af93-1ac6e8bc6207\") " Nov 03 20:02:50.432763 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:50.432710 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/291938d2-446e-4474-af93-1ac6e8bc6207-oauth-serving-cert" pod "291938d2-446e-4474-af93-1ac6e8bc6207" (UID: "291938d2-446e-4474-af93-1ac6e8bc6207"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:02:50.432868 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:50.432832 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/291938d2-446e-4474-af93-1ac6e8bc6207-tmp" pod "291938d2-446e-4474-af93-1ac6e8bc6207" (UID: "291938d2-446e-4474-af93-1ac6e8bc6207"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:02:50.432910 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:50.432880 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/291938d2-446e-4474-af93-1ac6e8bc6207-trusted-ca-bundle" pod "291938d2-446e-4474-af93-1ac6e8bc6207" (UID: "291938d2-446e-4474-af93-1ac6e8bc6207"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:02:50.432961 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:50.432837 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/291938d2-446e-4474-af93-1ac6e8bc6207-service-ca" pod "291938d2-446e-4474-af93-1ac6e8bc6207" (UID: "291938d2-446e-4474-af93-1ac6e8bc6207"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:02:50.433020 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:50.432987 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/291938d2-446e-4474-af93-1ac6e8bc6207-console-config" pod "291938d2-446e-4474-af93-1ac6e8bc6207" (UID: "291938d2-446e-4474-af93-1ac6e8bc6207"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:02:50.434468 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:50.434437 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/291938d2-446e-4474-af93-1ac6e8bc6207-console-oauth-config" pod "291938d2-446e-4474-af93-1ac6e8bc6207" (UID: "291938d2-446e-4474-af93-1ac6e8bc6207"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:02:50.434595 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:50.434555 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/291938d2-446e-4474-af93-1ac6e8bc6207-console-serving-cert" pod "291938d2-446e-4474-af93-1ac6e8bc6207" (UID: "291938d2-446e-4474-af93-1ac6e8bc6207"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:02:50.434786 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:50.434771 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/291938d2-446e-4474-af93-1ac6e8bc6207-kube-api-access-bkhts" pod "291938d2-446e-4474-af93-1ac6e8bc6207" (UID: "291938d2-446e-4474-af93-1ac6e8bc6207"). InnerVolumeSpecName "kube-api-access-bkhts". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:02:50.533747 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:50.533721 5857 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/291938d2-446e-4474-af93-1ac6e8bc6207-console-config\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:02:50.533747 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:50.533744 5857 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/291938d2-446e-4474-af93-1ac6e8bc6207-service-ca\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:02:50.533747 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:50.533754 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkhts\" (UniqueName: \"kubernetes.io/projected/291938d2-446e-4474-af93-1ac6e8bc6207-kube-api-access-bkhts\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:02:50.534259 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:50.533763 5857 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/291938d2-446e-4474-af93-1ac6e8bc6207-console-oauth-config\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:02:50.534259 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:50.533772 5857 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/291938d2-446e-4474-af93-1ac6e8bc6207-oauth-serving-cert\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:02:50.534259 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:50.533780 5857 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/291938d2-446e-4474-af93-1ac6e8bc6207-tmp\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:02:50.534259 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:50.533789 5857 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/291938d2-446e-4474-af93-1ac6e8bc6207-console-serving-cert\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:02:50.534259 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:50.533798 5857 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/291938d2-446e-4474-af93-1ac6e8bc6207-trusted-ca-bundle\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:02:50.991698 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:50.991663 5857 generic.go:356] "Generic (PLEG): container finished" podID="291938d2-446e-4474-af93-1ac6e8bc6207" containerID="69af7f1347bee5f8664ec90c50e9007ee55afddb754f7eb2a5d02b257a315059" exitCode=0 Nov 03 20:02:50.991853 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:50.991713 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59fc69cc99-ktxbb" Nov 03 20:02:50.991853 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:50.991743 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59fc69cc99-ktxbb" event={"ID":"291938d2-446e-4474-af93-1ac6e8bc6207","Type":"ContainerDied","Data":"69af7f1347bee5f8664ec90c50e9007ee55afddb754f7eb2a5d02b257a315059"} Nov 03 20:02:50.991853 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:50.991817 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59fc69cc99-ktxbb" event={"ID":"291938d2-446e-4474-af93-1ac6e8bc6207","Type":"ContainerDied","Data":"ae3236195a50b31bbb75267d594e869e57f85c8e47167e35215721bccf312aa8"} Nov 03 20:02:50.991853 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:50.991846 5857 scope.go:122] "RemoveContainer" containerID="69af7f1347bee5f8664ec90c50e9007ee55afddb754f7eb2a5d02b257a315059" Nov 03 20:02:51.000123 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:51.000106 5857 scope.go:122] "RemoveContainer" containerID="69af7f1347bee5f8664ec90c50e9007ee55afddb754f7eb2a5d02b257a315059" Nov 03 20:02:51.000655 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:02:51.000630 5857 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69af7f1347bee5f8664ec90c50e9007ee55afddb754f7eb2a5d02b257a315059\": container with ID starting with 69af7f1347bee5f8664ec90c50e9007ee55afddb754f7eb2a5d02b257a315059 not found: ID does not exist" containerID="69af7f1347bee5f8664ec90c50e9007ee55afddb754f7eb2a5d02b257a315059" Nov 03 20:02:51.000726 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:51.000667 5857 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69af7f1347bee5f8664ec90c50e9007ee55afddb754f7eb2a5d02b257a315059"} err="failed to get container status \"69af7f1347bee5f8664ec90c50e9007ee55afddb754f7eb2a5d02b257a315059\": rpc error: code = NotFound desc = could not find container \"69af7f1347bee5f8664ec90c50e9007ee55afddb754f7eb2a5d02b257a315059\": container with ID starting with 69af7f1347bee5f8664ec90c50e9007ee55afddb754f7eb2a5d02b257a315059 not found: ID does not exist" Nov 03 20:02:51.154351 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:51.154318 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59fc69cc99-ktxbb"] Nov 03 20:02:51.203745 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:51.203714 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59fc69cc99-ktxbb"] Nov 03 20:02:52.571734 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:02:52.571699 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="291938d2-446e-4474-af93-1ac6e8bc6207" path="/var/lib/kubelet/pods/291938d2-446e-4474-af93-1ac6e8bc6207/volumes" Nov 03 20:03:19.499513 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:03:19.499433 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:03:49.498169 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:03:49.498128 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:04:19.498110 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:04:19.498067 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:04:49.497957 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:04:49.497870 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:05:19.498102 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:05:19.498060 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:05:31.735367 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:31.735334 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8x57k"] Nov 03 20:05:31.735838 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:31.735729 5857 cpu_manager.go:414] "containerMap: removing container" podUID="291938d2-446e-4474-af93-1ac6e8bc6207" containerName="console" Nov 03 20:05:31.735838 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:31.735741 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="291938d2-446e-4474-af93-1ac6e8bc6207" containerName="console" Nov 03 20:05:31.735838 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:31.735804 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="291938d2-446e-4474-af93-1ac6e8bc6207" containerName="console" Nov 03 20:05:31.738983 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:31.738967 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8x57k" Nov 03 20:05:31.790990 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:31.790969 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Nov 03 20:05:31.809604 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:31.809551 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9c4e7a4-4e5f-4137-ab32-f9006ebb0475-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8x57k\" (UID: \"d9c4e7a4-4e5f-4137-ab32-f9006ebb0475\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8x57k" Nov 03 20:05:31.809744 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:31.809633 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwzf2\" (UniqueName: \"kubernetes.io/projected/d9c4e7a4-4e5f-4137-ab32-f9006ebb0475-kube-api-access-nwzf2\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8x57k\" (UID: \"d9c4e7a4-4e5f-4137-ab32-f9006ebb0475\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8x57k" Nov 03 20:05:31.809801 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:31.809777 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9c4e7a4-4e5f-4137-ab32-f9006ebb0475-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8x57k\" (UID: \"d9c4e7a4-4e5f-4137-ab32-f9006ebb0475\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8x57k" Nov 03 20:05:31.840480 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:31.840456 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Nov 03 20:05:31.840630 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:31.840586 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c7537007944577f64df34960ace3c69136c416-139ec370-dockercfg-mqfxj\"" Nov 03 20:05:31.841243 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:31.841223 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8x57k"] Nov 03 20:05:31.911044 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:31.911019 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9c4e7a4-4e5f-4137-ab32-f9006ebb0475-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8x57k\" (UID: \"d9c4e7a4-4e5f-4137-ab32-f9006ebb0475\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8x57k" Nov 03 20:05:31.911148 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:31.911054 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwzf2\" (UniqueName: \"kubernetes.io/projected/d9c4e7a4-4e5f-4137-ab32-f9006ebb0475-kube-api-access-nwzf2\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8x57k\" (UID: \"d9c4e7a4-4e5f-4137-ab32-f9006ebb0475\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8x57k" Nov 03 20:05:31.911148 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:31.911076 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9c4e7a4-4e5f-4137-ab32-f9006ebb0475-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8x57k\" (UID: \"d9c4e7a4-4e5f-4137-ab32-f9006ebb0475\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8x57k" Nov 03 20:05:31.911380 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:31.911363 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9c4e7a4-4e5f-4137-ab32-f9006ebb0475-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8x57k\" (UID: \"d9c4e7a4-4e5f-4137-ab32-f9006ebb0475\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8x57k" Nov 03 20:05:31.911449 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:31.911431 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9c4e7a4-4e5f-4137-ab32-f9006ebb0475-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8x57k\" (UID: \"d9c4e7a4-4e5f-4137-ab32-f9006ebb0475\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8x57k" Nov 03 20:05:31.971670 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:31.971643 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwzf2\" (UniqueName: \"kubernetes.io/projected/d9c4e7a4-4e5f-4137-ab32-f9006ebb0475-kube-api-access-nwzf2\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8x57k\" (UID: \"d9c4e7a4-4e5f-4137-ab32-f9006ebb0475\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8x57k" Nov 03 20:05:32.054166 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:32.054098 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8x57k" Nov 03 20:05:32.425175 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:32.425095 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8x57k"] Nov 03 20:05:32.456810 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:05:32.456783 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9c4e7a4_4e5f_4137_ab32_f9006ebb0475.slice/crio-fb737284c3c40ebfde06ffeb00fed59b36eb10d0e7d4109cb4b8c89755607d91 WatchSource:0}: Error finding container fb737284c3c40ebfde06ffeb00fed59b36eb10d0e7d4109cb4b8c89755607d91: Status 404 returned error can't find the container with id fb737284c3c40ebfde06ffeb00fed59b36eb10d0e7d4109cb4b8c89755607d91 Nov 03 20:05:32.459225 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:32.459209 5857 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 03 20:05:32.563550 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:32.563516 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8x57k" event={"ID":"d9c4e7a4-4e5f-4137-ab32-f9006ebb0475","Type":"ContainerStarted","Data":"fb737284c3c40ebfde06ffeb00fed59b36eb10d0e7d4109cb4b8c89755607d91"} Nov 03 20:05:38.589752 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:38.589716 5857 generic.go:356] "Generic (PLEG): container finished" podID="d9c4e7a4-4e5f-4137-ab32-f9006ebb0475" containerID="4716a5730cc3dc4d1b5a655f4529fdceb2da089ba3576263e67e9c0bc82e8454" exitCode=0 Nov 03 20:05:38.590185 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:38.589767 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8x57k" event={"ID":"d9c4e7a4-4e5f-4137-ab32-f9006ebb0475","Type":"ContainerDied","Data":"4716a5730cc3dc4d1b5a655f4529fdceb2da089ba3576263e67e9c0bc82e8454"} Nov 03 20:05:42.605966 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:42.605926 5857 generic.go:356] "Generic (PLEG): container finished" podID="d9c4e7a4-4e5f-4137-ab32-f9006ebb0475" containerID="f97e0b5aef2a8b1f92aa13945596cf36d0d8283a62a71e5443738a5a86eeddc9" exitCode=0 Nov 03 20:05:42.606458 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:42.606011 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8x57k" event={"ID":"d9c4e7a4-4e5f-4137-ab32-f9006ebb0475","Type":"ContainerDied","Data":"f97e0b5aef2a8b1f92aa13945596cf36d0d8283a62a71e5443738a5a86eeddc9"} Nov 03 20:05:49.498754 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:05:49.498719 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:05:49.635072 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:49.635038 5857 generic.go:356] "Generic (PLEG): container finished" podID="d9c4e7a4-4e5f-4137-ab32-f9006ebb0475" containerID="91d5aa8b1bec8164eb291ca1cd350a17c8199949c2549f8438008461bbee085d" exitCode=0 Nov 03 20:05:49.635269 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:49.635108 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8x57k" event={"ID":"d9c4e7a4-4e5f-4137-ab32-f9006ebb0475","Type":"ContainerDied","Data":"91d5aa8b1bec8164eb291ca1cd350a17c8199949c2549f8438008461bbee085d"} Nov 03 20:05:50.766053 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:50.766032 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8x57k" Nov 03 20:05:50.875277 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:50.875247 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d9c4e7a4-4e5f-4137-ab32-f9006ebb0475-bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9c4e7a4-4e5f-4137-ab32-f9006ebb0475-bundle\") pod \"d9c4e7a4-4e5f-4137-ab32-f9006ebb0475\" (UID: \"d9c4e7a4-4e5f-4137-ab32-f9006ebb0475\") " Nov 03 20:05:50.875398 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:50.875310 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d9c4e7a4-4e5f-4137-ab32-f9006ebb0475-kube-api-access-nwzf2\" (UniqueName: \"kubernetes.io/projected/d9c4e7a4-4e5f-4137-ab32-f9006ebb0475-kube-api-access-nwzf2\") pod \"d9c4e7a4-4e5f-4137-ab32-f9006ebb0475\" (UID: \"d9c4e7a4-4e5f-4137-ab32-f9006ebb0475\") " Nov 03 20:05:50.875398 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:50.875333 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d9c4e7a4-4e5f-4137-ab32-f9006ebb0475-util\" (UniqueName: \"kubernetes.io/empty-dir/d9c4e7a4-4e5f-4137-ab32-f9006ebb0475-util\") pod \"d9c4e7a4-4e5f-4137-ab32-f9006ebb0475\" (UID: \"d9c4e7a4-4e5f-4137-ab32-f9006ebb0475\") " Nov 03 20:05:50.875914 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:50.875889 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9c4e7a4-4e5f-4137-ab32-f9006ebb0475-bundle" pod "d9c4e7a4-4e5f-4137-ab32-f9006ebb0475" (UID: "d9c4e7a4-4e5f-4137-ab32-f9006ebb0475"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:05:50.877461 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:50.877439 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9c4e7a4-4e5f-4137-ab32-f9006ebb0475-kube-api-access-nwzf2" pod "d9c4e7a4-4e5f-4137-ab32-f9006ebb0475" (UID: "d9c4e7a4-4e5f-4137-ab32-f9006ebb0475"). InnerVolumeSpecName "kube-api-access-nwzf2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:05:50.879670 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:50.879646 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9c4e7a4-4e5f-4137-ab32-f9006ebb0475-util" pod "d9c4e7a4-4e5f-4137-ab32-f9006ebb0475" (UID: "d9c4e7a4-4e5f-4137-ab32-f9006ebb0475"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:05:50.975888 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:50.975859 5857 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9c4e7a4-4e5f-4137-ab32-f9006ebb0475-util\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:05:50.975888 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:50.975888 5857 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9c4e7a4-4e5f-4137-ab32-f9006ebb0475-bundle\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:05:50.976058 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:50.975903 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwzf2\" (UniqueName: \"kubernetes.io/projected/d9c4e7a4-4e5f-4137-ab32-f9006ebb0475-kube-api-access-nwzf2\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:05:51.643398 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:51.643354 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8x57k" event={"ID":"d9c4e7a4-4e5f-4137-ab32-f9006ebb0475","Type":"ContainerDied","Data":"fb737284c3c40ebfde06ffeb00fed59b36eb10d0e7d4109cb4b8c89755607d91"} Nov 03 20:05:51.643586 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:51.643417 5857 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb737284c3c40ebfde06ffeb00fed59b36eb10d0e7d4109cb4b8c89755607d91" Nov 03 20:05:51.643586 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:51.643374 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8x57k" Nov 03 20:05:54.876007 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:54.875961 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-65fc875df4-x62vd"] Nov 03 20:05:54.876494 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:54.876478 5857 cpu_manager.go:414] "containerMap: removing container" podUID="d9c4e7a4-4e5f-4137-ab32-f9006ebb0475" containerName="util" Nov 03 20:05:54.876540 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:54.876496 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d9c4e7a4-4e5f-4137-ab32-f9006ebb0475" containerName="util" Nov 03 20:05:54.876540 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:54.876512 5857 cpu_manager.go:414] "containerMap: removing container" podUID="d9c4e7a4-4e5f-4137-ab32-f9006ebb0475" containerName="extract" Nov 03 20:05:54.876540 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:54.876521 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d9c4e7a4-4e5f-4137-ab32-f9006ebb0475" containerName="extract" Nov 03 20:05:54.876670 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:54.876540 5857 cpu_manager.go:414] "containerMap: removing container" podUID="d9c4e7a4-4e5f-4137-ab32-f9006ebb0475" containerName="pull" Nov 03 20:05:54.876670 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:54.876546 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d9c4e7a4-4e5f-4137-ab32-f9006ebb0475" containerName="pull" Nov 03 20:05:54.876670 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:54.876630 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="d9c4e7a4-4e5f-4137-ab32-f9006ebb0475" containerName="extract" Nov 03 20:05:54.916721 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:54.916699 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-65fc875df4-x62vd" Nov 03 20:05:54.931608 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:54.931585 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-65fc875df4-x62vd"] Nov 03 20:05:54.980282 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:54.980252 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Nov 03 20:05:54.980421 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:54.980302 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-7nqw5\"" Nov 03 20:05:54.980421 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:54.980343 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Nov 03 20:05:55.108632 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:55.108606 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e1d31d1-a622-4b91-8b06-850fcbde63b2-tmp\") pod \"cert-manager-operator-controller-manager-65fc875df4-x62vd\" (UID: \"2e1d31d1-a622-4b91-8b06-850fcbde63b2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-65fc875df4-x62vd" Nov 03 20:05:55.108762 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:55.108664 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvg6n\" (UniqueName: \"kubernetes.io/projected/2e1d31d1-a622-4b91-8b06-850fcbde63b2-kube-api-access-vvg6n\") pod \"cert-manager-operator-controller-manager-65fc875df4-x62vd\" (UID: \"2e1d31d1-a622-4b91-8b06-850fcbde63b2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-65fc875df4-x62vd" Nov 03 20:05:55.209316 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:55.209288 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvg6n\" (UniqueName: \"kubernetes.io/projected/2e1d31d1-a622-4b91-8b06-850fcbde63b2-kube-api-access-vvg6n\") pod \"cert-manager-operator-controller-manager-65fc875df4-x62vd\" (UID: \"2e1d31d1-a622-4b91-8b06-850fcbde63b2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-65fc875df4-x62vd" Nov 03 20:05:55.209467 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:55.209344 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e1d31d1-a622-4b91-8b06-850fcbde63b2-tmp\") pod \"cert-manager-operator-controller-manager-65fc875df4-x62vd\" (UID: \"2e1d31d1-a622-4b91-8b06-850fcbde63b2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-65fc875df4-x62vd" Nov 03 20:05:55.209693 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:55.209675 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e1d31d1-a622-4b91-8b06-850fcbde63b2-tmp\") pod \"cert-manager-operator-controller-manager-65fc875df4-x62vd\" (UID: \"2e1d31d1-a622-4b91-8b06-850fcbde63b2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-65fc875df4-x62vd" Nov 03 20:05:55.270169 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:55.270133 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvg6n\" (UniqueName: \"kubernetes.io/projected/2e1d31d1-a622-4b91-8b06-850fcbde63b2-kube-api-access-vvg6n\") pod \"cert-manager-operator-controller-manager-65fc875df4-x62vd\" (UID: \"2e1d31d1-a622-4b91-8b06-850fcbde63b2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-65fc875df4-x62vd" Nov 03 20:05:55.540851 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:55.540769 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-65fc875df4-x62vd" Nov 03 20:05:56.033652 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:56.033616 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-65fc875df4-x62vd"] Nov 03 20:05:56.037271 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:05:56.037248 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e1d31d1_a622_4b91_8b06_850fcbde63b2.slice/crio-385cc0c685e3cfe6d043bb59ca2f7e8e4f359df3ae693bc453871c26db78698d WatchSource:0}: Error finding container 385cc0c685e3cfe6d043bb59ca2f7e8e4f359df3ae693bc453871c26db78698d: Status 404 returned error can't find the container with id 385cc0c685e3cfe6d043bb59ca2f7e8e4f359df3ae693bc453871c26db78698d Nov 03 20:05:56.664078 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:05:56.664044 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-65fc875df4-x62vd" event={"ID":"2e1d31d1-a622-4b91-8b06-850fcbde63b2","Type":"ContainerStarted","Data":"385cc0c685e3cfe6d043bb59ca2f7e8e4f359df3ae693bc453871c26db78698d"} Nov 03 20:06:03.697472 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:03.697436 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-65fc875df4-x62vd" event={"ID":"2e1d31d1-a622-4b91-8b06-850fcbde63b2","Type":"ContainerStarted","Data":"9e0c099c9026a73a81bb1626a8f8a6e6c9fbd2e45afa6935c9c293e250106fae"} Nov 03 20:06:03.915254 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:03.915179 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-65fc875df4-x62vd" podStartSLOduration=2.778292054 podStartE2EDuration="9.91516221s" totalImagesPullingTime="7.136870156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:05:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:06:03.865119649 +0000 UTC m=+273.432009796" watchObservedRunningTime="2026-11-03 20:06:03.91516221 +0000 UTC m=+273.482052361" Nov 03 20:06:05.670616 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:05.670583 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-8d75w"] Nov 03 20:06:05.672842 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:05.672828 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-8d75w" Nov 03 20:06:05.682828 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:05.682790 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8csmn\" (UniqueName: \"kubernetes.io/projected/4e094637-1215-4240-a160-c78ac71f9379-kube-api-access-8csmn\") pod \"cert-manager-webhook-5dbbbf75cc-8d75w\" (UID: \"4e094637-1215-4240-a160-c78ac71f9379\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-8d75w" Nov 03 20:06:05.682991 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:05.682970 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e094637-1215-4240-a160-c78ac71f9379-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-8d75w\" (UID: \"4e094637-1215-4240-a160-c78ac71f9379\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-8d75w" Nov 03 20:06:05.724962 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:05.724932 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Nov 03 20:06:05.774385 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:05.774354 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-cnq9w\"" Nov 03 20:06:05.774385 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:05.774377 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Nov 03 20:06:05.775221 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:05.775203 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-8d75w"] Nov 03 20:06:05.784021 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:05.783999 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8csmn\" (UniqueName: \"kubernetes.io/projected/4e094637-1215-4240-a160-c78ac71f9379-kube-api-access-8csmn\") pod \"cert-manager-webhook-5dbbbf75cc-8d75w\" (UID: \"4e094637-1215-4240-a160-c78ac71f9379\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-8d75w" Nov 03 20:06:05.784099 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:05.784068 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e094637-1215-4240-a160-c78ac71f9379-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-8d75w\" (UID: \"4e094637-1215-4240-a160-c78ac71f9379\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-8d75w" Nov 03 20:06:05.844829 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:05.844803 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e094637-1215-4240-a160-c78ac71f9379-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-8d75w\" (UID: \"4e094637-1215-4240-a160-c78ac71f9379\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-8d75w" Nov 03 20:06:05.844964 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:05.844873 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8csmn\" (UniqueName: \"kubernetes.io/projected/4e094637-1215-4240-a160-c78ac71f9379-kube-api-access-8csmn\") pod \"cert-manager-webhook-5dbbbf75cc-8d75w\" (UID: \"4e094637-1215-4240-a160-c78ac71f9379\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-8d75w" Nov 03 20:06:06.000243 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:06.000216 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-8d75w" Nov 03 20:06:06.370390 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:06.370317 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-8d75w"] Nov 03 20:06:06.373548 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:06:06.373526 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e094637_1215_4240_a160_c78ac71f9379.slice/crio-3fa8dd3594abf89ad5d823fa0658d894f77761337b92eef4fc7d17633fe52eb4 WatchSource:0}: Error finding container 3fa8dd3594abf89ad5d823fa0658d894f77761337b92eef4fc7d17633fe52eb4: Status 404 returned error can't find the container with id 3fa8dd3594abf89ad5d823fa0658d894f77761337b92eef4fc7d17633fe52eb4 Nov 03 20:06:06.711726 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:06.711692 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-8d75w" event={"ID":"4e094637-1215-4240-a160-c78ac71f9379","Type":"ContainerStarted","Data":"3fa8dd3594abf89ad5d823fa0658d894f77761337b92eef4fc7d17633fe52eb4"} Nov 03 20:06:10.729142 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:10.729103 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-8d75w" event={"ID":"4e094637-1215-4240-a160-c78ac71f9379","Type":"ContainerStarted","Data":"76acf0091e4b7edac5d28469ae8b99455b6fb58a99d733b2eaefaee6d11400a2"} Nov 03 20:06:10.729517 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:10.729240 5857 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-8d75w" Nov 03 20:06:10.843880 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:10.843825 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-8d75w" podStartSLOduration=1.914807599 podStartE2EDuration="5.843810899s" totalImagesPullingTime="3.9290033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:06:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:06:10.843642088 +0000 UTC m=+280.410532236" watchObservedRunningTime="2026-11-03 20:06:10.843810899 +0000 UTC m=+280.410701046" Nov 03 20:06:11.542291 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:11.542258 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-7rtxm"] Nov 03 20:06:11.544436 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:11.544421 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7rtxm" Nov 03 20:06:11.596322 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:11.596293 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-92xqq\"" Nov 03 20:06:11.631833 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:11.631784 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4nbh\" (UniqueName: \"kubernetes.io/projected/87daeb43-1a2a-44eb-9a09-6fd79908eb8a-kube-api-access-t4nbh\") pod \"cert-manager-cainjector-5c57bbd4fc-7rtxm\" (UID: \"87daeb43-1a2a-44eb-9a09-6fd79908eb8a\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7rtxm" Nov 03 20:06:11.631998 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:11.631902 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87daeb43-1a2a-44eb-9a09-6fd79908eb8a-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-7rtxm\" (UID: \"87daeb43-1a2a-44eb-9a09-6fd79908eb8a\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7rtxm" Nov 03 20:06:11.646591 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:11.646530 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-7rtxm"] Nov 03 20:06:11.732727 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:11.732696 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87daeb43-1a2a-44eb-9a09-6fd79908eb8a-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-7rtxm\" (UID: \"87daeb43-1a2a-44eb-9a09-6fd79908eb8a\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7rtxm" Nov 03 20:06:11.733109 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:11.732760 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4nbh\" (UniqueName: \"kubernetes.io/projected/87daeb43-1a2a-44eb-9a09-6fd79908eb8a-kube-api-access-t4nbh\") pod \"cert-manager-cainjector-5c57bbd4fc-7rtxm\" (UID: \"87daeb43-1a2a-44eb-9a09-6fd79908eb8a\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7rtxm" Nov 03 20:06:11.793634 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:11.793555 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87daeb43-1a2a-44eb-9a09-6fd79908eb8a-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-7rtxm\" (UID: \"87daeb43-1a2a-44eb-9a09-6fd79908eb8a\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7rtxm" Nov 03 20:06:11.793806 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:11.793781 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4nbh\" (UniqueName: \"kubernetes.io/projected/87daeb43-1a2a-44eb-9a09-6fd79908eb8a-kube-api-access-t4nbh\") pod \"cert-manager-cainjector-5c57bbd4fc-7rtxm\" (UID: \"87daeb43-1a2a-44eb-9a09-6fd79908eb8a\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7rtxm" Nov 03 20:06:11.854671 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:11.854639 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7rtxm" Nov 03 20:06:12.221330 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:12.221295 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-7rtxm"] Nov 03 20:06:12.225322 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:06:12.225295 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod87daeb43_1a2a_44eb_9a09_6fd79908eb8a.slice/crio-e6ed2b268650b0013fb6e0801da2e073926744c23ec97adf59f90937056e6599 WatchSource:0}: Error finding container e6ed2b268650b0013fb6e0801da2e073926744c23ec97adf59f90937056e6599: Status 404 returned error can't find the container with id e6ed2b268650b0013fb6e0801da2e073926744c23ec97adf59f90937056e6599 Nov 03 20:06:12.739166 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:12.739126 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7rtxm" event={"ID":"87daeb43-1a2a-44eb-9a09-6fd79908eb8a","Type":"ContainerStarted","Data":"df709e980efebc5020f7062e43d6afb3395900f4e8b9935b252f60a2984faa99"} Nov 03 20:06:12.739608 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:12.739176 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7rtxm" event={"ID":"87daeb43-1a2a-44eb-9a09-6fd79908eb8a","Type":"ContainerStarted","Data":"e6ed2b268650b0013fb6e0801da2e073926744c23ec97adf59f90937056e6599"} Nov 03 20:06:12.853991 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:12.853937 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7rtxm" podStartSLOduration=1.853923022 podStartE2EDuration="1.853923022s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:06:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:06:12.853059315 +0000 UTC m=+282.419949463" watchObservedRunningTime="2026-11-03 20:06:12.853923022 +0000 UTC m=+282.420813161" Nov 03 20:06:16.735006 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:16.734970 5857 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-8d75w" Nov 03 20:06:19.498350 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:06:19.498311 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:06:22.004723 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:22.004687 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gg578"] Nov 03 20:06:22.007213 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:22.007195 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gg578" Nov 03 20:06:22.108882 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:22.108854 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Nov 03 20:06:22.108882 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:22.108891 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c4959aeb960c8e20c88ac2de924a35b8221494-145dcd5a-dockercfg-7bctq\"" Nov 03 20:06:22.109094 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:22.108952 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Nov 03 20:06:22.109816 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:22.109797 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gg578"] Nov 03 20:06:22.126156 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:22.126130 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de038b03-6515-49c1-b22c-6d7f71d04d92-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gg578\" (UID: \"de038b03-6515-49c1-b22c-6d7f71d04d92\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gg578" Nov 03 20:06:22.126274 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:22.126164 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de038b03-6515-49c1-b22c-6d7f71d04d92-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gg578\" (UID: \"de038b03-6515-49c1-b22c-6d7f71d04d92\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gg578" Nov 03 20:06:22.126274 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:22.126191 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5wh2\" (UniqueName: \"kubernetes.io/projected/de038b03-6515-49c1-b22c-6d7f71d04d92-kube-api-access-x5wh2\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gg578\" (UID: \"de038b03-6515-49c1-b22c-6d7f71d04d92\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gg578" Nov 03 20:06:22.226768 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:22.226737 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de038b03-6515-49c1-b22c-6d7f71d04d92-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gg578\" (UID: \"de038b03-6515-49c1-b22c-6d7f71d04d92\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gg578" Nov 03 20:06:22.226899 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:22.226774 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de038b03-6515-49c1-b22c-6d7f71d04d92-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gg578\" (UID: \"de038b03-6515-49c1-b22c-6d7f71d04d92\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gg578" Nov 03 20:06:22.226899 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:22.226796 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5wh2\" (UniqueName: \"kubernetes.io/projected/de038b03-6515-49c1-b22c-6d7f71d04d92-kube-api-access-x5wh2\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gg578\" (UID: \"de038b03-6515-49c1-b22c-6d7f71d04d92\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gg578" Nov 03 20:06:22.227207 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:22.227183 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de038b03-6515-49c1-b22c-6d7f71d04d92-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gg578\" (UID: \"de038b03-6515-49c1-b22c-6d7f71d04d92\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gg578" Nov 03 20:06:22.227243 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:22.227190 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de038b03-6515-49c1-b22c-6d7f71d04d92-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gg578\" (UID: \"de038b03-6515-49c1-b22c-6d7f71d04d92\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gg578" Nov 03 20:06:22.287957 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:22.287885 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5wh2\" (UniqueName: \"kubernetes.io/projected/de038b03-6515-49c1-b22c-6d7f71d04d92-kube-api-access-x5wh2\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gg578\" (UID: \"de038b03-6515-49c1-b22c-6d7f71d04d92\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gg578" Nov 03 20:06:22.319848 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:22.319805 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gg578" Nov 03 20:06:22.689091 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:22.689020 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gg578"] Nov 03 20:06:22.692518 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:06:22.692488 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde038b03_6515_49c1_b22c_6d7f71d04d92.slice/crio-fa5e7b18758f3d2f5c8db4138f2fe0b247aed4fa70e7b45f787cfad4fa95a3e1 WatchSource:0}: Error finding container fa5e7b18758f3d2f5c8db4138f2fe0b247aed4fa70e7b45f787cfad4fa95a3e1: Status 404 returned error can't find the container with id fa5e7b18758f3d2f5c8db4138f2fe0b247aed4fa70e7b45f787cfad4fa95a3e1 Nov 03 20:06:22.786033 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:22.786007 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gg578" event={"ID":"de038b03-6515-49c1-b22c-6d7f71d04d92","Type":"ContainerStarted","Data":"1d0dbdbac0afbc8ba9b4868aa70c4e2805f88e834c510506f337e9f41e837f3c"} Nov 03 20:06:22.786154 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:22.786069 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gg578" event={"ID":"de038b03-6515-49c1-b22c-6d7f71d04d92","Type":"ContainerStarted","Data":"fa5e7b18758f3d2f5c8db4138f2fe0b247aed4fa70e7b45f787cfad4fa95a3e1"} Nov 03 20:06:23.792507 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:23.792469 5857 generic.go:356] "Generic (PLEG): container finished" podID="de038b03-6515-49c1-b22c-6d7f71d04d92" containerID="1d0dbdbac0afbc8ba9b4868aa70c4e2805f88e834c510506f337e9f41e837f3c" exitCode=0 Nov 03 20:06:23.792902 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:23.792557 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gg578" event={"ID":"de038b03-6515-49c1-b22c-6d7f71d04d92","Type":"ContainerDied","Data":"1d0dbdbac0afbc8ba9b4868aa70c4e2805f88e834c510506f337e9f41e837f3c"} Nov 03 20:06:27.813109 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:27.813076 5857 generic.go:356] "Generic (PLEG): container finished" podID="de038b03-6515-49c1-b22c-6d7f71d04d92" containerID="70c2818af938d1a86d8376908f0cd7d9bef92ddbb65b0556bfb60d574287c6d9" exitCode=0 Nov 03 20:06:27.813597 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:27.813124 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gg578" event={"ID":"de038b03-6515-49c1-b22c-6d7f71d04d92","Type":"ContainerDied","Data":"70c2818af938d1a86d8376908f0cd7d9bef92ddbb65b0556bfb60d574287c6d9"} Nov 03 20:06:28.819476 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:28.819441 5857 generic.go:356] "Generic (PLEG): container finished" podID="de038b03-6515-49c1-b22c-6d7f71d04d92" containerID="c98c9c417d89ba5928a510619ddfcab67bad9d812bf90fe69ec1d27e40df7e61" exitCode=0 Nov 03 20:06:28.819877 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:28.819524 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gg578" event={"ID":"de038b03-6515-49c1-b22c-6d7f71d04d92","Type":"ContainerDied","Data":"c98c9c417d89ba5928a510619ddfcab67bad9d812bf90fe69ec1d27e40df7e61"} Nov 03 20:06:29.952735 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:29.952712 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gg578" Nov 03 20:06:30.098501 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:30.098414 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/de038b03-6515-49c1-b22c-6d7f71d04d92-bundle\" (UniqueName: \"kubernetes.io/empty-dir/de038b03-6515-49c1-b22c-6d7f71d04d92-bundle\") pod \"de038b03-6515-49c1-b22c-6d7f71d04d92\" (UID: \"de038b03-6515-49c1-b22c-6d7f71d04d92\") " Nov 03 20:06:30.098501 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:30.098447 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/de038b03-6515-49c1-b22c-6d7f71d04d92-util\" (UniqueName: \"kubernetes.io/empty-dir/de038b03-6515-49c1-b22c-6d7f71d04d92-util\") pod \"de038b03-6515-49c1-b22c-6d7f71d04d92\" (UID: \"de038b03-6515-49c1-b22c-6d7f71d04d92\") " Nov 03 20:06:30.098749 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:30.098550 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/de038b03-6515-49c1-b22c-6d7f71d04d92-kube-api-access-x5wh2\" (UniqueName: \"kubernetes.io/projected/de038b03-6515-49c1-b22c-6d7f71d04d92-kube-api-access-x5wh2\") pod \"de038b03-6515-49c1-b22c-6d7f71d04d92\" (UID: \"de038b03-6515-49c1-b22c-6d7f71d04d92\") " Nov 03 20:06:30.098938 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:30.098897 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de038b03-6515-49c1-b22c-6d7f71d04d92-bundle" pod "de038b03-6515-49c1-b22c-6d7f71d04d92" (UID: "de038b03-6515-49c1-b22c-6d7f71d04d92"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:06:30.100984 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:30.100959 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de038b03-6515-49c1-b22c-6d7f71d04d92-kube-api-access-x5wh2" pod "de038b03-6515-49c1-b22c-6d7f71d04d92" (UID: "de038b03-6515-49c1-b22c-6d7f71d04d92"). InnerVolumeSpecName "kube-api-access-x5wh2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:06:30.103249 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:30.103218 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de038b03-6515-49c1-b22c-6d7f71d04d92-util" pod "de038b03-6515-49c1-b22c-6d7f71d04d92" (UID: "de038b03-6515-49c1-b22c-6d7f71d04d92"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:06:30.199470 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:30.199411 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5wh2\" (UniqueName: \"kubernetes.io/projected/de038b03-6515-49c1-b22c-6d7f71d04d92-kube-api-access-x5wh2\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:06:30.199470 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:30.199442 5857 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de038b03-6515-49c1-b22c-6d7f71d04d92-bundle\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:06:30.199470 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:30.199451 5857 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de038b03-6515-49c1-b22c-6d7f71d04d92-util\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:06:30.829311 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:30.829236 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gg578" Nov 03 20:06:30.829454 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:30.829237 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gg578" event={"ID":"de038b03-6515-49c1-b22c-6d7f71d04d92","Type":"ContainerDied","Data":"fa5e7b18758f3d2f5c8db4138f2fe0b247aed4fa70e7b45f787cfad4fa95a3e1"} Nov 03 20:06:30.829454 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:30.829367 5857 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa5e7b18758f3d2f5c8db4138f2fe0b247aed4fa70e7b45f787cfad4fa95a3e1" Nov 03 20:06:40.604070 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:40.604041 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-854c7f58d8-sv6nv"] Nov 03 20:06:40.604519 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:40.604351 5857 cpu_manager.go:414] "containerMap: removing container" podUID="de038b03-6515-49c1-b22c-6d7f71d04d92" containerName="util" Nov 03 20:06:40.604519 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:40.604361 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="de038b03-6515-49c1-b22c-6d7f71d04d92" containerName="util" Nov 03 20:06:40.604519 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:40.604375 5857 cpu_manager.go:414] "containerMap: removing container" podUID="de038b03-6515-49c1-b22c-6d7f71d04d92" containerName="extract" Nov 03 20:06:40.604519 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:40.604381 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="de038b03-6515-49c1-b22c-6d7f71d04d92" containerName="extract" Nov 03 20:06:40.604519 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:40.604391 5857 cpu_manager.go:414] "containerMap: removing container" podUID="de038b03-6515-49c1-b22c-6d7f71d04d92" containerName="pull" Nov 03 20:06:40.604519 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:40.604395 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="de038b03-6515-49c1-b22c-6d7f71d04d92" containerName="pull" Nov 03 20:06:40.604519 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:40.604450 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="de038b03-6515-49c1-b22c-6d7f71d04d92" containerName="extract" Nov 03 20:06:40.607243 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:40.607228 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-854c7f58d8-sv6nv" Nov 03 20:06:40.659429 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:40.659404 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Nov 03 20:06:40.689446 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:40.689415 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfq5z\" (UniqueName: \"kubernetes.io/projected/f56507ef-f63e-4696-a33b-92d6be9cc246-kube-api-access-lfq5z\") pod \"jobset-operator-854c7f58d8-sv6nv\" (UID: \"f56507ef-f63e-4696-a33b-92d6be9cc246\") " pod="openshift-jobset-operator/jobset-operator-854c7f58d8-sv6nv" Nov 03 20:06:40.689599 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:40.689483 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f56507ef-f63e-4696-a33b-92d6be9cc246-tmp\") pod \"jobset-operator-854c7f58d8-sv6nv\" (UID: \"f56507ef-f63e-4696-a33b-92d6be9cc246\") " pod="openshift-jobset-operator/jobset-operator-854c7f58d8-sv6nv" Nov 03 20:06:40.708913 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:40.708888 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Nov 03 20:06:40.709023 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:40.708915 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-mvzjr\"" Nov 03 20:06:40.710072 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:40.710052 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-854c7f58d8-sv6nv"] Nov 03 20:06:40.790976 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:40.790948 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f56507ef-f63e-4696-a33b-92d6be9cc246-tmp\") pod \"jobset-operator-854c7f58d8-sv6nv\" (UID: \"f56507ef-f63e-4696-a33b-92d6be9cc246\") " pod="openshift-jobset-operator/jobset-operator-854c7f58d8-sv6nv" Nov 03 20:06:40.791115 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:40.790999 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfq5z\" (UniqueName: \"kubernetes.io/projected/f56507ef-f63e-4696-a33b-92d6be9cc246-kube-api-access-lfq5z\") pod \"jobset-operator-854c7f58d8-sv6nv\" (UID: \"f56507ef-f63e-4696-a33b-92d6be9cc246\") " pod="openshift-jobset-operator/jobset-operator-854c7f58d8-sv6nv" Nov 03 20:06:40.791319 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:40.791301 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f56507ef-f63e-4696-a33b-92d6be9cc246-tmp\") pod \"jobset-operator-854c7f58d8-sv6nv\" (UID: \"f56507ef-f63e-4696-a33b-92d6be9cc246\") " pod="openshift-jobset-operator/jobset-operator-854c7f58d8-sv6nv" Nov 03 20:06:40.852415 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:40.852375 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfq5z\" (UniqueName: \"kubernetes.io/projected/f56507ef-f63e-4696-a33b-92d6be9cc246-kube-api-access-lfq5z\") pod \"jobset-operator-854c7f58d8-sv6nv\" (UID: \"f56507ef-f63e-4696-a33b-92d6be9cc246\") " pod="openshift-jobset-operator/jobset-operator-854c7f58d8-sv6nv" Nov 03 20:06:40.918287 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:40.918208 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-854c7f58d8-sv6nv" Nov 03 20:06:41.287182 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:41.287153 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-854c7f58d8-sv6nv"] Nov 03 20:06:41.290405 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:06:41.290377 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf56507ef_f63e_4696_a33b_92d6be9cc246.slice/crio-bf42d892e14362471aabe1c1d0ed0fad7e2d31d16540954318182103a59393d0 WatchSource:0}: Error finding container bf42d892e14362471aabe1c1d0ed0fad7e2d31d16540954318182103a59393d0: Status 404 returned error can't find the container with id bf42d892e14362471aabe1c1d0ed0fad7e2d31d16540954318182103a59393d0 Nov 03 20:06:41.878659 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:41.878620 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-854c7f58d8-sv6nv" event={"ID":"f56507ef-f63e-4696-a33b-92d6be9cc246","Type":"ContainerStarted","Data":"bf42d892e14362471aabe1c1d0ed0fad7e2d31d16540954318182103a59393d0"} Nov 03 20:06:44.892187 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:44.892100 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-854c7f58d8-sv6nv" event={"ID":"f56507ef-f63e-4696-a33b-92d6be9cc246","Type":"ContainerStarted","Data":"1c3b45e44a675e54b362227066b557e5a7170d4e4f6c281c4f360e62d380a6f5"} Nov 03 20:06:45.008084 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:06:45.008018 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-854c7f58d8-sv6nv" podStartSLOduration=1.751085245 podStartE2EDuration="5.008002494s" totalImagesPullingTime="3.256917249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:06:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:06:45.006988954 +0000 UTC m=+314.573879101" watchObservedRunningTime="2026-11-03 20:06:45.008002494 +0000 UTC m=+314.574892648" Nov 03 20:06:49.498931 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:06:49.498888 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:07:19.011672 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:07:19.011643 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-5859b8957d-6j5bv"] Nov 03 20:07:19.015036 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:07:19.015016 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-5859b8957d-6j5bv" Nov 03 20:07:19.068081 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:07:19.068045 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Nov 03 20:07:19.110228 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:07:19.110187 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9lp6\" (UniqueName: \"kubernetes.io/projected/b41b7a93-d8bd-4079-a295-fd5359e7b59c-kube-api-access-g9lp6\") pod \"kubeflow-trainer-controller-manager-5859b8957d-6j5bv\" (UID: \"b41b7a93-d8bd-4079-a295-fd5359e7b59c\") " pod="opendatahub/kubeflow-trainer-controller-manager-5859b8957d-6j5bv" Nov 03 20:07:19.110525 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:07:19.110502 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b41b7a93-d8bd-4079-a295-fd5359e7b59c-cert\") pod \"kubeflow-trainer-controller-manager-5859b8957d-6j5bv\" (UID: \"b41b7a93-d8bd-4079-a295-fd5359e7b59c\") " pod="opendatahub/kubeflow-trainer-controller-manager-5859b8957d-6j5bv" Nov 03 20:07:19.110715 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:07:19.110698 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/b41b7a93-d8bd-4079-a295-fd5359e7b59c-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-5859b8957d-6j5bv\" (UID: \"b41b7a93-d8bd-4079-a295-fd5359e7b59c\") " pod="opendatahub/kubeflow-trainer-controller-manager-5859b8957d-6j5bv" Nov 03 20:07:19.117415 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:07:19.117377 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Nov 03 20:07:19.117750 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:07:19.117736 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Nov 03 20:07:19.117975 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:07:19.117962 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-hbk4v\"" Nov 03 20:07:19.118237 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:07:19.118216 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Nov 03 20:07:19.119727 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:07:19.119698 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-5859b8957d-6j5bv"] Nov 03 20:07:19.212156 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:07:19.212121 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9lp6\" (UniqueName: \"kubernetes.io/projected/b41b7a93-d8bd-4079-a295-fd5359e7b59c-kube-api-access-g9lp6\") pod \"kubeflow-trainer-controller-manager-5859b8957d-6j5bv\" (UID: \"b41b7a93-d8bd-4079-a295-fd5359e7b59c\") " pod="opendatahub/kubeflow-trainer-controller-manager-5859b8957d-6j5bv" Nov 03 20:07:19.212326 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:07:19.212182 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b41b7a93-d8bd-4079-a295-fd5359e7b59c-cert\") pod \"kubeflow-trainer-controller-manager-5859b8957d-6j5bv\" (UID: \"b41b7a93-d8bd-4079-a295-fd5359e7b59c\") " pod="opendatahub/kubeflow-trainer-controller-manager-5859b8957d-6j5bv" Nov 03 20:07:19.212326 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:07:19.212208 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/b41b7a93-d8bd-4079-a295-fd5359e7b59c-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-5859b8957d-6j5bv\" (UID: \"b41b7a93-d8bd-4079-a295-fd5359e7b59c\") " pod="opendatahub/kubeflow-trainer-controller-manager-5859b8957d-6j5bv" Nov 03 20:07:19.212849 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:07:19.212830 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/b41b7a93-d8bd-4079-a295-fd5359e7b59c-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-5859b8957d-6j5bv\" (UID: \"b41b7a93-d8bd-4079-a295-fd5359e7b59c\") " pod="opendatahub/kubeflow-trainer-controller-manager-5859b8957d-6j5bv" Nov 03 20:07:19.214829 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:07:19.214810 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b41b7a93-d8bd-4079-a295-fd5359e7b59c-cert\") pod \"kubeflow-trainer-controller-manager-5859b8957d-6j5bv\" (UID: \"b41b7a93-d8bd-4079-a295-fd5359e7b59c\") " pod="opendatahub/kubeflow-trainer-controller-manager-5859b8957d-6j5bv" Nov 03 20:07:19.273453 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:07:19.273384 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9lp6\" (UniqueName: \"kubernetes.io/projected/b41b7a93-d8bd-4079-a295-fd5359e7b59c-kube-api-access-g9lp6\") pod \"kubeflow-trainer-controller-manager-5859b8957d-6j5bv\" (UID: \"b41b7a93-d8bd-4079-a295-fd5359e7b59c\") " pod="opendatahub/kubeflow-trainer-controller-manager-5859b8957d-6j5bv" Nov 03 20:07:19.327317 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:07:19.327277 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-5859b8957d-6j5bv" Nov 03 20:07:19.501921 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:07:19.501883 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:07:19.699484 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:07:19.699386 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-5859b8957d-6j5bv"] Nov 03 20:07:19.702426 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:07:19.702394 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb41b7a93_d8bd_4079_a295_fd5359e7b59c.slice/crio-002441f2d2fe8752250587cc0c2c39c5d9affd27dfc2b2fc8f04de7d5cf0270c WatchSource:0}: Error finding container 002441f2d2fe8752250587cc0c2c39c5d9affd27dfc2b2fc8f04de7d5cf0270c: Status 404 returned error can't find the container with id 002441f2d2fe8752250587cc0c2c39c5d9affd27dfc2b2fc8f04de7d5cf0270c Nov 03 20:07:20.043625 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:07:20.043589 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-5859b8957d-6j5bv" event={"ID":"b41b7a93-d8bd-4079-a295-fd5359e7b59c","Type":"ContainerStarted","Data":"002441f2d2fe8752250587cc0c2c39c5d9affd27dfc2b2fc8f04de7d5cf0270c"} Nov 03 20:07:29.087628 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:07:29.087593 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-5859b8957d-6j5bv" event={"ID":"b41b7a93-d8bd-4079-a295-fd5359e7b59c","Type":"ContainerStarted","Data":"3a226ba49525f84cd5ea8c7d1cc7625132580b994deef597a42a5bd3e7bf7a67"} Nov 03 20:07:29.088030 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:07:29.087657 5857 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-5859b8957d-6j5bv" Nov 03 20:07:29.203360 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:07:29.203088 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-5859b8957d-6j5bv" podStartSLOduration=2.054773276 podStartE2EDuration="11.203071672s" totalImagesPullingTime="9.148298396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:07:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:07:29.202800566 +0000 UTC m=+358.769690705" watchObservedRunningTime="2026-11-03 20:07:29.203071672 +0000 UTC m=+358.769961820" Nov 03 20:07:45.093974 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:07:45.093876 5857 prober.go:122] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-5859b8957d-6j5bv" podUID="b41b7a93-d8bd-4079-a295-fd5359e7b59c" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Nov 03 20:07:49.499382 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:07:49.499342 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:08:00.092935 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:08:00.092895 5857 prober.go:122] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-5859b8957d-6j5bv" podUID="b41b7a93-d8bd-4079-a295-fd5359e7b59c" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Nov 03 20:08:15.093464 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:08:15.093418 5857 prober.go:122] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-5859b8957d-6j5bv" podUID="b41b7a93-d8bd-4079-a295-fd5359e7b59c" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Nov 03 20:08:19.498912 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:08:19.498868 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:08:30.093655 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:08:30.093614 5857 prober.go:122] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-5859b8957d-6j5bv" podUID="b41b7a93-d8bd-4079-a295-fd5359e7b59c" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Nov 03 20:08:32.568339 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:08:32.568290 5857 prober.go:122] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-5859b8957d-6j5bv" podUID="b41b7a93-d8bd-4079-a295-fd5359e7b59c" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Nov 03 20:08:47.568752 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:08:47.568706 5857 prober.go:122] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-5859b8957d-6j5bv" podUID="b41b7a93-d8bd-4079-a295-fd5359e7b59c" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Nov 03 20:08:49.498840 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:08:49.498798 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:09:02.572282 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:02.572256 5857 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-5859b8957d-6j5bv" Nov 03 20:09:07.051326 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:07.051290 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4b03a36ecd76e9a7e7f5972f194ca8efbbceec5fc84188e4f8a5456cefsmstc"] Nov 03 20:09:07.054775 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:07.054758 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4b03a36ecd76e9a7e7f5972f194ca8efbbceec5fc84188e4f8a5456cefsmstc" Nov 03 20:09:07.120114 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:07.120085 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64bzk\" (UniqueName: \"kubernetes.io/projected/8fe080e4-0ede-4090-952e-8c7f025c7a1b-kube-api-access-64bzk\") pod \"4b03a36ecd76e9a7e7f5972f194ca8efbbceec5fc84188e4f8a5456cefsmstc\" (UID: \"8fe080e4-0ede-4090-952e-8c7f025c7a1b\") " pod="openshift-marketplace/4b03a36ecd76e9a7e7f5972f194ca8efbbceec5fc84188e4f8a5456cefsmstc" Nov 03 20:09:07.120263 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:07.120132 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fe080e4-0ede-4090-952e-8c7f025c7a1b-bundle\") pod \"4b03a36ecd76e9a7e7f5972f194ca8efbbceec5fc84188e4f8a5456cefsmstc\" (UID: \"8fe080e4-0ede-4090-952e-8c7f025c7a1b\") " pod="openshift-marketplace/4b03a36ecd76e9a7e7f5972f194ca8efbbceec5fc84188e4f8a5456cefsmstc" Nov 03 20:09:07.120263 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:07.120241 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8fe080e4-0ede-4090-952e-8c7f025c7a1b-util\") pod \"4b03a36ecd76e9a7e7f5972f194ca8efbbceec5fc84188e4f8a5456cefsmstc\" (UID: \"8fe080e4-0ede-4090-952e-8c7f025c7a1b\") " pod="openshift-marketplace/4b03a36ecd76e9a7e7f5972f194ca8efbbceec5fc84188e4f8a5456cefsmstc" Nov 03 20:09:07.156313 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:07.156289 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Nov 03 20:09:07.156313 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:07.156289 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"4b03a36ecd76e9a7e7f5972f194ca8efbbceec-8788c165-dockercfg-lf4xq\"" Nov 03 20:09:07.156313 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:07.156310 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Nov 03 20:09:07.157376 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:07.157357 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4b03a36ecd76e9a7e7f5972f194ca8efbbceec5fc84188e4f8a5456cefsmstc"] Nov 03 20:09:07.221315 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:07.221287 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fe080e4-0ede-4090-952e-8c7f025c7a1b-bundle\") pod \"4b03a36ecd76e9a7e7f5972f194ca8efbbceec5fc84188e4f8a5456cefsmstc\" (UID: \"8fe080e4-0ede-4090-952e-8c7f025c7a1b\") " pod="openshift-marketplace/4b03a36ecd76e9a7e7f5972f194ca8efbbceec5fc84188e4f8a5456cefsmstc" Nov 03 20:09:07.221457 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:07.221339 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8fe080e4-0ede-4090-952e-8c7f025c7a1b-util\") pod \"4b03a36ecd76e9a7e7f5972f194ca8efbbceec5fc84188e4f8a5456cefsmstc\" (UID: \"8fe080e4-0ede-4090-952e-8c7f025c7a1b\") " pod="openshift-marketplace/4b03a36ecd76e9a7e7f5972f194ca8efbbceec5fc84188e4f8a5456cefsmstc" Nov 03 20:09:07.221457 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:07.221389 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64bzk\" (UniqueName: \"kubernetes.io/projected/8fe080e4-0ede-4090-952e-8c7f025c7a1b-kube-api-access-64bzk\") pod \"4b03a36ecd76e9a7e7f5972f194ca8efbbceec5fc84188e4f8a5456cefsmstc\" (UID: \"8fe080e4-0ede-4090-952e-8c7f025c7a1b\") " pod="openshift-marketplace/4b03a36ecd76e9a7e7f5972f194ca8efbbceec5fc84188e4f8a5456cefsmstc" Nov 03 20:09:07.221706 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:07.221686 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fe080e4-0ede-4090-952e-8c7f025c7a1b-bundle\") pod \"4b03a36ecd76e9a7e7f5972f194ca8efbbceec5fc84188e4f8a5456cefsmstc\" (UID: \"8fe080e4-0ede-4090-952e-8c7f025c7a1b\") " pod="openshift-marketplace/4b03a36ecd76e9a7e7f5972f194ca8efbbceec5fc84188e4f8a5456cefsmstc" Nov 03 20:09:07.221817 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:07.221798 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8fe080e4-0ede-4090-952e-8c7f025c7a1b-util\") pod \"4b03a36ecd76e9a7e7f5972f194ca8efbbceec5fc84188e4f8a5456cefsmstc\" (UID: \"8fe080e4-0ede-4090-952e-8c7f025c7a1b\") " pod="openshift-marketplace/4b03a36ecd76e9a7e7f5972f194ca8efbbceec5fc84188e4f8a5456cefsmstc" Nov 03 20:09:07.282198 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:07.282174 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64bzk\" (UniqueName: \"kubernetes.io/projected/8fe080e4-0ede-4090-952e-8c7f025c7a1b-kube-api-access-64bzk\") pod \"4b03a36ecd76e9a7e7f5972f194ca8efbbceec5fc84188e4f8a5456cefsmstc\" (UID: \"8fe080e4-0ede-4090-952e-8c7f025c7a1b\") " pod="openshift-marketplace/4b03a36ecd76e9a7e7f5972f194ca8efbbceec5fc84188e4f8a5456cefsmstc" Nov 03 20:09:07.370774 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:07.370688 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4b03a36ecd76e9a7e7f5972f194ca8efbbceec5fc84188e4f8a5456cefsmstc" Nov 03 20:09:07.739998 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:07.739848 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4b03a36ecd76e9a7e7f5972f194ca8efbbceec5fc84188e4f8a5456cefsmstc"] Nov 03 20:09:07.742885 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:09:07.742843 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fe080e4_0ede_4090_952e_8c7f025c7a1b.slice/crio-fd746acafe87bb96686cb35718d537e7d37ed51498e002b7e26a59cf17f23a37 WatchSource:0}: Error finding container fd746acafe87bb96686cb35718d537e7d37ed51498e002b7e26a59cf17f23a37: Status 404 returned error can't find the container with id fd746acafe87bb96686cb35718d537e7d37ed51498e002b7e26a59cf17f23a37 Nov 03 20:09:08.500978 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:08.500948 5857 generic.go:356] "Generic (PLEG): container finished" podID="8fe080e4-0ede-4090-952e-8c7f025c7a1b" containerID="25a62f5dea5302900d09cd1af0b17bd0a0bd68c1c1208fd5a240a6d4c6cbf0c3" exitCode=0 Nov 03 20:09:08.501394 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:08.500983 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4b03a36ecd76e9a7e7f5972f194ca8efbbceec5fc84188e4f8a5456cefsmstc" event={"ID":"8fe080e4-0ede-4090-952e-8c7f025c7a1b","Type":"ContainerDied","Data":"25a62f5dea5302900d09cd1af0b17bd0a0bd68c1c1208fd5a240a6d4c6cbf0c3"} Nov 03 20:09:08.501394 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:08.501019 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4b03a36ecd76e9a7e7f5972f194ca8efbbceec5fc84188e4f8a5456cefsmstc" event={"ID":"8fe080e4-0ede-4090-952e-8c7f025c7a1b","Type":"ContainerStarted","Data":"fd746acafe87bb96686cb35718d537e7d37ed51498e002b7e26a59cf17f23a37"} Nov 03 20:09:10.511427 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:10.511400 5857 generic.go:356] "Generic (PLEG): container finished" podID="8fe080e4-0ede-4090-952e-8c7f025c7a1b" containerID="12c195d487b6ac0c1c8810a11af853d7dc07cd94387da28c3cc2a7f08a157a96" exitCode=0 Nov 03 20:09:10.511895 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:10.511470 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4b03a36ecd76e9a7e7f5972f194ca8efbbceec5fc84188e4f8a5456cefsmstc" event={"ID":"8fe080e4-0ede-4090-952e-8c7f025c7a1b","Type":"ContainerDied","Data":"12c195d487b6ac0c1c8810a11af853d7dc07cd94387da28c3cc2a7f08a157a96"} Nov 03 20:09:11.517641 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:11.517605 5857 generic.go:356] "Generic (PLEG): container finished" podID="8fe080e4-0ede-4090-952e-8c7f025c7a1b" containerID="c32678dd5057208a6adadc9678241d96dbab68d8d525f73a5c9e06f9342e52c8" exitCode=0 Nov 03 20:09:11.518058 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:11.517688 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4b03a36ecd76e9a7e7f5972f194ca8efbbceec5fc84188e4f8a5456cefsmstc" event={"ID":"8fe080e4-0ede-4090-952e-8c7f025c7a1b","Type":"ContainerDied","Data":"c32678dd5057208a6adadc9678241d96dbab68d8d525f73a5c9e06f9342e52c8"} Nov 03 20:09:12.645857 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:12.645824 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4b03a36ecd76e9a7e7f5972f194ca8efbbceec5fc84188e4f8a5456cefsmstc" Nov 03 20:09:12.775380 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:12.775311 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8fe080e4-0ede-4090-952e-8c7f025c7a1b-util\" (UniqueName: \"kubernetes.io/empty-dir/8fe080e4-0ede-4090-952e-8c7f025c7a1b-util\") pod \"8fe080e4-0ede-4090-952e-8c7f025c7a1b\" (UID: \"8fe080e4-0ede-4090-952e-8c7f025c7a1b\") " Nov 03 20:09:12.775538 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:12.775401 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8fe080e4-0ede-4090-952e-8c7f025c7a1b-kube-api-access-64bzk\" (UniqueName: \"kubernetes.io/projected/8fe080e4-0ede-4090-952e-8c7f025c7a1b-kube-api-access-64bzk\") pod \"8fe080e4-0ede-4090-952e-8c7f025c7a1b\" (UID: \"8fe080e4-0ede-4090-952e-8c7f025c7a1b\") " Nov 03 20:09:12.775538 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:12.775425 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8fe080e4-0ede-4090-952e-8c7f025c7a1b-bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fe080e4-0ede-4090-952e-8c7f025c7a1b-bundle\") pod \"8fe080e4-0ede-4090-952e-8c7f025c7a1b\" (UID: \"8fe080e4-0ede-4090-952e-8c7f025c7a1b\") " Nov 03 20:09:12.775925 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:12.775895 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fe080e4-0ede-4090-952e-8c7f025c7a1b-bundle" pod "8fe080e4-0ede-4090-952e-8c7f025c7a1b" (UID: "8fe080e4-0ede-4090-952e-8c7f025c7a1b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:09:12.777696 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:12.777675 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fe080e4-0ede-4090-952e-8c7f025c7a1b-kube-api-access-64bzk" pod "8fe080e4-0ede-4090-952e-8c7f025c7a1b" (UID: "8fe080e4-0ede-4090-952e-8c7f025c7a1b"). InnerVolumeSpecName "kube-api-access-64bzk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:09:12.785192 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:12.785144 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fe080e4-0ede-4090-952e-8c7f025c7a1b-util" pod "8fe080e4-0ede-4090-952e-8c7f025c7a1b" (UID: "8fe080e4-0ede-4090-952e-8c7f025c7a1b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:09:12.876813 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:12.876784 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64bzk\" (UniqueName: \"kubernetes.io/projected/8fe080e4-0ede-4090-952e-8c7f025c7a1b-kube-api-access-64bzk\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:09:12.876813 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:12.876811 5857 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fe080e4-0ede-4090-952e-8c7f025c7a1b-bundle\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:09:12.876813 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:12.876821 5857 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8fe080e4-0ede-4090-952e-8c7f025c7a1b-util\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:09:13.528341 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:13.528313 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4b03a36ecd76e9a7e7f5972f194ca8efbbceec5fc84188e4f8a5456cefsmstc" Nov 03 20:09:13.528341 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:13.528329 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4b03a36ecd76e9a7e7f5972f194ca8efbbceec5fc84188e4f8a5456cefsmstc" event={"ID":"8fe080e4-0ede-4090-952e-8c7f025c7a1b","Type":"ContainerDied","Data":"fd746acafe87bb96686cb35718d537e7d37ed51498e002b7e26a59cf17f23a37"} Nov 03 20:09:13.528552 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:13.528369 5857 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fd746acafe87bb96686cb35718d537e7d37ed51498e002b7e26a59cf17f23a37" Nov 03 20:09:19.064326 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:19.064293 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kueue-operator/openshift-kueue-operator-86d856df97-vrf8s"] Nov 03 20:09:19.064714 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:19.064636 5857 cpu_manager.go:414] "containerMap: removing container" podUID="8fe080e4-0ede-4090-952e-8c7f025c7a1b" containerName="pull" Nov 03 20:09:19.064714 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:19.064648 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8fe080e4-0ede-4090-952e-8c7f025c7a1b" containerName="pull" Nov 03 20:09:19.064714 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:19.064657 5857 cpu_manager.go:414] "containerMap: removing container" podUID="8fe080e4-0ede-4090-952e-8c7f025c7a1b" containerName="extract" Nov 03 20:09:19.064714 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:19.064662 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8fe080e4-0ede-4090-952e-8c7f025c7a1b" containerName="extract" Nov 03 20:09:19.064714 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:19.064674 5857 cpu_manager.go:414] "containerMap: removing container" podUID="8fe080e4-0ede-4090-952e-8c7f025c7a1b" containerName="util" Nov 03 20:09:19.064714 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:19.064679 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8fe080e4-0ede-4090-952e-8c7f025c7a1b" containerName="util" Nov 03 20:09:19.064904 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:19.064747 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="8fe080e4-0ede-4090-952e-8c7f025c7a1b" containerName="extract" Nov 03 20:09:19.071672 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:19.071647 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kueue-operator/openshift-kueue-operator-86d856df97-vrf8s" Nov 03 20:09:19.175286 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:19.175253 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kueue-operator/openshift-kueue-operator-86d856df97-vrf8s"] Nov 03 20:09:19.223779 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:19.223752 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kueue-operator\"/\"kube-root-ca.crt\"" Nov 03 20:09:19.232312 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:19.232286 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6nm8\" (UniqueName: \"kubernetes.io/projected/78707994-cc0f-44bc-ac85-85e5dc27f87e-kube-api-access-w6nm8\") pod \"openshift-kueue-operator-86d856df97-vrf8s\" (UID: \"78707994-cc0f-44bc-ac85-85e5dc27f87e\") " pod="openshift-kueue-operator/openshift-kueue-operator-86d856df97-vrf8s" Nov 03 20:09:19.232391 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:19.232352 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78707994-cc0f-44bc-ac85-85e5dc27f87e-tmp\") pod \"openshift-kueue-operator-86d856df97-vrf8s\" (UID: \"78707994-cc0f-44bc-ac85-85e5dc27f87e\") " pod="openshift-kueue-operator/openshift-kueue-operator-86d856df97-vrf8s" Nov 03 20:09:19.235452 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:19.235433 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kueue-operator\"/\"openshift-kueue-operator-dockercfg-998rj\"" Nov 03 20:09:19.235533 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:19.235488 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kueue-operator\"/\"openshift-service-ca.crt\"" Nov 03 20:09:19.332818 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:19.332759 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6nm8\" (UniqueName: \"kubernetes.io/projected/78707994-cc0f-44bc-ac85-85e5dc27f87e-kube-api-access-w6nm8\") pod \"openshift-kueue-operator-86d856df97-vrf8s\" (UID: \"78707994-cc0f-44bc-ac85-85e5dc27f87e\") " pod="openshift-kueue-operator/openshift-kueue-operator-86d856df97-vrf8s" Nov 03 20:09:19.332912 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:19.332820 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78707994-cc0f-44bc-ac85-85e5dc27f87e-tmp\") pod \"openshift-kueue-operator-86d856df97-vrf8s\" (UID: \"78707994-cc0f-44bc-ac85-85e5dc27f87e\") " pod="openshift-kueue-operator/openshift-kueue-operator-86d856df97-vrf8s" Nov 03 20:09:19.333186 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:19.333171 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78707994-cc0f-44bc-ac85-85e5dc27f87e-tmp\") pod \"openshift-kueue-operator-86d856df97-vrf8s\" (UID: \"78707994-cc0f-44bc-ac85-85e5dc27f87e\") " pod="openshift-kueue-operator/openshift-kueue-operator-86d856df97-vrf8s" Nov 03 20:09:19.395426 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:19.395395 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6nm8\" (UniqueName: \"kubernetes.io/projected/78707994-cc0f-44bc-ac85-85e5dc27f87e-kube-api-access-w6nm8\") pod \"openshift-kueue-operator-86d856df97-vrf8s\" (UID: \"78707994-cc0f-44bc-ac85-85e5dc27f87e\") " pod="openshift-kueue-operator/openshift-kueue-operator-86d856df97-vrf8s" Nov 03 20:09:19.499240 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:09:19.499203 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:09:19.682711 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:19.682628 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kueue-operator/openshift-kueue-operator-86d856df97-vrf8s" Nov 03 20:09:20.052823 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:20.052792 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kueue-operator/openshift-kueue-operator-86d856df97-vrf8s"] Nov 03 20:09:20.055970 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:09:20.055936 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod78707994_cc0f_44bc_ac85_85e5dc27f87e.slice/crio-b552dfed9746d9c81aca4f35c1bde15f66d852a1077166fce5087edb4f4d9507 WatchSource:0}: Error finding container b552dfed9746d9c81aca4f35c1bde15f66d852a1077166fce5087edb4f4d9507: Status 404 returned error can't find the container with id b552dfed9746d9c81aca4f35c1bde15f66d852a1077166fce5087edb4f4d9507 Nov 03 20:09:20.560749 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:20.560709 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kueue-operator/openshift-kueue-operator-86d856df97-vrf8s" event={"ID":"78707994-cc0f-44bc-ac85-85e5dc27f87e","Type":"ContainerStarted","Data":"b552dfed9746d9c81aca4f35c1bde15f66d852a1077166fce5087edb4f4d9507"} Nov 03 20:09:30.607735 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:30.607697 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kueue-operator/openshift-kueue-operator-86d856df97-vrf8s" event={"ID":"78707994-cc0f-44bc-ac85-85e5dc27f87e","Type":"ContainerStarted","Data":"010419d8f72ea480082adebeee8c2c0ec777eb41625c9ea99e7b8125bb3b2f07"} Nov 03 20:09:30.723680 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:09:30.723617 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kueue-operator/openshift-kueue-operator-86d856df97-vrf8s" podStartSLOduration=1.6750046859999999 podStartE2EDuration="11.723600275s" totalImagesPullingTime="10.048595589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:09:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:09:30.722732416 +0000 UTC m=+480.289622565" watchObservedRunningTime="2026-11-03 20:09:30.723600275 +0000 UTC m=+480.290490424" Nov 03 20:09:49.498538 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:09:49.498500 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:10:05.888303 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:05.888269 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kueue-operator/kueue-controller-manager-864777c47f-fhm8d"] Nov 03 20:10:05.892795 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:05.892772 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kueue-operator/kueue-controller-manager-864777c47f-fhm8d" Nov 03 20:10:05.944692 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:05.944663 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kueue-operator\"/\"metrics-server-cert\"" Nov 03 20:10:05.944692 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:05.944664 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kueue-operator\"/\"kueue-manager-config\"" Nov 03 20:10:05.994147 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:05.994119 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kueue-operator\"/\"kueue-webhook-server-cert\"" Nov 03 20:10:05.994299 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:05.994201 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kueue-operator\"/\"kueue-controller-manager-dockercfg-trntl\"" Nov 03 20:10:05.994299 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:05.994282 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kueue-operator\"/\"kueue-visibility-server-cert\"" Nov 03 20:10:05.996498 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:05.996479 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kueue-operator/kueue-controller-manager-864777c47f-fhm8d"] Nov 03 20:10:06.046789 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:06.046737 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltbfm\" (UniqueName: \"kubernetes.io/projected/415d0754-0974-4f58-86d4-8a9806c26de9-kube-api-access-ltbfm\") pod \"kueue-controller-manager-864777c47f-fhm8d\" (UID: \"415d0754-0974-4f58-86d4-8a9806c26de9\") " pod="openshift-kueue-operator/kueue-controller-manager-864777c47f-fhm8d" Nov 03 20:10:06.046957 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:06.046814 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/415d0754-0974-4f58-86d4-8a9806c26de9-metrics-certs\") pod \"kueue-controller-manager-864777c47f-fhm8d\" (UID: \"415d0754-0974-4f58-86d4-8a9806c26de9\") " pod="openshift-kueue-operator/kueue-controller-manager-864777c47f-fhm8d" Nov 03 20:10:06.046957 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:06.046897 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"visibility\" (UniqueName: \"kubernetes.io/secret/415d0754-0974-4f58-86d4-8a9806c26de9-visibility\") pod \"kueue-controller-manager-864777c47f-fhm8d\" (UID: \"415d0754-0974-4f58-86d4-8a9806c26de9\") " pod="openshift-kueue-operator/kueue-controller-manager-864777c47f-fhm8d" Nov 03 20:10:06.046957 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:06.046948 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/415d0754-0974-4f58-86d4-8a9806c26de9-cert\") pod \"kueue-controller-manager-864777c47f-fhm8d\" (UID: \"415d0754-0974-4f58-86d4-8a9806c26de9\") " pod="openshift-kueue-operator/kueue-controller-manager-864777c47f-fhm8d" Nov 03 20:10:06.047061 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:06.047042 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/415d0754-0974-4f58-86d4-8a9806c26de9-manager-config\") pod \"kueue-controller-manager-864777c47f-fhm8d\" (UID: \"415d0754-0974-4f58-86d4-8a9806c26de9\") " pod="openshift-kueue-operator/kueue-controller-manager-864777c47f-fhm8d" Nov 03 20:10:06.148514 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:06.148430 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/415d0754-0974-4f58-86d4-8a9806c26de9-manager-config\") pod \"kueue-controller-manager-864777c47f-fhm8d\" (UID: \"415d0754-0974-4f58-86d4-8a9806c26de9\") " pod="openshift-kueue-operator/kueue-controller-manager-864777c47f-fhm8d" Nov 03 20:10:06.148514 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:06.148485 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltbfm\" (UniqueName: \"kubernetes.io/projected/415d0754-0974-4f58-86d4-8a9806c26de9-kube-api-access-ltbfm\") pod \"kueue-controller-manager-864777c47f-fhm8d\" (UID: \"415d0754-0974-4f58-86d4-8a9806c26de9\") " pod="openshift-kueue-operator/kueue-controller-manager-864777c47f-fhm8d" Nov 03 20:10:06.148764 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:06.148531 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/415d0754-0974-4f58-86d4-8a9806c26de9-metrics-certs\") pod \"kueue-controller-manager-864777c47f-fhm8d\" (UID: \"415d0754-0974-4f58-86d4-8a9806c26de9\") " pod="openshift-kueue-operator/kueue-controller-manager-864777c47f-fhm8d" Nov 03 20:10:06.148764 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:06.148588 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"visibility\" (UniqueName: \"kubernetes.io/secret/415d0754-0974-4f58-86d4-8a9806c26de9-visibility\") pod \"kueue-controller-manager-864777c47f-fhm8d\" (UID: \"415d0754-0974-4f58-86d4-8a9806c26de9\") " pod="openshift-kueue-operator/kueue-controller-manager-864777c47f-fhm8d" Nov 03 20:10:06.148764 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:06.148732 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/415d0754-0974-4f58-86d4-8a9806c26de9-cert\") pod \"kueue-controller-manager-864777c47f-fhm8d\" (UID: \"415d0754-0974-4f58-86d4-8a9806c26de9\") " pod="openshift-kueue-operator/kueue-controller-manager-864777c47f-fhm8d" Nov 03 20:10:06.149242 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:06.149222 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/415d0754-0974-4f58-86d4-8a9806c26de9-manager-config\") pod \"kueue-controller-manager-864777c47f-fhm8d\" (UID: \"415d0754-0974-4f58-86d4-8a9806c26de9\") " pod="openshift-kueue-operator/kueue-controller-manager-864777c47f-fhm8d" Nov 03 20:10:06.151225 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:06.151201 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"visibility\" (UniqueName: \"kubernetes.io/secret/415d0754-0974-4f58-86d4-8a9806c26de9-visibility\") pod \"kueue-controller-manager-864777c47f-fhm8d\" (UID: \"415d0754-0974-4f58-86d4-8a9806c26de9\") " pod="openshift-kueue-operator/kueue-controller-manager-864777c47f-fhm8d" Nov 03 20:10:06.151324 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:06.151264 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/415d0754-0974-4f58-86d4-8a9806c26de9-metrics-certs\") pod \"kueue-controller-manager-864777c47f-fhm8d\" (UID: \"415d0754-0974-4f58-86d4-8a9806c26de9\") " pod="openshift-kueue-operator/kueue-controller-manager-864777c47f-fhm8d" Nov 03 20:10:06.151363 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:06.151313 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/415d0754-0974-4f58-86d4-8a9806c26de9-cert\") pod \"kueue-controller-manager-864777c47f-fhm8d\" (UID: \"415d0754-0974-4f58-86d4-8a9806c26de9\") " pod="openshift-kueue-operator/kueue-controller-manager-864777c47f-fhm8d" Nov 03 20:10:06.209558 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:06.209532 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltbfm\" (UniqueName: \"kubernetes.io/projected/415d0754-0974-4f58-86d4-8a9806c26de9-kube-api-access-ltbfm\") pod \"kueue-controller-manager-864777c47f-fhm8d\" (UID: \"415d0754-0974-4f58-86d4-8a9806c26de9\") " pod="openshift-kueue-operator/kueue-controller-manager-864777c47f-fhm8d" Nov 03 20:10:06.503052 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:06.503022 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kueue-operator/kueue-controller-manager-864777c47f-fhm8d" Nov 03 20:10:06.982543 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:10:06.982516 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod415d0754_0974_4f58_86d4_8a9806c26de9.slice/crio-cb1932a8ab0e842f0d48ef5d5047cee77d37f0a8992f3d592f0f9ae38b1c9e95 WatchSource:0}: Error finding container cb1932a8ab0e842f0d48ef5d5047cee77d37f0a8992f3d592f0f9ae38b1c9e95: Status 404 returned error can't find the container with id cb1932a8ab0e842f0d48ef5d5047cee77d37f0a8992f3d592f0f9ae38b1c9e95 Nov 03 20:10:06.994826 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:06.994805 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kueue-operator/kueue-controller-manager-864777c47f-fhm8d"] Nov 03 20:10:07.776556 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:07.776522 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kueue-operator/kueue-controller-manager-864777c47f-fhm8d" event={"ID":"415d0754-0974-4f58-86d4-8a9806c26de9","Type":"ContainerStarted","Data":"cb1932a8ab0e842f0d48ef5d5047cee77d37f0a8992f3d592f0f9ae38b1c9e95"} Nov 03 20:10:10.792379 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:10.792343 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kueue-operator/kueue-controller-manager-864777c47f-fhm8d" event={"ID":"415d0754-0974-4f58-86d4-8a9806c26de9","Type":"ContainerStarted","Data":"5b53c31ed917b36f523411321e79ceb84528b4049f15fcbf35530f28b572abab"} Nov 03 20:10:10.792844 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:10.792478 5857 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-kueue-operator/kueue-controller-manager-864777c47f-fhm8d" Nov 03 20:10:11.015032 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:11.014969 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kueue-operator/kueue-controller-manager-864777c47f-fhm8d" podStartSLOduration=2.7594735679999998 podStartE2EDuration="6.014948287s" totalImagesPullingTime="3.255474719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:10:10.963789509 +0000 UTC m=+520.530679660" watchObservedRunningTime="2026-11-03 20:10:11.014948287 +0000 UTC m=+520.581838439" Nov 03 20:10:19.498776 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:10:19.498664 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:10:21.803218 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:21.803186 5857 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kueue-operator/kueue-controller-manager-864777c47f-fhm8d" Nov 03 20:10:22.688964 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:22.688925 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-kueue-operator/kueue-controller-manager-864777c47f-fhm8d"] Nov 03 20:10:22.689163 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:22.689135 5857 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-kueue-operator/kueue-controller-manager-864777c47f-fhm8d" podUID="415d0754-0974-4f58-86d4-8a9806c26de9" containerName="manager" containerID="cri-o://5b53c31ed917b36f523411321e79ceb84528b4049f15fcbf35530f28b572abab" gracePeriod=10 Nov 03 20:10:22.847996 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:22.847964 5857 generic.go:356] "Generic (PLEG): container finished" podID="415d0754-0974-4f58-86d4-8a9806c26de9" containerID="5b53c31ed917b36f523411321e79ceb84528b4049f15fcbf35530f28b572abab" exitCode=0 Nov 03 20:10:22.848363 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:22.848040 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kueue-operator/kueue-controller-manager-864777c47f-fhm8d" event={"ID":"415d0754-0974-4f58-86d4-8a9806c26de9","Type":"ContainerDied","Data":"5b53c31ed917b36f523411321e79ceb84528b4049f15fcbf35530f28b572abab"} Nov 03 20:10:22.934821 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:22.934773 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kueue-operator/kueue-controller-manager-864777c47f-fhm8d" Nov 03 20:10:22.997439 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:22.997410 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/415d0754-0974-4f58-86d4-8a9806c26de9-manager-config\" (UniqueName: \"kubernetes.io/configmap/415d0754-0974-4f58-86d4-8a9806c26de9-manager-config\") pod \"415d0754-0974-4f58-86d4-8a9806c26de9\" (UID: \"415d0754-0974-4f58-86d4-8a9806c26de9\") " Nov 03 20:10:22.997642 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:22.997469 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/415d0754-0974-4f58-86d4-8a9806c26de9-visibility\" (UniqueName: \"kubernetes.io/secret/415d0754-0974-4f58-86d4-8a9806c26de9-visibility\") pod \"415d0754-0974-4f58-86d4-8a9806c26de9\" (UID: \"415d0754-0974-4f58-86d4-8a9806c26de9\") " Nov 03 20:10:22.997642 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:22.997505 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/415d0754-0974-4f58-86d4-8a9806c26de9-metrics-certs\" (UniqueName: \"kubernetes.io/secret/415d0754-0974-4f58-86d4-8a9806c26de9-metrics-certs\") pod \"415d0754-0974-4f58-86d4-8a9806c26de9\" (UID: \"415d0754-0974-4f58-86d4-8a9806c26de9\") " Nov 03 20:10:22.997642 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:22.997608 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/415d0754-0974-4f58-86d4-8a9806c26de9-kube-api-access-ltbfm\" (UniqueName: \"kubernetes.io/projected/415d0754-0974-4f58-86d4-8a9806c26de9-kube-api-access-ltbfm\") pod \"415d0754-0974-4f58-86d4-8a9806c26de9\" (UID: \"415d0754-0974-4f58-86d4-8a9806c26de9\") " Nov 03 20:10:22.997642 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:22.997641 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/415d0754-0974-4f58-86d4-8a9806c26de9-cert\" (UniqueName: \"kubernetes.io/secret/415d0754-0974-4f58-86d4-8a9806c26de9-cert\") pod \"415d0754-0974-4f58-86d4-8a9806c26de9\" (UID: \"415d0754-0974-4f58-86d4-8a9806c26de9\") " Nov 03 20:10:22.999969 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:22.999942 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/415d0754-0974-4f58-86d4-8a9806c26de9-metrics-certs" pod "415d0754-0974-4f58-86d4-8a9806c26de9" (UID: "415d0754-0974-4f58-86d4-8a9806c26de9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:10:22.999969 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:22.999949 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/415d0754-0974-4f58-86d4-8a9806c26de9-kube-api-access-ltbfm" pod "415d0754-0974-4f58-86d4-8a9806c26de9" (UID: "415d0754-0974-4f58-86d4-8a9806c26de9"). InnerVolumeSpecName "kube-api-access-ltbfm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:10:23.000246 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:23.000224 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/415d0754-0974-4f58-86d4-8a9806c26de9-visibility" pod "415d0754-0974-4f58-86d4-8a9806c26de9" (UID: "415d0754-0974-4f58-86d4-8a9806c26de9"). InnerVolumeSpecName "visibility". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:10:23.000315 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:23.000261 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/415d0754-0974-4f58-86d4-8a9806c26de9-cert" pod "415d0754-0974-4f58-86d4-8a9806c26de9" (UID: "415d0754-0974-4f58-86d4-8a9806c26de9"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:10:23.002611 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:23.002590 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/415d0754-0974-4f58-86d4-8a9806c26de9-manager-config" pod "415d0754-0974-4f58-86d4-8a9806c26de9" (UID: "415d0754-0974-4f58-86d4-8a9806c26de9"). InnerVolumeSpecName "manager-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:10:23.098614 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:23.098536 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltbfm\" (UniqueName: \"kubernetes.io/projected/415d0754-0974-4f58-86d4-8a9806c26de9-kube-api-access-ltbfm\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:10:23.098614 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:23.098589 5857 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/415d0754-0974-4f58-86d4-8a9806c26de9-cert\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:10:23.098614 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:23.098599 5857 reconciler_common.go:299] "Volume detached for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/415d0754-0974-4f58-86d4-8a9806c26de9-manager-config\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:10:23.098614 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:23.098608 5857 reconciler_common.go:299] "Volume detached for volume \"visibility\" (UniqueName: \"kubernetes.io/secret/415d0754-0974-4f58-86d4-8a9806c26de9-visibility\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:10:23.098614 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:23.098617 5857 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/415d0754-0974-4f58-86d4-8a9806c26de9-metrics-certs\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:10:23.860426 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:23.860384 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kueue-operator/kueue-controller-manager-864777c47f-fhm8d" event={"ID":"415d0754-0974-4f58-86d4-8a9806c26de9","Type":"ContainerDied","Data":"cb1932a8ab0e842f0d48ef5d5047cee77d37f0a8992f3d592f0f9ae38b1c9e95"} Nov 03 20:10:23.860830 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:23.860427 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kueue-operator/kueue-controller-manager-864777c47f-fhm8d" Nov 03 20:10:23.860830 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:23.860515 5857 scope.go:122] "RemoveContainer" containerID="5b53c31ed917b36f523411321e79ceb84528b4049f15fcbf35530f28b572abab" Nov 03 20:10:24.074947 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:24.074911 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-kueue-operator/kueue-controller-manager-864777c47f-fhm8d"] Nov 03 20:10:24.124454 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:24.124358 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-kueue-operator/kueue-controller-manager-864777c47f-fhm8d"] Nov 03 20:10:24.573129 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:24.573095 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="415d0754-0974-4f58-86d4-8a9806c26de9" path="/var/lib/kubelet/pods/415d0754-0974-4f58-86d4-8a9806c26de9/volumes" Nov 03 20:10:27.758752 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:27.758711 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/acf657cbea745ff2101fd7618cd5cb160700bebf1a0903dad6ab2103fe5r8xk"] Nov 03 20:10:27.759149 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:27.759078 5857 cpu_manager.go:414] "containerMap: removing container" podUID="415d0754-0974-4f58-86d4-8a9806c26de9" containerName="manager" Nov 03 20:10:27.759149 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:27.759089 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="415d0754-0974-4f58-86d4-8a9806c26de9" containerName="manager" Nov 03 20:10:27.759265 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:27.759157 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="415d0754-0974-4f58-86d4-8a9806c26de9" containerName="manager" Nov 03 20:10:27.765296 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:27.765273 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/acf657cbea745ff2101fd7618cd5cb160700bebf1a0903dad6ab2103fe5r8xk" Nov 03 20:10:27.817534 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:27.817507 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Nov 03 20:10:27.839011 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:27.838975 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18a3974b-cd34-4253-ad85-43ef4b0fee22-util\") pod \"acf657cbea745ff2101fd7618cd5cb160700bebf1a0903dad6ab2103fe5r8xk\" (UID: \"18a3974b-cd34-4253-ad85-43ef4b0fee22\") " pod="openshift-marketplace/acf657cbea745ff2101fd7618cd5cb160700bebf1a0903dad6ab2103fe5r8xk" Nov 03 20:10:27.839011 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:27.839008 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kv9l\" (UniqueName: \"kubernetes.io/projected/18a3974b-cd34-4253-ad85-43ef4b0fee22-kube-api-access-5kv9l\") pod \"acf657cbea745ff2101fd7618cd5cb160700bebf1a0903dad6ab2103fe5r8xk\" (UID: \"18a3974b-cd34-4253-ad85-43ef4b0fee22\") " pod="openshift-marketplace/acf657cbea745ff2101fd7618cd5cb160700bebf1a0903dad6ab2103fe5r8xk" Nov 03 20:10:27.839222 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:27.839127 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18a3974b-cd34-4253-ad85-43ef4b0fee22-bundle\") pod \"acf657cbea745ff2101fd7618cd5cb160700bebf1a0903dad6ab2103fe5r8xk\" (UID: \"18a3974b-cd34-4253-ad85-43ef4b0fee22\") " pod="openshift-marketplace/acf657cbea745ff2101fd7618cd5cb160700bebf1a0903dad6ab2103fe5r8xk" Nov 03 20:10:27.867099 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:27.867074 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Nov 03 20:10:27.867099 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:27.867075 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"acf657cbea745ff2101fd7618cd5cb160700be-4ab8d706-dockercfg-knmxx\"" Nov 03 20:10:27.868377 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:27.868359 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/acf657cbea745ff2101fd7618cd5cb160700bebf1a0903dad6ab2103fe5r8xk"] Nov 03 20:10:27.940090 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:27.940064 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18a3974b-cd34-4253-ad85-43ef4b0fee22-util\") pod \"acf657cbea745ff2101fd7618cd5cb160700bebf1a0903dad6ab2103fe5r8xk\" (UID: \"18a3974b-cd34-4253-ad85-43ef4b0fee22\") " pod="openshift-marketplace/acf657cbea745ff2101fd7618cd5cb160700bebf1a0903dad6ab2103fe5r8xk" Nov 03 20:10:27.940090 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:27.940098 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kv9l\" (UniqueName: \"kubernetes.io/projected/18a3974b-cd34-4253-ad85-43ef4b0fee22-kube-api-access-5kv9l\") pod \"acf657cbea745ff2101fd7618cd5cb160700bebf1a0903dad6ab2103fe5r8xk\" (UID: \"18a3974b-cd34-4253-ad85-43ef4b0fee22\") " pod="openshift-marketplace/acf657cbea745ff2101fd7618cd5cb160700bebf1a0903dad6ab2103fe5r8xk" Nov 03 20:10:27.940338 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:27.940162 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18a3974b-cd34-4253-ad85-43ef4b0fee22-bundle\") pod \"acf657cbea745ff2101fd7618cd5cb160700bebf1a0903dad6ab2103fe5r8xk\" (UID: \"18a3974b-cd34-4253-ad85-43ef4b0fee22\") " pod="openshift-marketplace/acf657cbea745ff2101fd7618cd5cb160700bebf1a0903dad6ab2103fe5r8xk" Nov 03 20:10:27.940489 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:27.940470 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18a3974b-cd34-4253-ad85-43ef4b0fee22-util\") pod \"acf657cbea745ff2101fd7618cd5cb160700bebf1a0903dad6ab2103fe5r8xk\" (UID: \"18a3974b-cd34-4253-ad85-43ef4b0fee22\") " pod="openshift-marketplace/acf657cbea745ff2101fd7618cd5cb160700bebf1a0903dad6ab2103fe5r8xk" Nov 03 20:10:27.940556 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:27.940515 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18a3974b-cd34-4253-ad85-43ef4b0fee22-bundle\") pod \"acf657cbea745ff2101fd7618cd5cb160700bebf1a0903dad6ab2103fe5r8xk\" (UID: \"18a3974b-cd34-4253-ad85-43ef4b0fee22\") " pod="openshift-marketplace/acf657cbea745ff2101fd7618cd5cb160700bebf1a0903dad6ab2103fe5r8xk" Nov 03 20:10:28.000938 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:28.000916 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kv9l\" (UniqueName: \"kubernetes.io/projected/18a3974b-cd34-4253-ad85-43ef4b0fee22-kube-api-access-5kv9l\") pod \"acf657cbea745ff2101fd7618cd5cb160700bebf1a0903dad6ab2103fe5r8xk\" (UID: \"18a3974b-cd34-4253-ad85-43ef4b0fee22\") " pod="openshift-marketplace/acf657cbea745ff2101fd7618cd5cb160700bebf1a0903dad6ab2103fe5r8xk" Nov 03 20:10:28.083344 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:28.083265 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/acf657cbea745ff2101fd7618cd5cb160700bebf1a0903dad6ab2103fe5r8xk" Nov 03 20:10:28.452176 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:28.452152 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/acf657cbea745ff2101fd7618cd5cb160700bebf1a0903dad6ab2103fe5r8xk"] Nov 03 20:10:28.456169 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:10:28.456143 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18a3974b_cd34_4253_ad85_43ef4b0fee22.slice/crio-7e6cac6d7d9e880cbf1db099e6aea77b301142217bb3b2b32710a8c6fe1fb6cc WatchSource:0}: Error finding container 7e6cac6d7d9e880cbf1db099e6aea77b301142217bb3b2b32710a8c6fe1fb6cc: Status 404 returned error can't find the container with id 7e6cac6d7d9e880cbf1db099e6aea77b301142217bb3b2b32710a8c6fe1fb6cc Nov 03 20:10:28.887119 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:28.887038 5857 generic.go:356] "Generic (PLEG): container finished" podID="18a3974b-cd34-4253-ad85-43ef4b0fee22" containerID="58e44476aa1cddc5e1681818330cd72a11132b9136b48e8ac0f83e8639c2652a" exitCode=0 Nov 03 20:10:28.887119 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:28.887110 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/acf657cbea745ff2101fd7618cd5cb160700bebf1a0903dad6ab2103fe5r8xk" event={"ID":"18a3974b-cd34-4253-ad85-43ef4b0fee22","Type":"ContainerDied","Data":"58e44476aa1cddc5e1681818330cd72a11132b9136b48e8ac0f83e8639c2652a"} Nov 03 20:10:28.887525 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:28.887150 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/acf657cbea745ff2101fd7618cd5cb160700bebf1a0903dad6ab2103fe5r8xk" event={"ID":"18a3974b-cd34-4253-ad85-43ef4b0fee22","Type":"ContainerStarted","Data":"7e6cac6d7d9e880cbf1db099e6aea77b301142217bb3b2b32710a8c6fe1fb6cc"} Nov 03 20:10:30.898452 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:30.898355 5857 generic.go:356] "Generic (PLEG): container finished" podID="18a3974b-cd34-4253-ad85-43ef4b0fee22" containerID="6590ba7d4978f4ea3ef766b4085bc85381ca0755a3c50dae74a8a5af6078b3a2" exitCode=0 Nov 03 20:10:30.898452 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:30.898435 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/acf657cbea745ff2101fd7618cd5cb160700bebf1a0903dad6ab2103fe5r8xk" event={"ID":"18a3974b-cd34-4253-ad85-43ef4b0fee22","Type":"ContainerDied","Data":"6590ba7d4978f4ea3ef766b4085bc85381ca0755a3c50dae74a8a5af6078b3a2"} Nov 03 20:10:31.905553 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:31.905521 5857 generic.go:356] "Generic (PLEG): container finished" podID="18a3974b-cd34-4253-ad85-43ef4b0fee22" containerID="008798df9e520712e3745cb07fa31ab6a8c30bcfb2788eea4f1fea6357dfd345" exitCode=0 Nov 03 20:10:31.906004 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:31.905593 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/acf657cbea745ff2101fd7618cd5cb160700bebf1a0903dad6ab2103fe5r8xk" event={"ID":"18a3974b-cd34-4253-ad85-43ef4b0fee22","Type":"ContainerDied","Data":"008798df9e520712e3745cb07fa31ab6a8c30bcfb2788eea4f1fea6357dfd345"} Nov 03 20:10:33.034243 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:33.034212 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/acf657cbea745ff2101fd7618cd5cb160700bebf1a0903dad6ab2103fe5r8xk" Nov 03 20:10:33.087286 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:33.087255 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18a3974b-cd34-4253-ad85-43ef4b0fee22-util\" (UniqueName: \"kubernetes.io/empty-dir/18a3974b-cd34-4253-ad85-43ef4b0fee22-util\") pod \"18a3974b-cd34-4253-ad85-43ef4b0fee22\" (UID: \"18a3974b-cd34-4253-ad85-43ef4b0fee22\") " Nov 03 20:10:33.087435 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:33.087307 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18a3974b-cd34-4253-ad85-43ef4b0fee22-bundle\" (UniqueName: \"kubernetes.io/empty-dir/18a3974b-cd34-4253-ad85-43ef4b0fee22-bundle\") pod \"18a3974b-cd34-4253-ad85-43ef4b0fee22\" (UID: \"18a3974b-cd34-4253-ad85-43ef4b0fee22\") " Nov 03 20:10:33.087435 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:33.087337 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/18a3974b-cd34-4253-ad85-43ef4b0fee22-kube-api-access-5kv9l\" (UniqueName: \"kubernetes.io/projected/18a3974b-cd34-4253-ad85-43ef4b0fee22-kube-api-access-5kv9l\") pod \"18a3974b-cd34-4253-ad85-43ef4b0fee22\" (UID: \"18a3974b-cd34-4253-ad85-43ef4b0fee22\") " Nov 03 20:10:33.087805 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:33.087778 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18a3974b-cd34-4253-ad85-43ef4b0fee22-bundle" pod "18a3974b-cd34-4253-ad85-43ef4b0fee22" (UID: "18a3974b-cd34-4253-ad85-43ef4b0fee22"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:10:33.089630 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:33.089608 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18a3974b-cd34-4253-ad85-43ef4b0fee22-kube-api-access-5kv9l" pod "18a3974b-cd34-4253-ad85-43ef4b0fee22" (UID: "18a3974b-cd34-4253-ad85-43ef4b0fee22"). InnerVolumeSpecName "kube-api-access-5kv9l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:10:33.094925 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:33.094882 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18a3974b-cd34-4253-ad85-43ef4b0fee22-util" pod "18a3974b-cd34-4253-ad85-43ef4b0fee22" (UID: "18a3974b-cd34-4253-ad85-43ef4b0fee22"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:10:33.188230 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:33.188151 5857 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18a3974b-cd34-4253-ad85-43ef4b0fee22-bundle\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:10:33.188230 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:33.188179 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kv9l\" (UniqueName: \"kubernetes.io/projected/18a3974b-cd34-4253-ad85-43ef4b0fee22-kube-api-access-5kv9l\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:10:33.188230 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:33.188189 5857 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18a3974b-cd34-4253-ad85-43ef4b0fee22-util\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:10:33.917089 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:33.917050 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/acf657cbea745ff2101fd7618cd5cb160700bebf1a0903dad6ab2103fe5r8xk" event={"ID":"18a3974b-cd34-4253-ad85-43ef4b0fee22","Type":"ContainerDied","Data":"7e6cac6d7d9e880cbf1db099e6aea77b301142217bb3b2b32710a8c6fe1fb6cc"} Nov 03 20:10:33.917089 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:33.917092 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/acf657cbea745ff2101fd7618cd5cb160700bebf1a0903dad6ab2103fe5r8xk" Nov 03 20:10:33.917270 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:33.917113 5857 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e6cac6d7d9e880cbf1db099e6aea77b301142217bb3b2b32710a8c6fe1fb6cc" Nov 03 20:10:39.323374 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:39.323299 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-operators/nfs-provisioner-operator-controller-manager-5fb9b456b5-428n6"] Nov 03 20:10:39.323847 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:39.323662 5857 cpu_manager.go:414] "containerMap: removing container" podUID="18a3974b-cd34-4253-ad85-43ef4b0fee22" containerName="util" Nov 03 20:10:39.323847 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:39.323674 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="18a3974b-cd34-4253-ad85-43ef4b0fee22" containerName="util" Nov 03 20:10:39.323847 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:39.323699 5857 cpu_manager.go:414] "containerMap: removing container" podUID="18a3974b-cd34-4253-ad85-43ef4b0fee22" containerName="pull" Nov 03 20:10:39.323847 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:39.323703 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="18a3974b-cd34-4253-ad85-43ef4b0fee22" containerName="pull" Nov 03 20:10:39.323847 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:39.323723 5857 cpu_manager.go:414] "containerMap: removing container" podUID="18a3974b-cd34-4253-ad85-43ef4b0fee22" containerName="extract" Nov 03 20:10:39.323847 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:39.323728 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="18a3974b-cd34-4253-ad85-43ef4b0fee22" containerName="extract" Nov 03 20:10:39.323847 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:39.323785 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="18a3974b-cd34-4253-ad85-43ef4b0fee22" containerName="extract" Nov 03 20:10:39.325653 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:39.325633 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/nfs-provisioner-operator-controller-manager-5fb9b456b5-428n6" Nov 03 20:10:39.379027 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:39.379001 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Nov 03 20:10:39.428781 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:39.428750 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Nov 03 20:10:39.428987 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:39.428970 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"default-dockercfg-xq84j\"" Nov 03 20:10:39.430076 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:39.430055 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-operators/nfs-provisioner-operator-controller-manager-5fb9b456b5-428n6"] Nov 03 20:10:39.439658 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:39.439632 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8s82\" (UniqueName: \"kubernetes.io/projected/9834c8b6-3779-4e27-bdbe-a8d3efc62082-kube-api-access-j8s82\") pod \"nfs-provisioner-operator-controller-manager-5fb9b456b5-428n6\" (UID: \"9834c8b6-3779-4e27-bdbe-a8d3efc62082\") " pod="openshift-operators/nfs-provisioner-operator-controller-manager-5fb9b456b5-428n6" Nov 03 20:10:39.540425 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:39.540397 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8s82\" (UniqueName: \"kubernetes.io/projected/9834c8b6-3779-4e27-bdbe-a8d3efc62082-kube-api-access-j8s82\") pod \"nfs-provisioner-operator-controller-manager-5fb9b456b5-428n6\" (UID: \"9834c8b6-3779-4e27-bdbe-a8d3efc62082\") " pod="openshift-operators/nfs-provisioner-operator-controller-manager-5fb9b456b5-428n6" Nov 03 20:10:39.601350 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:39.601287 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8s82\" (UniqueName: \"kubernetes.io/projected/9834c8b6-3779-4e27-bdbe-a8d3efc62082-kube-api-access-j8s82\") pod \"nfs-provisioner-operator-controller-manager-5fb9b456b5-428n6\" (UID: \"9834c8b6-3779-4e27-bdbe-a8d3efc62082\") " pod="openshift-operators/nfs-provisioner-operator-controller-manager-5fb9b456b5-428n6" Nov 03 20:10:39.636745 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:39.636722 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/nfs-provisioner-operator-controller-manager-5fb9b456b5-428n6" Nov 03 20:10:40.003691 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:40.003609 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-operators/nfs-provisioner-operator-controller-manager-5fb9b456b5-428n6"] Nov 03 20:10:40.006357 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:10:40.006325 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9834c8b6_3779_4e27_bdbe_a8d3efc62082.slice/crio-0c3952e8d537f981560258db92fb70879f5daa8add8e3cd438ee7f4e42b30d9d WatchSource:0}: Error finding container 0c3952e8d537f981560258db92fb70879f5daa8add8e3cd438ee7f4e42b30d9d: Status 404 returned error can't find the container with id 0c3952e8d537f981560258db92fb70879f5daa8add8e3cd438ee7f4e42b30d9d Nov 03 20:10:40.007738 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:40.007719 5857 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 03 20:10:40.952920 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:40.952885 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-operators/nfs-provisioner-operator-controller-manager-5fb9b456b5-428n6" event={"ID":"9834c8b6-3779-4e27-bdbe-a8d3efc62082","Type":"ContainerStarted","Data":"0c3952e8d537f981560258db92fb70879f5daa8add8e3cd438ee7f4e42b30d9d"} Nov 03 20:10:42.963709 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:42.963667 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-operators/nfs-provisioner-operator-controller-manager-5fb9b456b5-428n6" event={"ID":"9834c8b6-3779-4e27-bdbe-a8d3efc62082","Type":"ContainerStarted","Data":"c90904bbdbc9105c8b1b421f367fd871344be0e99b5d2d8eec8c6b8401a6fb0c"} Nov 03 20:10:43.078724 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:43.078636 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-operators/nfs-provisioner-operator-controller-manager-5fb9b456b5-428n6" podStartSLOduration=1.751451779 podStartE2EDuration="4.078613991s" totalImagesPullingTime="2.327162212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:10:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:10:43.077441358 +0000 UTC m=+552.644331507" watchObservedRunningTime="2026-11-03 20:10:43.078613991 +0000 UTC m=+552.645504138" Nov 03 20:10:49.499198 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:10:49.499160 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:10:58.505959 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:58.505924 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-operators/nfs-provisioner-74bbcc8765-5scbq"] Nov 03 20:10:58.509346 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:58.509330 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/nfs-provisioner-74bbcc8765-5scbq" Nov 03 20:10:58.611264 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:58.611230 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"nfs-provisioner-dockercfg-fhjnc\"" Nov 03 20:10:58.612688 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:58.612664 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-operators/nfs-provisioner-74bbcc8765-5scbq"] Nov 03 20:10:58.712605 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:58.712548 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8425\" (UniqueName: \"kubernetes.io/projected/3311cb3e-e66b-4bf6-9bcb-32cc42bfa466-kube-api-access-t8425\") pod \"nfs-provisioner-74bbcc8765-5scbq\" (UID: \"3311cb3e-e66b-4bf6-9bcb-32cc42bfa466\") " pod="openshift-operators/nfs-provisioner-74bbcc8765-5scbq" Nov 03 20:10:58.813891 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:58.813809 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8425\" (UniqueName: \"kubernetes.io/projected/3311cb3e-e66b-4bf6-9bcb-32cc42bfa466-kube-api-access-t8425\") pod \"nfs-provisioner-74bbcc8765-5scbq\" (UID: \"3311cb3e-e66b-4bf6-9bcb-32cc42bfa466\") " pod="openshift-operators/nfs-provisioner-74bbcc8765-5scbq" Nov 03 20:10:58.875467 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:10:58.875433 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8425\" (UniqueName: \"kubernetes.io/projected/3311cb3e-e66b-4bf6-9bcb-32cc42bfa466-kube-api-access-t8425\") pod \"nfs-provisioner-74bbcc8765-5scbq\" (UID: \"3311cb3e-e66b-4bf6-9bcb-32cc42bfa466\") " pod="openshift-operators/nfs-provisioner-74bbcc8765-5scbq" Nov 03 20:11:05.660865 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:11:05.660828 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-05f972c4-e41b-4a6f-8d37-046058e90362\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0532721c047054afb\") pod \"nfs-provisioner-74bbcc8765-5scbq\" (UID: \"3311cb3e-e66b-4bf6-9bcb-32cc42bfa466\") " pod="openshift-operators/nfs-provisioner-74bbcc8765-5scbq" Nov 03 20:11:05.765001 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:11:05.764968 5857 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-05f972c4-e41b-4a6f-8d37-046058e90362\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0532721c047054afb\") pod \"nfs-provisioner-74bbcc8765-5scbq\" (UID: \"3311cb3e-e66b-4bf6-9bcb-32cc42bfa466\") device path: \"\"" pod="openshift-operators/nfs-provisioner-74bbcc8765-5scbq" Nov 03 20:11:05.861703 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:11:05.861667 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-05f972c4-e41b-4a6f-8d37-046058e90362\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0532721c047054afb\") pod \"nfs-provisioner-74bbcc8765-5scbq\" (UID: \"3311cb3e-e66b-4bf6-9bcb-32cc42bfa466\") " pod="openshift-operators/nfs-provisioner-74bbcc8765-5scbq" Nov 03 20:11:05.861856 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:11:05.861827 5857 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-05f972c4-e41b-4a6f-8d37-046058e90362\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0532721c047054afb\") pod \"nfs-provisioner-74bbcc8765-5scbq\" (UID: \"3311cb3e-e66b-4bf6-9bcb-32cc42bfa466\") DevicePath \"\"" pod="openshift-operators/nfs-provisioner-74bbcc8765-5scbq" Nov 03 20:11:05.913731 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:11:05.913648 5857 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-05f972c4-e41b-4a6f-8d37-046058e90362\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0532721c047054afb\") pod \"nfs-provisioner-74bbcc8765-5scbq\" (UID: \"3311cb3e-e66b-4bf6-9bcb-32cc42bfa466\") DevicePath \"csi-611d53785f3d22bde488e79c8ffe687e6b60be6ddc5ff9f7104ebed0a9b4f81a\"" pod="openshift-operators/nfs-provisioner-74bbcc8765-5scbq" Nov 03 20:11:09.178641 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:11:09.178606 5857 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-05f972c4-e41b-4a6f-8d37-046058e90362\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0532721c047054afb\") pod \"nfs-provisioner-74bbcc8765-5scbq\" (UID: \"3311cb3e-e66b-4bf6-9bcb-32cc42bfa466\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/2bc4040f1c50c8ab24f1b3e84bcf39f053727c51b37a01b40de493d87e92fa58/globalmount\"" pod="openshift-operators/nfs-provisioner-74bbcc8765-5scbq" Nov 03 20:11:09.242832 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:11:09.242800 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-05f972c4-e41b-4a6f-8d37-046058e90362\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0532721c047054afb\") pod \"nfs-provisioner-74bbcc8765-5scbq\" (UID: \"3311cb3e-e66b-4bf6-9bcb-32cc42bfa466\") " pod="openshift-operators/nfs-provisioner-74bbcc8765-5scbq" Nov 03 20:11:09.320631 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:11:09.320597 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/nfs-provisioner-74bbcc8765-5scbq" Nov 03 20:11:09.695635 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:11:09.695603 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-operators/nfs-provisioner-74bbcc8765-5scbq"] Nov 03 20:11:09.698345 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:11:09.698318 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3311cb3e_e66b_4bf6_9bcb_32cc42bfa466.slice/crio-67dc4792fb0c5025050a65351e19c60a3bb961b8a8ec3988a20b132ff6c9dd1f WatchSource:0}: Error finding container 67dc4792fb0c5025050a65351e19c60a3bb961b8a8ec3988a20b132ff6c9dd1f: Status 404 returned error can't find the container with id 67dc4792fb0c5025050a65351e19c60a3bb961b8a8ec3988a20b132ff6c9dd1f Nov 03 20:11:10.086422 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:11:10.086384 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-operators/nfs-provisioner-74bbcc8765-5scbq" event={"ID":"3311cb3e-e66b-4bf6-9bcb-32cc42bfa466","Type":"ContainerStarted","Data":"67dc4792fb0c5025050a65351e19c60a3bb961b8a8ec3988a20b132ff6c9dd1f"} Nov 03 20:11:13.103690 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:11:13.103648 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-operators/nfs-provisioner-74bbcc8765-5scbq" event={"ID":"3311cb3e-e66b-4bf6-9bcb-32cc42bfa466","Type":"ContainerStarted","Data":"54a8537a37c3838018792f18ee3579863c51de25858d52d0342516bf8b528fde"} Nov 03 20:11:13.221091 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:11:13.221038 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-operators/nfs-provisioner-74bbcc8765-5scbq" podStartSLOduration=14.99984057 podStartE2EDuration="18.22102397s" totalImagesPullingTime="3.2211834s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 20:10:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:11:13.219288024 +0000 UTC m=+582.786178171" watchObservedRunningTime="2026-11-03 20:11:13.22102397 +0000 UTC m=+582.787914118" Nov 03 20:11:19.500243 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:11:19.500206 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:11:49.500132 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:11:49.500098 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:12:19.499881 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:12:19.499838 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:12:49.499521 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:12:49.499482 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:13:19.500715 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:13:19.500675 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:13:43.853964 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:13:43.853891 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-kxc2k/e2e-test-torch-node-0-0-2rxzf"] Nov 03 20:13:43.857366 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:13:43.857349 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-kxc2k/e2e-test-torch-node-0-0-2rxzf" Nov 03 20:13:43.958808 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:13:43.958770 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-kxc2k\"/\"kube-root-ca.crt\"" Nov 03 20:13:43.958808 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:13:43.958793 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-kxc2k\"/\"openshift-service-ca.crt\"" Nov 03 20:13:43.958808 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:13:43.958782 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-kxc2k\"/\"default-dockercfg-zbjnv\"" Nov 03 20:13:43.960123 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:13:43.960105 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-kxc2k/e2e-test-torch-node-0-0-2rxzf"] Nov 03 20:13:43.990406 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:13:43.990371 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzw7r\" (UniqueName: \"kubernetes.io/projected/669641b1-3763-41b6-8a35-79689cdcd5cf-kube-api-access-pzw7r\") pod \"e2e-test-torch-node-0-0-2rxzf\" (UID: \"669641b1-3763-41b6-8a35-79689cdcd5cf\") " pod="e2e-kxc2k/e2e-test-torch-node-0-0-2rxzf" Nov 03 20:13:44.091931 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:13:44.091898 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzw7r\" (UniqueName: \"kubernetes.io/projected/669641b1-3763-41b6-8a35-79689cdcd5cf-kube-api-access-pzw7r\") pod \"e2e-test-torch-node-0-0-2rxzf\" (UID: \"669641b1-3763-41b6-8a35-79689cdcd5cf\") " pod="e2e-kxc2k/e2e-test-torch-node-0-0-2rxzf" Nov 03 20:13:44.152974 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:13:44.152901 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzw7r\" (UniqueName: \"kubernetes.io/projected/669641b1-3763-41b6-8a35-79689cdcd5cf-kube-api-access-pzw7r\") pod \"e2e-test-torch-node-0-0-2rxzf\" (UID: \"669641b1-3763-41b6-8a35-79689cdcd5cf\") " pod="e2e-kxc2k/e2e-test-torch-node-0-0-2rxzf" Nov 03 20:13:44.169213 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:13:44.169182 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-kxc2k/e2e-test-torch-node-0-0-2rxzf" Nov 03 20:13:44.539884 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:13:44.539855 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-kxc2k/e2e-test-torch-node-0-0-2rxzf"] Nov 03 20:13:44.543070 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:13:44.543041 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod669641b1_3763_41b6_8a35_79689cdcd5cf.slice/crio-2decf103bd187c7c1331fe90b4f9481d4d3e4b0c11e9de11b14698dfcbf781c2 WatchSource:0}: Error finding container 2decf103bd187c7c1331fe90b4f9481d4d3e4b0c11e9de11b14698dfcbf781c2: Status 404 returned error can't find the container with id 2decf103bd187c7c1331fe90b4f9481d4d3e4b0c11e9de11b14698dfcbf781c2 Nov 03 20:13:44.811716 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:13:44.811623 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-kxc2k/e2e-test-torch-node-0-0-2rxzf" event={"ID":"669641b1-3763-41b6-8a35-79689cdcd5cf","Type":"ContainerStarted","Data":"2decf103bd187c7c1331fe90b4f9481d4d3e4b0c11e9de11b14698dfcbf781c2"} Nov 03 20:13:49.519342 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:13:49.519296 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:14:19.506833 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:14:19.506762 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:14:49.506453 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:14:49.506412 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:15:19.507882 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:15:19.507754 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:15:49.505731 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:15:49.505688 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:16:19.638846 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:16:19.638809 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:16:49.502972 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:16:49.502879 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:17:19.502279 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:17:19.502200 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:17:49.499422 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:17:49.499359 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:18:03.256726 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:18:03.256688 5857 generic.go:356] "Generic (PLEG): container finished" podID="669641b1-3763-41b6-8a35-79689cdcd5cf" containerID="134abb321b51edac6ebff0c50b82aa3bfe42e7afe857638a61b9b86997e77270" exitCode=0 Nov 03 20:18:03.257136 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:18:03.256742 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-kxc2k/e2e-test-torch-node-0-0-2rxzf" event={"ID":"669641b1-3763-41b6-8a35-79689cdcd5cf","Type":"ContainerDied","Data":"134abb321b51edac6ebff0c50b82aa3bfe42e7afe857638a61b9b86997e77270"} Nov 03 20:18:04.462520 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:18:04.462493 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-kxc2k/e2e-test-torch-node-0-0-2rxzf" Nov 03 20:18:04.618538 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:18:04.618471 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/669641b1-3763-41b6-8a35-79689cdcd5cf-kube-api-access-pzw7r\" (UniqueName: \"kubernetes.io/projected/669641b1-3763-41b6-8a35-79689cdcd5cf-kube-api-access-pzw7r\") pod \"669641b1-3763-41b6-8a35-79689cdcd5cf\" (UID: \"669641b1-3763-41b6-8a35-79689cdcd5cf\") " Nov 03 20:18:04.630142 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:18:04.630102 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/669641b1-3763-41b6-8a35-79689cdcd5cf-kube-api-access-pzw7r" pod "669641b1-3763-41b6-8a35-79689cdcd5cf" (UID: "669641b1-3763-41b6-8a35-79689cdcd5cf"). InnerVolumeSpecName "kube-api-access-pzw7r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:18:04.719813 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:18:04.719772 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzw7r\" (UniqueName: \"kubernetes.io/projected/669641b1-3763-41b6-8a35-79689cdcd5cf-kube-api-access-pzw7r\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:18:05.267376 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:18:05.267340 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-kxc2k/e2e-test-torch-node-0-0-2rxzf" event={"ID":"669641b1-3763-41b6-8a35-79689cdcd5cf","Type":"ContainerDied","Data":"2decf103bd187c7c1331fe90b4f9481d4d3e4b0c11e9de11b14698dfcbf781c2"} Nov 03 20:18:05.267376 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:18:05.267372 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-kxc2k/e2e-test-torch-node-0-0-2rxzf" Nov 03 20:18:05.267612 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:18:05.267385 5857 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2decf103bd187c7c1331fe90b4f9481d4d3e4b0c11e9de11b14698dfcbf781c2" Nov 03 20:18:07.605795 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:18:07.605761 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-q6jls/e2e-test-jax-node-0-0-5qb2z"] Nov 03 20:18:07.606180 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:18:07.606100 5857 cpu_manager.go:414] "containerMap: removing container" podUID="669641b1-3763-41b6-8a35-79689cdcd5cf" containerName="node" Nov 03 20:18:07.606180 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:18:07.606111 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="669641b1-3763-41b6-8a35-79689cdcd5cf" containerName="node" Nov 03 20:18:07.606180 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:18:07.606166 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="669641b1-3763-41b6-8a35-79689cdcd5cf" containerName="node" Nov 03 20:18:07.635556 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:18:07.635530 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-q6jls/e2e-test-jax-node-0-0-5qb2z" Nov 03 20:18:07.667718 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:18:07.667688 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-q6jls/e2e-test-jax-node-0-0-5qb2z"] Nov 03 20:18:07.715751 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:18:07.715708 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-q6jls\"/\"default-dockercfg-c9h8r\"" Nov 03 20:18:07.715751 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:18:07.715733 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-q6jls\"/\"openshift-service-ca.crt\"" Nov 03 20:18:07.715751 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:18:07.715734 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-q6jls\"/\"kube-root-ca.crt\"" Nov 03 20:18:07.746645 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:18:07.746610 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhmvb\" (UniqueName: \"kubernetes.io/projected/c8b6c940-d1cc-4e59-a57d-4d4f110fda6f-kube-api-access-qhmvb\") pod \"e2e-test-jax-node-0-0-5qb2z\" (UID: \"c8b6c940-d1cc-4e59-a57d-4d4f110fda6f\") " pod="e2e-q6jls/e2e-test-jax-node-0-0-5qb2z" Nov 03 20:18:07.847590 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:18:07.847489 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhmvb\" (UniqueName: \"kubernetes.io/projected/c8b6c940-d1cc-4e59-a57d-4d4f110fda6f-kube-api-access-qhmvb\") pod \"e2e-test-jax-node-0-0-5qb2z\" (UID: \"c8b6c940-d1cc-4e59-a57d-4d4f110fda6f\") " pod="e2e-q6jls/e2e-test-jax-node-0-0-5qb2z" Nov 03 20:18:07.908790 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:18:07.908721 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhmvb\" (UniqueName: \"kubernetes.io/projected/c8b6c940-d1cc-4e59-a57d-4d4f110fda6f-kube-api-access-qhmvb\") pod \"e2e-test-jax-node-0-0-5qb2z\" (UID: \"c8b6c940-d1cc-4e59-a57d-4d4f110fda6f\") " pod="e2e-q6jls/e2e-test-jax-node-0-0-5qb2z" Nov 03 20:18:07.966485 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:18:07.966452 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-q6jls/e2e-test-jax-node-0-0-5qb2z" Nov 03 20:18:08.357459 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:18:08.357422 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-q6jls/e2e-test-jax-node-0-0-5qb2z"] Nov 03 20:18:08.359979 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:18:08.359952 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8b6c940_d1cc_4e59_a57d_4d4f110fda6f.slice/crio-f9b8a8ea0e582eb6bfe499e040712df06c1fcee103ba58fd36589f5ef093acf6 WatchSource:0}: Error finding container f9b8a8ea0e582eb6bfe499e040712df06c1fcee103ba58fd36589f5ef093acf6: Status 404 returned error can't find the container with id f9b8a8ea0e582eb6bfe499e040712df06c1fcee103ba58fd36589f5ef093acf6 Nov 03 20:18:08.361942 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:18:08.361926 5857 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 03 20:18:09.288964 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:18:09.288922 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-q6jls/e2e-test-jax-node-0-0-5qb2z" event={"ID":"c8b6c940-d1cc-4e59-a57d-4d4f110fda6f","Type":"ContainerStarted","Data":"f9b8a8ea0e582eb6bfe499e040712df06c1fcee103ba58fd36589f5ef093acf6"} Nov 03 20:18:10.982125 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:18:10.982062 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-kxc2k/e2e-test-torch-node-0-0-2rxzf"] Nov 03 20:18:11.032355 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:18:11.032321 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-kxc2k/e2e-test-torch-node-0-0-2rxzf"] Nov 03 20:18:12.580353 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:18:12.580317 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="669641b1-3763-41b6-8a35-79689cdcd5cf" path="/var/lib/kubelet/pods/669641b1-3763-41b6-8a35-79689cdcd5cf/volumes" Nov 03 20:18:19.511512 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:18:19.511474 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:18:49.500766 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:18:49.500727 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:19:19.499723 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:19:19.499671 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:19:49.502965 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:19:49.502878 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:20:19.500582 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:20:19.500530 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:20:49.501072 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:20:49.501035 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:21:19.501278 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:21:19.501234 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:21:49.509719 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:21:49.509675 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:22:19.506867 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:22:19.506823 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:22:39.701412 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:22:39.701371 5857 generic.go:356] "Generic (PLEG): container finished" podID="c8b6c940-d1cc-4e59-a57d-4d4f110fda6f" containerID="cfbde3310566b7f752c698faf4d205a39f8351da2b2cc1e464154ff198398f77" exitCode=0 Nov 03 20:22:39.701889 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:22:39.701462 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-q6jls/e2e-test-jax-node-0-0-5qb2z" event={"ID":"c8b6c940-d1cc-4e59-a57d-4d4f110fda6f","Type":"ContainerDied","Data":"cfbde3310566b7f752c698faf4d205a39f8351da2b2cc1e464154ff198398f77"} Nov 03 20:22:40.859704 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:22:40.859677 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-q6jls/e2e-test-jax-node-0-0-5qb2z" Nov 03 20:22:40.920376 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:22:40.920343 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c8b6c940-d1cc-4e59-a57d-4d4f110fda6f-kube-api-access-qhmvb\" (UniqueName: \"kubernetes.io/projected/c8b6c940-d1cc-4e59-a57d-4d4f110fda6f-kube-api-access-qhmvb\") pod \"c8b6c940-d1cc-4e59-a57d-4d4f110fda6f\" (UID: \"c8b6c940-d1cc-4e59-a57d-4d4f110fda6f\") " Nov 03 20:22:40.922717 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:22:40.922685 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8b6c940-d1cc-4e59-a57d-4d4f110fda6f-kube-api-access-qhmvb" pod "c8b6c940-d1cc-4e59-a57d-4d4f110fda6f" (UID: "c8b6c940-d1cc-4e59-a57d-4d4f110fda6f"). InnerVolumeSpecName "kube-api-access-qhmvb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:22:41.020946 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:22:41.020865 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhmvb\" (UniqueName: \"kubernetes.io/projected/c8b6c940-d1cc-4e59-a57d-4d4f110fda6f-kube-api-access-qhmvb\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:22:41.711865 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:22:41.711833 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-q6jls/e2e-test-jax-node-0-0-5qb2z" Nov 03 20:22:41.711865 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:22:41.711855 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-q6jls/e2e-test-jax-node-0-0-5qb2z" event={"ID":"c8b6c940-d1cc-4e59-a57d-4d4f110fda6f","Type":"ContainerDied","Data":"f9b8a8ea0e582eb6bfe499e040712df06c1fcee103ba58fd36589f5ef093acf6"} Nov 03 20:22:41.712072 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:22:41.711885 5857 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f9b8a8ea0e582eb6bfe499e040712df06c1fcee103ba58fd36589f5ef093acf6" Nov 03 20:22:43.689321 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:22:43.689286 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-nmp6w/e2e-test-xgboost-node-0-0-4l9mh"] Nov 03 20:22:43.689732 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:22:43.689693 5857 cpu_manager.go:414] "containerMap: removing container" podUID="c8b6c940-d1cc-4e59-a57d-4d4f110fda6f" containerName="node" Nov 03 20:22:43.689732 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:22:43.689706 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c8b6c940-d1cc-4e59-a57d-4d4f110fda6f" containerName="node" Nov 03 20:22:43.689808 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:22:43.689796 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="c8b6c940-d1cc-4e59-a57d-4d4f110fda6f" containerName="node" Nov 03 20:22:43.760780 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:22:43.760751 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-nmp6w/e2e-test-xgboost-node-0-0-4l9mh"] Nov 03 20:22:43.760972 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:22:43.760859 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-nmp6w/e2e-test-xgboost-node-0-0-4l9mh" Nov 03 20:22:43.841171 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:22:43.841139 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsrls\" (UniqueName: \"kubernetes.io/projected/7af99ec2-c805-4ff0-a6c8-875f4981f21d-kube-api-access-vsrls\") pod \"e2e-test-xgboost-node-0-0-4l9mh\" (UID: \"7af99ec2-c805-4ff0-a6c8-875f4981f21d\") " pod="e2e-nmp6w/e2e-test-xgboost-node-0-0-4l9mh" Nov 03 20:22:43.862663 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:22:43.862635 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-nmp6w\"/\"default-dockercfg-gwz8w\"" Nov 03 20:22:43.862832 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:22:43.862639 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-nmp6w\"/\"openshift-service-ca.crt\"" Nov 03 20:22:43.862832 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:22:43.862699 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-nmp6w\"/\"kube-root-ca.crt\"" Nov 03 20:22:43.942446 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:22:43.942361 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsrls\" (UniqueName: \"kubernetes.io/projected/7af99ec2-c805-4ff0-a6c8-875f4981f21d-kube-api-access-vsrls\") pod \"e2e-test-xgboost-node-0-0-4l9mh\" (UID: \"7af99ec2-c805-4ff0-a6c8-875f4981f21d\") " pod="e2e-nmp6w/e2e-test-xgboost-node-0-0-4l9mh" Nov 03 20:22:44.003451 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:22:44.003408 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsrls\" (UniqueName: \"kubernetes.io/projected/7af99ec2-c805-4ff0-a6c8-875f4981f21d-kube-api-access-vsrls\") pod \"e2e-test-xgboost-node-0-0-4l9mh\" (UID: \"7af99ec2-c805-4ff0-a6c8-875f4981f21d\") " pod="e2e-nmp6w/e2e-test-xgboost-node-0-0-4l9mh" Nov 03 20:22:44.090952 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:22:44.090919 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-nmp6w/e2e-test-xgboost-node-0-0-4l9mh" Nov 03 20:22:44.475476 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:22:44.475447 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-nmp6w/e2e-test-xgboost-node-0-0-4l9mh"] Nov 03 20:22:44.477612 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:22:44.477580 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7af99ec2_c805_4ff0_a6c8_875f4981f21d.slice/crio-cf07c3ba041c5b9198bf760f90ff93037b1d4269bd95a188f4fadb0511fba952 WatchSource:0}: Error finding container cf07c3ba041c5b9198bf760f90ff93037b1d4269bd95a188f4fadb0511fba952: Status 404 returned error can't find the container with id cf07c3ba041c5b9198bf760f90ff93037b1d4269bd95a188f4fadb0511fba952 Nov 03 20:22:44.726483 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:22:44.726389 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-nmp6w/e2e-test-xgboost-node-0-0-4l9mh" event={"ID":"7af99ec2-c805-4ff0-a6c8-875f4981f21d","Type":"ContainerStarted","Data":"cf07c3ba041c5b9198bf760f90ff93037b1d4269bd95a188f4fadb0511fba952"} Nov 03 20:22:47.357623 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:22:47.357587 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-q6jls/e2e-test-jax-node-0-0-5qb2z"] Nov 03 20:22:47.407517 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:22:47.407479 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-q6jls/e2e-test-jax-node-0-0-5qb2z"] Nov 03 20:22:48.575186 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:22:48.575137 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c8b6c940-d1cc-4e59-a57d-4d4f110fda6f" path="/var/lib/kubelet/pods/c8b6c940-d1cc-4e59-a57d-4d4f110fda6f/volumes" Nov 03 20:22:49.503346 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:22:49.503301 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:23:19.504790 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:23:19.504746 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:23:47.059024 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:47.058986 5857 generic.go:356] "Generic (PLEG): container finished" podID="7af99ec2-c805-4ff0-a6c8-875f4981f21d" containerID="224059b6df23b04d68b0be882e949cc20f4b3f6af4128ff15c895ad94003690c" exitCode=0 Nov 03 20:23:47.059457 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:47.059031 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-nmp6w/e2e-test-xgboost-node-0-0-4l9mh" event={"ID":"7af99ec2-c805-4ff0-a6c8-875f4981f21d","Type":"ContainerDied","Data":"224059b6df23b04d68b0be882e949cc20f4b3f6af4128ff15c895ad94003690c"} Nov 03 20:23:48.197701 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:48.197676 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-nmp6w/e2e-test-xgboost-node-0-0-4l9mh" Nov 03 20:23:48.314364 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:48.314263 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7af99ec2-c805-4ff0-a6c8-875f4981f21d-kube-api-access-vsrls\" (UniqueName: \"kubernetes.io/projected/7af99ec2-c805-4ff0-a6c8-875f4981f21d-kube-api-access-vsrls\") pod \"7af99ec2-c805-4ff0-a6c8-875f4981f21d\" (UID: \"7af99ec2-c805-4ff0-a6c8-875f4981f21d\") " Nov 03 20:23:48.317246 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:48.317210 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7af99ec2-c805-4ff0-a6c8-875f4981f21d-kube-api-access-vsrls" pod "7af99ec2-c805-4ff0-a6c8-875f4981f21d" (UID: "7af99ec2-c805-4ff0-a6c8-875f4981f21d"). InnerVolumeSpecName "kube-api-access-vsrls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:23:48.414965 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:48.414931 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsrls\" (UniqueName: \"kubernetes.io/projected/7af99ec2-c805-4ff0-a6c8-875f4981f21d-kube-api-access-vsrls\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:23:49.069464 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:49.069433 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-nmp6w/e2e-test-xgboost-node-0-0-4l9mh" Nov 03 20:23:49.069691 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:49.069468 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-nmp6w/e2e-test-xgboost-node-0-0-4l9mh" event={"ID":"7af99ec2-c805-4ff0-a6c8-875f4981f21d","Type":"ContainerDied","Data":"cf07c3ba041c5b9198bf760f90ff93037b1d4269bd95a188f4fadb0511fba952"} Nov 03 20:23:49.069691 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:49.069504 5857 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf07c3ba041c5b9198bf760f90ff93037b1d4269bd95a188f4fadb0511fba952" Nov 03 20:23:49.500824 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:23:49.500790 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:23:50.623473 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:50.623440 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-245rn/e2e-test-flux-node-0-0-r5hsq"] Nov 03 20:23:50.623975 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:50.623779 5857 cpu_manager.go:414] "containerMap: removing container" podUID="7af99ec2-c805-4ff0-a6c8-875f4981f21d" containerName="node" Nov 03 20:23:50.623975 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:50.623790 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7af99ec2-c805-4ff0-a6c8-875f4981f21d" containerName="node" Nov 03 20:23:50.623975 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:50.623865 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="7af99ec2-c805-4ff0-a6c8-875f4981f21d" containerName="node" Nov 03 20:23:50.625658 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:50.625641 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-245rn/e2e-test-flux-node-0-0-r5hsq" Nov 03 20:23:50.682032 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:50.682005 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-245rn\"/\"openshift-service-ca.crt\"" Nov 03 20:23:50.731132 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:50.731102 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-245rn\"/\"kube-root-ca.crt\"" Nov 03 20:23:50.731132 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:50.731105 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-245rn\"/\"e2e-test-flux-flux-entrypoint\"" Nov 03 20:23:50.731347 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:50.731146 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-245rn\"/\"default-dockercfg-dgtkj\"" Nov 03 20:23:50.731347 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:50.731149 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-245rn\"/\"e2e-test-flux-flux-curve\"" Nov 03 20:23:50.733055 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:50.733035 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-245rn/e2e-test-flux-node-0-0-r5hsq"] Nov 03 20:23:50.734766 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:50.734748 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"flux-curve\" (UniqueName: \"kubernetes.io/secret/19264bd3-38e2-4167-a3a7-729b76ec1c7c-flux-curve\") pod \"e2e-test-flux-node-0-0-r5hsq\" (UID: \"19264bd3-38e2-4167-a3a7-729b76ec1c7c\") " pod="e2e-245rn/e2e-test-flux-node-0-0-r5hsq" Nov 03 20:23:50.734868 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:50.734781 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"shared-memory\" (UniqueName: \"kubernetes.io/empty-dir/19264bd3-38e2-4167-a3a7-729b76ec1c7c-shared-memory\") pod \"e2e-test-flux-node-0-0-r5hsq\" (UID: \"19264bd3-38e2-4167-a3a7-729b76ec1c7c\") " pod="e2e-245rn/e2e-test-flux-node-0-0-r5hsq" Nov 03 20:23:50.734868 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:50.734808 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"e2e-test-flux-flux-entrypoint\" (UniqueName: \"kubernetes.io/configmap/19264bd3-38e2-4167-a3a7-729b76ec1c7c-e2e-test-flux-flux-entrypoint\") pod \"e2e-test-flux-node-0-0-r5hsq\" (UID: \"19264bd3-38e2-4167-a3a7-729b76ec1c7c\") " pod="e2e-245rn/e2e-test-flux-node-0-0-r5hsq" Nov 03 20:23:50.735007 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:50.734984 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxdz5\" (UniqueName: \"kubernetes.io/projected/19264bd3-38e2-4167-a3a7-729b76ec1c7c-kube-api-access-zxdz5\") pod \"e2e-test-flux-node-0-0-r5hsq\" (UID: \"19264bd3-38e2-4167-a3a7-729b76ec1c7c\") " pod="e2e-245rn/e2e-test-flux-node-0-0-r5hsq" Nov 03 20:23:50.735044 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:50.735026 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"flux-install\" (UniqueName: \"kubernetes.io/empty-dir/19264bd3-38e2-4167-a3a7-729b76ec1c7c-flux-install\") pod \"e2e-test-flux-node-0-0-r5hsq\" (UID: \"19264bd3-38e2-4167-a3a7-729b76ec1c7c\") " pod="e2e-245rn/e2e-test-flux-node-0-0-r5hsq" Nov 03 20:23:50.735118 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:50.735103 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spack-install\" (UniqueName: \"kubernetes.io/empty-dir/19264bd3-38e2-4167-a3a7-729b76ec1c7c-spack-install\") pod \"e2e-test-flux-node-0-0-r5hsq\" (UID: \"19264bd3-38e2-4167-a3a7-729b76ec1c7c\") " pod="e2e-245rn/e2e-test-flux-node-0-0-r5hsq" Nov 03 20:23:50.835932 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:50.835894 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"spack-install\" (UniqueName: \"kubernetes.io/empty-dir/19264bd3-38e2-4167-a3a7-729b76ec1c7c-spack-install\") pod \"e2e-test-flux-node-0-0-r5hsq\" (UID: \"19264bd3-38e2-4167-a3a7-729b76ec1c7c\") " pod="e2e-245rn/e2e-test-flux-node-0-0-r5hsq" Nov 03 20:23:50.836113 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:50.835959 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"flux-curve\" (UniqueName: \"kubernetes.io/secret/19264bd3-38e2-4167-a3a7-729b76ec1c7c-flux-curve\") pod \"e2e-test-flux-node-0-0-r5hsq\" (UID: \"19264bd3-38e2-4167-a3a7-729b76ec1c7c\") " pod="e2e-245rn/e2e-test-flux-node-0-0-r5hsq" Nov 03 20:23:50.836113 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:50.835979 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"shared-memory\" (UniqueName: \"kubernetes.io/empty-dir/19264bd3-38e2-4167-a3a7-729b76ec1c7c-shared-memory\") pod \"e2e-test-flux-node-0-0-r5hsq\" (UID: \"19264bd3-38e2-4167-a3a7-729b76ec1c7c\") " pod="e2e-245rn/e2e-test-flux-node-0-0-r5hsq" Nov 03 20:23:50.836113 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:50.835995 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"e2e-test-flux-flux-entrypoint\" (UniqueName: \"kubernetes.io/configmap/19264bd3-38e2-4167-a3a7-729b76ec1c7c-e2e-test-flux-flux-entrypoint\") pod \"e2e-test-flux-node-0-0-r5hsq\" (UID: \"19264bd3-38e2-4167-a3a7-729b76ec1c7c\") " pod="e2e-245rn/e2e-test-flux-node-0-0-r5hsq" Nov 03 20:23:50.836113 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:50.836032 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxdz5\" (UniqueName: \"kubernetes.io/projected/19264bd3-38e2-4167-a3a7-729b76ec1c7c-kube-api-access-zxdz5\") pod \"e2e-test-flux-node-0-0-r5hsq\" (UID: \"19264bd3-38e2-4167-a3a7-729b76ec1c7c\") " pod="e2e-245rn/e2e-test-flux-node-0-0-r5hsq" Nov 03 20:23:50.836113 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:50.836049 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"flux-install\" (UniqueName: \"kubernetes.io/empty-dir/19264bd3-38e2-4167-a3a7-729b76ec1c7c-flux-install\") pod \"e2e-test-flux-node-0-0-r5hsq\" (UID: \"19264bd3-38e2-4167-a3a7-729b76ec1c7c\") " pod="e2e-245rn/e2e-test-flux-node-0-0-r5hsq" Nov 03 20:23:50.836413 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:50.836386 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"spack-install\" (UniqueName: \"kubernetes.io/empty-dir/19264bd3-38e2-4167-a3a7-729b76ec1c7c-spack-install\") pod \"e2e-test-flux-node-0-0-r5hsq\" (UID: \"19264bd3-38e2-4167-a3a7-729b76ec1c7c\") " pod="e2e-245rn/e2e-test-flux-node-0-0-r5hsq" Nov 03 20:23:50.836463 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:50.836412 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"flux-install\" (UniqueName: \"kubernetes.io/empty-dir/19264bd3-38e2-4167-a3a7-729b76ec1c7c-flux-install\") pod \"e2e-test-flux-node-0-0-r5hsq\" (UID: \"19264bd3-38e2-4167-a3a7-729b76ec1c7c\") " pod="e2e-245rn/e2e-test-flux-node-0-0-r5hsq" Nov 03 20:23:50.836824 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:50.836805 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"e2e-test-flux-flux-entrypoint\" (UniqueName: \"kubernetes.io/configmap/19264bd3-38e2-4167-a3a7-729b76ec1c7c-e2e-test-flux-flux-entrypoint\") pod \"e2e-test-flux-node-0-0-r5hsq\" (UID: \"19264bd3-38e2-4167-a3a7-729b76ec1c7c\") " pod="e2e-245rn/e2e-test-flux-node-0-0-r5hsq" Nov 03 20:23:50.838451 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:50.838426 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"shared-memory\" (UniqueName: \"kubernetes.io/empty-dir/19264bd3-38e2-4167-a3a7-729b76ec1c7c-shared-memory\") pod \"e2e-test-flux-node-0-0-r5hsq\" (UID: \"19264bd3-38e2-4167-a3a7-729b76ec1c7c\") " pod="e2e-245rn/e2e-test-flux-node-0-0-r5hsq" Nov 03 20:23:50.838605 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:50.838543 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"flux-curve\" (UniqueName: \"kubernetes.io/secret/19264bd3-38e2-4167-a3a7-729b76ec1c7c-flux-curve\") pod \"e2e-test-flux-node-0-0-r5hsq\" (UID: \"19264bd3-38e2-4167-a3a7-729b76ec1c7c\") " pod="e2e-245rn/e2e-test-flux-node-0-0-r5hsq" Nov 03 20:23:50.897262 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:50.897200 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxdz5\" (UniqueName: \"kubernetes.io/projected/19264bd3-38e2-4167-a3a7-729b76ec1c7c-kube-api-access-zxdz5\") pod \"e2e-test-flux-node-0-0-r5hsq\" (UID: \"19264bd3-38e2-4167-a3a7-729b76ec1c7c\") " pod="e2e-245rn/e2e-test-flux-node-0-0-r5hsq" Nov 03 20:23:50.937159 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:50.937124 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-245rn/e2e-test-flux-node-0-0-r5hsq" Nov 03 20:23:51.315651 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:51.315616 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-245rn/e2e-test-flux-node-0-0-r5hsq"] Nov 03 20:23:51.318761 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:23:51.318730 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19264bd3_38e2_4167_a3a7_729b76ec1c7c.slice/crio-c05e09025b8e586cbdefe23ab8c5ebaf78342e5ed0dfb2db4fd6abde25c7badd WatchSource:0}: Error finding container c05e09025b8e586cbdefe23ab8c5ebaf78342e5ed0dfb2db4fd6abde25c7badd: Status 404 returned error can't find the container with id c05e09025b8e586cbdefe23ab8c5ebaf78342e5ed0dfb2db4fd6abde25c7badd Nov 03 20:23:51.320876 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:51.320861 5857 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 03 20:23:52.092340 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:52.092307 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-245rn/e2e-test-flux-node-0-0-r5hsq" event={"ID":"19264bd3-38e2-4167-a3a7-729b76ec1c7c","Type":"ContainerStarted","Data":"c05e09025b8e586cbdefe23ab8c5ebaf78342e5ed0dfb2db4fd6abde25c7badd"} Nov 03 20:23:54.856912 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:54.856870 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-nmp6w/e2e-test-xgboost-node-0-0-4l9mh"] Nov 03 20:23:54.905461 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:54.905430 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-nmp6w/e2e-test-xgboost-node-0-0-4l9mh"] Nov 03 20:23:56.574291 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:23:56.574254 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7af99ec2-c805-4ff0-a6c8-875f4981f21d" path="/var/lib/kubelet/pods/7af99ec2-c805-4ff0-a6c8-875f4981f21d/volumes" Nov 03 20:24:05.175019 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:05.174979 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-245rn/e2e-test-flux-node-0-0-r5hsq" event={"ID":"19264bd3-38e2-4167-a3a7-729b76ec1c7c","Type":"ContainerStarted","Data":"a277abd13d146dce2017b86aae8fb68845acd18283cdd1a1d0545f8f4b4ea5d0"} Nov 03 20:24:09.197820 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:09.197786 5857 generic.go:356] "Generic (PLEG): container finished" podID="19264bd3-38e2-4167-a3a7-729b76ec1c7c" containerID="a277abd13d146dce2017b86aae8fb68845acd18283cdd1a1d0545f8f4b4ea5d0" exitCode=0 Nov 03 20:24:09.198251 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:09.197861 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-245rn/e2e-test-flux-node-0-0-r5hsq" event={"ID":"19264bd3-38e2-4167-a3a7-729b76ec1c7c","Type":"ContainerDied","Data":"a277abd13d146dce2017b86aae8fb68845acd18283cdd1a1d0545f8f4b4ea5d0"} Nov 03 20:24:14.228015 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:14.227973 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-245rn/e2e-test-flux-node-0-0-r5hsq" event={"ID":"19264bd3-38e2-4167-a3a7-729b76ec1c7c","Type":"ContainerStarted","Data":"22948c79366601cbc381e787d6effd6b135856d0959dbaa7740e359d3119f719"} Nov 03 20:24:14.346143 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:14.346081 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-245rn/e2e-test-flux-node-0-0-r5hsq" podStartSLOduration=3.712569635 podStartE2EDuration="24.346062602s" totalImagesPullingTime="17.072995237s" totalInitContainerRuntime="3.56049773s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:23:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:24:14.345427338 +0000 UTC m=+1363.912317510" watchObservedRunningTime="2026-11-03 20:24:14.346062602 +0000 UTC m=+1363.912952784" Nov 03 20:24:19.503756 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:24:19.503714 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:24:23.277382 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:23.277333 5857 generic.go:356] "Generic (PLEG): container finished" podID="19264bd3-38e2-4167-a3a7-729b76ec1c7c" containerID="22948c79366601cbc381e787d6effd6b135856d0959dbaa7740e359d3119f719" exitCode=0 Nov 03 20:24:23.277866 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:23.277403 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-245rn/e2e-test-flux-node-0-0-r5hsq" event={"ID":"19264bd3-38e2-4167-a3a7-729b76ec1c7c","Type":"ContainerDied","Data":"22948c79366601cbc381e787d6effd6b135856d0959dbaa7740e359d3119f719"} Nov 03 20:24:24.770072 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:24.770037 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-245rn/e2e-test-flux-node-0-0-r5hsq" Nov 03 20:24:24.946679 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:24.946641 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/19264bd3-38e2-4167-a3a7-729b76ec1c7c-kube-api-access-zxdz5\" (UniqueName: \"kubernetes.io/projected/19264bd3-38e2-4167-a3a7-729b76ec1c7c-kube-api-access-zxdz5\") pod \"19264bd3-38e2-4167-a3a7-729b76ec1c7c\" (UID: \"19264bd3-38e2-4167-a3a7-729b76ec1c7c\") " Nov 03 20:24:24.946877 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:24.946686 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/19264bd3-38e2-4167-a3a7-729b76ec1c7c-spack-install\" (UniqueName: \"kubernetes.io/empty-dir/19264bd3-38e2-4167-a3a7-729b76ec1c7c-spack-install\") pod \"19264bd3-38e2-4167-a3a7-729b76ec1c7c\" (UID: \"19264bd3-38e2-4167-a3a7-729b76ec1c7c\") " Nov 03 20:24:24.946877 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:24.946717 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/19264bd3-38e2-4167-a3a7-729b76ec1c7c-flux-curve\" (UniqueName: \"kubernetes.io/secret/19264bd3-38e2-4167-a3a7-729b76ec1c7c-flux-curve\") pod \"19264bd3-38e2-4167-a3a7-729b76ec1c7c\" (UID: \"19264bd3-38e2-4167-a3a7-729b76ec1c7c\") " Nov 03 20:24:24.946877 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:24.946805 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/19264bd3-38e2-4167-a3a7-729b76ec1c7c-shared-memory\" (UniqueName: \"kubernetes.io/empty-dir/19264bd3-38e2-4167-a3a7-729b76ec1c7c-shared-memory\") pod \"19264bd3-38e2-4167-a3a7-729b76ec1c7c\" (UID: \"19264bd3-38e2-4167-a3a7-729b76ec1c7c\") " Nov 03 20:24:24.946877 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:24.946849 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/19264bd3-38e2-4167-a3a7-729b76ec1c7c-e2e-test-flux-flux-entrypoint\" (UniqueName: \"kubernetes.io/configmap/19264bd3-38e2-4167-a3a7-729b76ec1c7c-e2e-test-flux-flux-entrypoint\") pod \"19264bd3-38e2-4167-a3a7-729b76ec1c7c\" (UID: \"19264bd3-38e2-4167-a3a7-729b76ec1c7c\") " Nov 03 20:24:24.947467 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:24.946884 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/19264bd3-38e2-4167-a3a7-729b76ec1c7c-flux-install\" (UniqueName: \"kubernetes.io/empty-dir/19264bd3-38e2-4167-a3a7-729b76ec1c7c-flux-install\") pod \"19264bd3-38e2-4167-a3a7-729b76ec1c7c\" (UID: \"19264bd3-38e2-4167-a3a7-729b76ec1c7c\") " Nov 03 20:24:24.947467 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:24.947333 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19264bd3-38e2-4167-a3a7-729b76ec1c7c-e2e-test-flux-flux-entrypoint" pod "19264bd3-38e2-4167-a3a7-729b76ec1c7c" (UID: "19264bd3-38e2-4167-a3a7-729b76ec1c7c"). InnerVolumeSpecName "e2e-test-flux-flux-entrypoint". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:24:24.949480 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:24.949449 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19264bd3-38e2-4167-a3a7-729b76ec1c7c-shared-memory" pod "19264bd3-38e2-4167-a3a7-729b76ec1c7c" (UID: "19264bd3-38e2-4167-a3a7-729b76ec1c7c"). InnerVolumeSpecName "shared-memory". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:24:24.949695 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:24.949671 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19264bd3-38e2-4167-a3a7-729b76ec1c7c-flux-curve" pod "19264bd3-38e2-4167-a3a7-729b76ec1c7c" (UID: "19264bd3-38e2-4167-a3a7-729b76ec1c7c"). InnerVolumeSpecName "flux-curve". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:24:24.949762 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:24.949747 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19264bd3-38e2-4167-a3a7-729b76ec1c7c-kube-api-access-zxdz5" pod "19264bd3-38e2-4167-a3a7-729b76ec1c7c" (UID: "19264bd3-38e2-4167-a3a7-729b76ec1c7c"). InnerVolumeSpecName "kube-api-access-zxdz5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:24:25.047993 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:25.047920 5857 reconciler_common.go:299] "Volume detached for volume \"flux-curve\" (UniqueName: \"kubernetes.io/secret/19264bd3-38e2-4167-a3a7-729b76ec1c7c-flux-curve\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:24:25.047993 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:25.047950 5857 reconciler_common.go:299] "Volume detached for volume \"shared-memory\" (UniqueName: \"kubernetes.io/empty-dir/19264bd3-38e2-4167-a3a7-729b76ec1c7c-shared-memory\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:24:25.047993 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:25.047962 5857 reconciler_common.go:299] "Volume detached for volume \"e2e-test-flux-flux-entrypoint\" (UniqueName: \"kubernetes.io/configmap/19264bd3-38e2-4167-a3a7-729b76ec1c7c-e2e-test-flux-flux-entrypoint\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:24:25.047993 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:25.047971 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxdz5\" (UniqueName: \"kubernetes.io/projected/19264bd3-38e2-4167-a3a7-729b76ec1c7c-kube-api-access-zxdz5\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:24:25.291144 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:25.291106 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-245rn/e2e-test-flux-node-0-0-r5hsq" event={"ID":"19264bd3-38e2-4167-a3a7-729b76ec1c7c","Type":"ContainerDied","Data":"c05e09025b8e586cbdefe23ab8c5ebaf78342e5ed0dfb2db4fd6abde25c7badd"} Nov 03 20:24:25.291144 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:25.291146 5857 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c05e09025b8e586cbdefe23ab8c5ebaf78342e5ed0dfb2db4fd6abde25c7badd" Nov 03 20:24:25.291360 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:25.291145 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-245rn/e2e-test-flux-node-0-0-r5hsq" Nov 03 20:24:27.753192 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:27.753150 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19264bd3-38e2-4167-a3a7-729b76ec1c7c-flux-install" pod "19264bd3-38e2-4167-a3a7-729b76ec1c7c" (UID: "19264bd3-38e2-4167-a3a7-729b76ec1c7c"). InnerVolumeSpecName "flux-install". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:24:27.767617 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:27.767558 5857 reconciler_common.go:299] "Volume detached for volume \"flux-install\" (UniqueName: \"kubernetes.io/empty-dir/19264bd3-38e2-4167-a3a7-729b76ec1c7c-flux-install\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:24:30.025627 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:30.025584 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19264bd3-38e2-4167-a3a7-729b76ec1c7c-spack-install" pod "19264bd3-38e2-4167-a3a7-729b76ec1c7c" (UID: "19264bd3-38e2-4167-a3a7-729b76ec1c7c"). InnerVolumeSpecName "spack-install". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:24:30.082978 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:30.082941 5857 reconciler_common.go:299] "Volume detached for volume \"spack-install\" (UniqueName: \"kubernetes.io/empty-dir/19264bd3-38e2-4167-a3a7-729b76ec1c7c-spack-install\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:24:30.752788 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:30.752758 5857 scope.go:122] "RemoveContainer" containerID="134abb321b51edac6ebff0c50b82aa3bfe42e7afe857638a61b9b86997e77270" Nov 03 20:24:31.357194 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:31.357164 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-245rn/e2e-test-flux-node-0-0-r5hsq"] Nov 03 20:24:31.407013 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:31.406987 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-245rn/e2e-test-flux-node-0-0-r5hsq"] Nov 03 20:24:32.576017 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:32.575983 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="19264bd3-38e2-4167-a3a7-729b76ec1c7c" path="/var/lib/kubelet/pods/19264bd3-38e2-4167-a3a7-729b76ec1c7c/volumes" Nov 03 20:24:43.673551 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:43.673519 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-xwgz9/e2e-deadline-job-node-0-0-9vkwz"] Nov 03 20:24:43.673952 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:43.673892 5857 cpu_manager.go:414] "containerMap: removing container" podUID="19264bd3-38e2-4167-a3a7-729b76ec1c7c" containerName="node" Nov 03 20:24:43.673952 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:43.673909 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="19264bd3-38e2-4167-a3a7-729b76ec1c7c" containerName="node" Nov 03 20:24:43.674022 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:43.673964 5857 cpu_manager.go:414] "containerMap: removing container" podUID="19264bd3-38e2-4167-a3a7-729b76ec1c7c" containerName="flux-installer" Nov 03 20:24:43.674022 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:43.673973 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="19264bd3-38e2-4167-a3a7-729b76ec1c7c" containerName="flux-installer" Nov 03 20:24:43.674086 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:43.674074 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="19264bd3-38e2-4167-a3a7-729b76ec1c7c" containerName="node" Nov 03 20:24:43.683849 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:43.683824 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-xwgz9/e2e-deadline-job-node-0-0-9vkwz" Nov 03 20:24:43.735095 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:43.735072 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-xwgz9/e2e-deadline-job-node-0-0-9vkwz"] Nov 03 20:24:43.782822 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:43.782784 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-xwgz9\"/\"openshift-service-ca.crt\"" Nov 03 20:24:43.782985 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:43.782888 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-xwgz9\"/\"kube-root-ca.crt\"" Nov 03 20:24:43.783038 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:43.782998 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-xwgz9\"/\"default-dockercfg-pdhcj\"" Nov 03 20:24:43.801285 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:43.801259 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9pdn\" (UniqueName: \"kubernetes.io/projected/aaf3ac30-7559-4875-a2a2-c7d414019f99-kube-api-access-m9pdn\") pod \"e2e-deadline-job-node-0-0-9vkwz\" (UID: \"aaf3ac30-7559-4875-a2a2-c7d414019f99\") " pod="e2e-xwgz9/e2e-deadline-job-node-0-0-9vkwz" Nov 03 20:24:43.901990 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:43.901953 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9pdn\" (UniqueName: \"kubernetes.io/projected/aaf3ac30-7559-4875-a2a2-c7d414019f99-kube-api-access-m9pdn\") pod \"e2e-deadline-job-node-0-0-9vkwz\" (UID: \"aaf3ac30-7559-4875-a2a2-c7d414019f99\") " pod="e2e-xwgz9/e2e-deadline-job-node-0-0-9vkwz" Nov 03 20:24:43.962882 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:43.962852 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9pdn\" (UniqueName: \"kubernetes.io/projected/aaf3ac30-7559-4875-a2a2-c7d414019f99-kube-api-access-m9pdn\") pod \"e2e-deadline-job-node-0-0-9vkwz\" (UID: \"aaf3ac30-7559-4875-a2a2-c7d414019f99\") " pod="e2e-xwgz9/e2e-deadline-job-node-0-0-9vkwz" Nov 03 20:24:43.995533 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:43.995492 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-xwgz9/e2e-deadline-job-node-0-0-9vkwz" Nov 03 20:24:44.371711 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:44.371623 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-xwgz9/e2e-deadline-job-node-0-0-9vkwz"] Nov 03 20:24:44.375080 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:24:44.375050 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaaf3ac30_7559_4875_a2a2_c7d414019f99.slice/crio-b8749f44dea8f285076b88282d85ca844623ecd3e1d60a7106466ebaf82543c5 WatchSource:0}: Error finding container b8749f44dea8f285076b88282d85ca844623ecd3e1d60a7106466ebaf82543c5: Status 404 returned error can't find the container with id b8749f44dea8f285076b88282d85ca844623ecd3e1d60a7106466ebaf82543c5 Nov 03 20:24:44.383685 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:44.383661 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-xwgz9/e2e-deadline-job-node-0-0-9vkwz" event={"ID":"aaf3ac30-7559-4875-a2a2-c7d414019f99","Type":"ContainerStarted","Data":"b8749f44dea8f285076b88282d85ca844623ecd3e1d60a7106466ebaf82543c5"} Nov 03 20:24:46.394695 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:46.394657 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-xwgz9/e2e-deadline-job-node-0-0-9vkwz" event={"ID":"aaf3ac30-7559-4875-a2a2-c7d414019f99","Type":"ContainerStarted","Data":"d670eaf586dcba6a4493605e2433a73fb8d74e5015953a6c5084748f9d0424af"} Nov 03 20:24:46.511675 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:46.511625 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-xwgz9/e2e-deadline-job-node-0-0-9vkwz" podStartSLOduration=2.5516426 podStartE2EDuration="3.511611344s" totalImagesPullingTime="959.968744ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:24:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:24:46.510262687 +0000 UTC m=+1396.077152830" watchObservedRunningTime="2026-11-03 20:24:46.511611344 +0000 UTC m=+1396.078501489" Nov 03 20:24:49.500541 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:24:49.500505 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:24:53.130281 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:53.130247 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-xwgz9/e2e-deadline-job-node-0-0-9vkwz"] Nov 03 20:24:53.130701 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:53.130440 5857 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-xwgz9/e2e-deadline-job-node-0-0-9vkwz" podUID="aaf3ac30-7559-4875-a2a2-c7d414019f99" containerName="node" containerID="cri-o://d670eaf586dcba6a4493605e2433a73fb8d74e5015953a6c5084748f9d0424af" gracePeriod=30 Nov 03 20:24:54.139758 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:54.139724 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-mn6k7/e2e-test-runtime-update-node-0-0-rgx4p"] Nov 03 20:24:54.143102 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:54.143082 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-mn6k7/e2e-test-runtime-update-node-0-0-rgx4p" Nov 03 20:24:54.190829 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:54.190802 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2f9j\" (UniqueName: \"kubernetes.io/projected/1a65e3a0-7dc0-41ca-8d92-1ec12a6bddb9-kube-api-access-q2f9j\") pod \"e2e-test-runtime-update-node-0-0-rgx4p\" (UID: \"1a65e3a0-7dc0-41ca-8d92-1ec12a6bddb9\") " pod="e2e-mn6k7/e2e-test-runtime-update-node-0-0-rgx4p" Nov 03 20:24:54.244753 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:54.244729 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-mn6k7\"/\"openshift-service-ca.crt\"" Nov 03 20:24:54.244753 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:54.244732 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-mn6k7\"/\"kube-root-ca.crt\"" Nov 03 20:24:54.244914 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:54.244887 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-mn6k7\"/\"default-dockercfg-qwc4r\"" Nov 03 20:24:54.246259 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:54.246243 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-mn6k7/e2e-test-runtime-update-node-0-0-rgx4p"] Nov 03 20:24:54.291551 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:54.291527 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2f9j\" (UniqueName: \"kubernetes.io/projected/1a65e3a0-7dc0-41ca-8d92-1ec12a6bddb9-kube-api-access-q2f9j\") pod \"e2e-test-runtime-update-node-0-0-rgx4p\" (UID: \"1a65e3a0-7dc0-41ca-8d92-1ec12a6bddb9\") " pod="e2e-mn6k7/e2e-test-runtime-update-node-0-0-rgx4p" Nov 03 20:24:54.352337 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:54.352304 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2f9j\" (UniqueName: \"kubernetes.io/projected/1a65e3a0-7dc0-41ca-8d92-1ec12a6bddb9-kube-api-access-q2f9j\") pod \"e2e-test-runtime-update-node-0-0-rgx4p\" (UID: \"1a65e3a0-7dc0-41ca-8d92-1ec12a6bddb9\") " pod="e2e-mn6k7/e2e-test-runtime-update-node-0-0-rgx4p" Nov 03 20:24:54.454846 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:54.454817 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-mn6k7/e2e-test-runtime-update-node-0-0-rgx4p" Nov 03 20:24:54.800213 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:54.800126 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-mn6k7/e2e-test-runtime-update-node-0-0-rgx4p"] Nov 03 20:24:54.945796 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:54.945714 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-mn6k7/e2e-test-runtime-update-node-0-0-rgx4p"] Nov 03 20:24:54.948498 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:24:54.948470 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a65e3a0_7dc0_41ca_8d92_1ec12a6bddb9.slice/crio-1f2838c504e5a361eca3f8e3a3d2388eff14ebccf3b351b6377c1d19f12db9b8 WatchSource:0}: Error finding container 1f2838c504e5a361eca3f8e3a3d2388eff14ebccf3b351b6377c1d19f12db9b8: Status 404 returned error can't find the container with id 1f2838c504e5a361eca3f8e3a3d2388eff14ebccf3b351b6377c1d19f12db9b8 Nov 03 20:24:55.438065 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:55.438018 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-mn6k7/e2e-test-runtime-update-node-0-0-rgx4p" event={"ID":"1a65e3a0-7dc0-41ca-8d92-1ec12a6bddb9","Type":"ContainerStarted","Data":"1f2838c504e5a361eca3f8e3a3d2388eff14ebccf3b351b6377c1d19f12db9b8"} Nov 03 20:24:55.815608 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:55.815550 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-mn6k7/e2e-test-runtime-update-node-0-0-7xk4q"] Nov 03 20:24:55.818924 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:55.818901 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-mn6k7/e2e-test-runtime-update-node-0-0-7xk4q" Nov 03 20:24:55.905341 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:55.905305 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw2sj\" (UniqueName: \"kubernetes.io/projected/1a399777-e963-466d-8359-c70252abe2f2-kube-api-access-kw2sj\") pod \"e2e-test-runtime-update-node-0-0-7xk4q\" (UID: \"1a399777-e963-466d-8359-c70252abe2f2\") " pod="e2e-mn6k7/e2e-test-runtime-update-node-0-0-7xk4q" Nov 03 20:24:55.921799 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:55.921763 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-mn6k7/e2e-test-runtime-update-node-0-0-7xk4q"] Nov 03 20:24:56.006493 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:56.006462 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw2sj\" (UniqueName: \"kubernetes.io/projected/1a399777-e963-466d-8359-c70252abe2f2-kube-api-access-kw2sj\") pod \"e2e-test-runtime-update-node-0-0-7xk4q\" (UID: \"1a399777-e963-466d-8359-c70252abe2f2\") " pod="e2e-mn6k7/e2e-test-runtime-update-node-0-0-7xk4q" Nov 03 20:24:56.067629 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:56.067539 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw2sj\" (UniqueName: \"kubernetes.io/projected/1a399777-e963-466d-8359-c70252abe2f2-kube-api-access-kw2sj\") pod \"e2e-test-runtime-update-node-0-0-7xk4q\" (UID: \"1a399777-e963-466d-8359-c70252abe2f2\") " pod="e2e-mn6k7/e2e-test-runtime-update-node-0-0-7xk4q" Nov 03 20:24:56.130765 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:56.130735 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-mn6k7/e2e-test-runtime-update-node-0-0-7xk4q" Nov 03 20:24:56.241142 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:56.241110 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-mn6k7/e2e-test-runtime-update-node-0-0-7xk4q"] Nov 03 20:24:56.446003 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:56.445921 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-mn6k7/e2e-test-runtime-update-node-0-0-rgx4p" event={"ID":"1a65e3a0-7dc0-41ca-8d92-1ec12a6bddb9","Type":"ContainerStarted","Data":"1a86a0d176214c9a262e08e8ad51f06d5571f37df7a5b3eb5af8af341eca47e4"} Nov 03 20:24:56.446384 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:56.446004 5857 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-mn6k7/e2e-test-runtime-update-node-0-0-rgx4p" podUID="1a65e3a0-7dc0-41ca-8d92-1ec12a6bddb9" containerName="node" containerID="cri-o://1a86a0d176214c9a262e08e8ad51f06d5571f37df7a5b3eb5af8af341eca47e4" gracePeriod=30 Nov 03 20:24:56.507496 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:56.507380 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-mn6k7/e2e-test-runtime-update-node-0-0-7xk4q"] Nov 03 20:24:56.514436 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:24:56.514410 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a399777_e963_466d_8359_c70252abe2f2.slice/crio-cf94fe8e4acc925c1728a48c3ce2e322adfa20d9ec7d7b5c229808c42d2790ca WatchSource:0}: Error finding container cf94fe8e4acc925c1728a48c3ce2e322adfa20d9ec7d7b5c229808c42d2790ca: Status 404 returned error can't find the container with id cf94fe8e4acc925c1728a48c3ce2e322adfa20d9ec7d7b5c229808c42d2790ca Nov 03 20:24:56.561730 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:56.561683 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-mn6k7/e2e-test-runtime-update-node-0-0-rgx4p" podStartSLOduration=1.961593856 podStartE2EDuration="2.561667326s" totalImagesPullingTime="600.07347ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:24:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:24:56.559478457 +0000 UTC m=+1406.126368623" watchObservedRunningTime="2026-11-03 20:24:56.561667326 +0000 UTC m=+1406.128557473" Nov 03 20:24:56.696866 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:56.696799 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-mn6k7/e2e-test-runtime-update-node-0-0-rgx4p" Nov 03 20:24:56.813023 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:56.812986 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1a65e3a0-7dc0-41ca-8d92-1ec12a6bddb9-kube-api-access-q2f9j\" (UniqueName: \"kubernetes.io/projected/1a65e3a0-7dc0-41ca-8d92-1ec12a6bddb9-kube-api-access-q2f9j\") pod \"1a65e3a0-7dc0-41ca-8d92-1ec12a6bddb9\" (UID: \"1a65e3a0-7dc0-41ca-8d92-1ec12a6bddb9\") " Nov 03 20:24:56.815368 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:56.815342 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a65e3a0-7dc0-41ca-8d92-1ec12a6bddb9-kube-api-access-q2f9j" pod "1a65e3a0-7dc0-41ca-8d92-1ec12a6bddb9" (UID: "1a65e3a0-7dc0-41ca-8d92-1ec12a6bddb9"). InnerVolumeSpecName "kube-api-access-q2f9j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:24:56.913601 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:56.913550 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2f9j\" (UniqueName: \"kubernetes.io/projected/1a65e3a0-7dc0-41ca-8d92-1ec12a6bddb9-kube-api-access-q2f9j\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:24:57.087241 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:57.087210 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-9jmbp/e2e-test-runtime-update-node-0-0-278bv"] Nov 03 20:24:57.087595 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:57.087580 5857 cpu_manager.go:414] "containerMap: removing container" podUID="1a65e3a0-7dc0-41ca-8d92-1ec12a6bddb9" containerName="node" Nov 03 20:24:57.087666 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:57.087596 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1a65e3a0-7dc0-41ca-8d92-1ec12a6bddb9" containerName="node" Nov 03 20:24:57.087666 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:57.087664 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="1a65e3a0-7dc0-41ca-8d92-1ec12a6bddb9" containerName="node" Nov 03 20:24:57.090599 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:57.090552 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-9jmbp/e2e-test-runtime-update-node-0-0-278bv" Nov 03 20:24:57.147769 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:57.147730 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-9jmbp\"/\"default-dockercfg-8lz4n\"" Nov 03 20:24:57.147920 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:57.147789 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-9jmbp\"/\"kube-root-ca.crt\"" Nov 03 20:24:57.147920 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:57.147790 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-9jmbp\"/\"openshift-service-ca.crt\"" Nov 03 20:24:57.197727 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:57.197697 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-9jmbp/e2e-test-runtime-update-node-0-0-278bv"] Nov 03 20:24:57.216519 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:57.216498 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqz9h\" (UniqueName: \"kubernetes.io/projected/b7ea44d4-1de1-4e4e-bb5f-b4fafa0a8487-kube-api-access-zqz9h\") pod \"e2e-test-runtime-update-node-0-0-278bv\" (UID: \"b7ea44d4-1de1-4e4e-bb5f-b4fafa0a8487\") " pod="e2e-9jmbp/e2e-test-runtime-update-node-0-0-278bv" Nov 03 20:24:57.317817 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:57.317783 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqz9h\" (UniqueName: \"kubernetes.io/projected/b7ea44d4-1de1-4e4e-bb5f-b4fafa0a8487-kube-api-access-zqz9h\") pod \"e2e-test-runtime-update-node-0-0-278bv\" (UID: \"b7ea44d4-1de1-4e4e-bb5f-b4fafa0a8487\") " pod="e2e-9jmbp/e2e-test-runtime-update-node-0-0-278bv" Nov 03 20:24:57.378604 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:57.378514 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqz9h\" (UniqueName: \"kubernetes.io/projected/b7ea44d4-1de1-4e4e-bb5f-b4fafa0a8487-kube-api-access-zqz9h\") pod \"e2e-test-runtime-update-node-0-0-278bv\" (UID: \"b7ea44d4-1de1-4e4e-bb5f-b4fafa0a8487\") " pod="e2e-9jmbp/e2e-test-runtime-update-node-0-0-278bv" Nov 03 20:24:57.402540 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:57.402513 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-9jmbp/e2e-test-runtime-update-node-0-0-278bv" Nov 03 20:24:57.453136 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:57.453101 5857 generic.go:356] "Generic (PLEG): container finished" podID="1a65e3a0-7dc0-41ca-8d92-1ec12a6bddb9" containerID="1a86a0d176214c9a262e08e8ad51f06d5571f37df7a5b3eb5af8af341eca47e4" exitCode=0 Nov 03 20:24:57.453647 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:57.453154 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-mn6k7/e2e-test-runtime-update-node-0-0-rgx4p" Nov 03 20:24:57.453647 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:57.453197 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-mn6k7/e2e-test-runtime-update-node-0-0-rgx4p" event={"ID":"1a65e3a0-7dc0-41ca-8d92-1ec12a6bddb9","Type":"ContainerDied","Data":"1a86a0d176214c9a262e08e8ad51f06d5571f37df7a5b3eb5af8af341eca47e4"} Nov 03 20:24:57.453647 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:57.453253 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-mn6k7/e2e-test-runtime-update-node-0-0-rgx4p" event={"ID":"1a65e3a0-7dc0-41ca-8d92-1ec12a6bddb9","Type":"ContainerDied","Data":"1f2838c504e5a361eca3f8e3a3d2388eff14ebccf3b351b6377c1d19f12db9b8"} Nov 03 20:24:57.453647 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:57.453277 5857 scope.go:122] "RemoveContainer" containerID="1a86a0d176214c9a262e08e8ad51f06d5571f37df7a5b3eb5af8af341eca47e4" Nov 03 20:24:57.456455 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:57.456331 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-mn6k7/e2e-test-runtime-update-node-0-0-7xk4q" event={"ID":"1a399777-e963-466d-8359-c70252abe2f2","Type":"ContainerStarted","Data":"6f9fcfd4bad8ef1482c3facad2ca627f773cde03a229250a704258244281244d"} Nov 03 20:24:57.456455 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:57.456366 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-mn6k7/e2e-test-runtime-update-node-0-0-7xk4q" event={"ID":"1a399777-e963-466d-8359-c70252abe2f2","Type":"ContainerStarted","Data":"cf94fe8e4acc925c1728a48c3ce2e322adfa20d9ec7d7b5c229808c42d2790ca"} Nov 03 20:24:57.456455 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:57.456422 5857 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-mn6k7/e2e-test-runtime-update-node-0-0-7xk4q" podUID="1a399777-e963-466d-8359-c70252abe2f2" containerName="node" containerID="cri-o://6f9fcfd4bad8ef1482c3facad2ca627f773cde03a229250a704258244281244d" gracePeriod=30 Nov 03 20:24:57.475090 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:57.475064 5857 scope.go:122] "RemoveContainer" containerID="1a86a0d176214c9a262e08e8ad51f06d5571f37df7a5b3eb5af8af341eca47e4" Nov 03 20:24:57.475488 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:24:57.475466 5857 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a86a0d176214c9a262e08e8ad51f06d5571f37df7a5b3eb5af8af341eca47e4\": container with ID starting with 1a86a0d176214c9a262e08e8ad51f06d5571f37df7a5b3eb5af8af341eca47e4 not found: ID does not exist" containerID="1a86a0d176214c9a262e08e8ad51f06d5571f37df7a5b3eb5af8af341eca47e4" Nov 03 20:24:57.475586 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:57.475500 5857 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a86a0d176214c9a262e08e8ad51f06d5571f37df7a5b3eb5af8af341eca47e4"} err="failed to get container status \"1a86a0d176214c9a262e08e8ad51f06d5571f37df7a5b3eb5af8af341eca47e4\": rpc error: code = NotFound desc = could not find container \"1a86a0d176214c9a262e08e8ad51f06d5571f37df7a5b3eb5af8af341eca47e4\": container with ID starting with 1a86a0d176214c9a262e08e8ad51f06d5571f37df7a5b3eb5af8af341eca47e4 not found: ID does not exist" Nov 03 20:24:57.621862 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:57.621801 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-mn6k7/e2e-test-runtime-update-node-0-0-7xk4q" podStartSLOduration=2.621785667 podStartE2EDuration="2.621785667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:24:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:24:57.619457774 +0000 UTC m=+1407.186347922" watchObservedRunningTime="2026-11-03 20:24:57.621785667 +0000 UTC m=+1407.188675815" Nov 03 20:24:57.718227 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:57.718200 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-mn6k7/e2e-test-runtime-update-node-0-0-7xk4q" Nov 03 20:24:57.739870 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:57.739841 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-mn6k7/e2e-test-runtime-update-node-0-0-rgx4p"] Nov 03 20:24:57.747255 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:57.747232 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-mn6k7/e2e-test-runtime-update-node-0-0-rgx4p"] Nov 03 20:24:57.761546 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:57.761522 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-9jmbp/e2e-test-runtime-update-node-0-0-278bv"] Nov 03 20:24:57.822864 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:57.822834 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1a399777-e963-466d-8359-c70252abe2f2-kube-api-access-kw2sj\" (UniqueName: \"kubernetes.io/projected/1a399777-e963-466d-8359-c70252abe2f2-kube-api-access-kw2sj\") pod \"1a399777-e963-466d-8359-c70252abe2f2\" (UID: \"1a399777-e963-466d-8359-c70252abe2f2\") " Nov 03 20:24:57.824982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:57.824954 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a399777-e963-466d-8359-c70252abe2f2-kube-api-access-kw2sj" pod "1a399777-e963-466d-8359-c70252abe2f2" (UID: "1a399777-e963-466d-8359-c70252abe2f2"). InnerVolumeSpecName "kube-api-access-kw2sj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:24:57.898240 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:57.898167 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-9jmbp/e2e-test-runtime-update-node-0-0-278bv"] Nov 03 20:24:57.900955 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:24:57.900926 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7ea44d4_1de1_4e4e_bb5f_b4fafa0a8487.slice/crio-ab6b4fda9896218abf1604ee457da96d77d8db8e9360d53ff286a819afe5469b WatchSource:0}: Error finding container ab6b4fda9896218abf1604ee457da96d77d8db8e9360d53ff286a819afe5469b: Status 404 returned error can't find the container with id ab6b4fda9896218abf1604ee457da96d77d8db8e9360d53ff286a819afe5469b Nov 03 20:24:57.923794 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:57.923759 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kw2sj\" (UniqueName: \"kubernetes.io/projected/1a399777-e963-466d-8359-c70252abe2f2-kube-api-access-kw2sj\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:24:58.462781 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:58.462745 5857 generic.go:356] "Generic (PLEG): container finished" podID="1a399777-e963-466d-8359-c70252abe2f2" containerID="6f9fcfd4bad8ef1482c3facad2ca627f773cde03a229250a704258244281244d" exitCode=0 Nov 03 20:24:58.463211 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:58.462794 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-mn6k7/e2e-test-runtime-update-node-0-0-7xk4q" Nov 03 20:24:58.463211 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:58.462831 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-mn6k7/e2e-test-runtime-update-node-0-0-7xk4q" event={"ID":"1a399777-e963-466d-8359-c70252abe2f2","Type":"ContainerDied","Data":"6f9fcfd4bad8ef1482c3facad2ca627f773cde03a229250a704258244281244d"} Nov 03 20:24:58.463211 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:58.462880 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-mn6k7/e2e-test-runtime-update-node-0-0-7xk4q" event={"ID":"1a399777-e963-466d-8359-c70252abe2f2","Type":"ContainerDied","Data":"cf94fe8e4acc925c1728a48c3ce2e322adfa20d9ec7d7b5c229808c42d2790ca"} Nov 03 20:24:58.463211 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:58.462897 5857 scope.go:122] "RemoveContainer" containerID="6f9fcfd4bad8ef1482c3facad2ca627f773cde03a229250a704258244281244d" Nov 03 20:24:58.464922 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:58.464888 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-9jmbp/e2e-test-runtime-update-node-0-0-278bv" event={"ID":"b7ea44d4-1de1-4e4e-bb5f-b4fafa0a8487","Type":"ContainerStarted","Data":"b75ed947cc7d2701bdfc07d53fa0c597d9e90571d3c9b221ef1bb99520a8982d"} Nov 03 20:24:58.465036 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:58.464922 5857 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-9jmbp/e2e-test-runtime-update-node-0-0-278bv" podUID="b7ea44d4-1de1-4e4e-bb5f-b4fafa0a8487" containerName="node" containerID="cri-o://b75ed947cc7d2701bdfc07d53fa0c597d9e90571d3c9b221ef1bb99520a8982d" gracePeriod=30 Nov 03 20:24:58.465036 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:58.464931 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-9jmbp/e2e-test-runtime-update-node-0-0-278bv" event={"ID":"b7ea44d4-1de1-4e4e-bb5f-b4fafa0a8487","Type":"ContainerStarted","Data":"ab6b4fda9896218abf1604ee457da96d77d8db8e9360d53ff286a819afe5469b"} Nov 03 20:24:58.472370 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:58.472347 5857 scope.go:122] "RemoveContainer" containerID="6f9fcfd4bad8ef1482c3facad2ca627f773cde03a229250a704258244281244d" Nov 03 20:24:58.472682 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:24:58.472657 5857 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f9fcfd4bad8ef1482c3facad2ca627f773cde03a229250a704258244281244d\": container with ID starting with 6f9fcfd4bad8ef1482c3facad2ca627f773cde03a229250a704258244281244d not found: ID does not exist" containerID="6f9fcfd4bad8ef1482c3facad2ca627f773cde03a229250a704258244281244d" Nov 03 20:24:58.472766 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:58.472690 5857 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f9fcfd4bad8ef1482c3facad2ca627f773cde03a229250a704258244281244d"} err="failed to get container status \"6f9fcfd4bad8ef1482c3facad2ca627f773cde03a229250a704258244281244d\": rpc error: code = NotFound desc = could not find container \"6f9fcfd4bad8ef1482c3facad2ca627f773cde03a229250a704258244281244d\": container with ID starting with 6f9fcfd4bad8ef1482c3facad2ca627f773cde03a229250a704258244281244d not found: ID does not exist" Nov 03 20:24:58.573555 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:58.573525 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1a65e3a0-7dc0-41ca-8d92-1ec12a6bddb9" path="/var/lib/kubelet/pods/1a65e3a0-7dc0-41ca-8d92-1ec12a6bddb9/volumes" Nov 03 20:24:58.625288 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:58.625259 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-mn6k7/e2e-test-runtime-update-node-0-0-7xk4q"] Nov 03 20:24:58.629167 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:58.629138 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-mn6k7/e2e-test-runtime-update-node-0-0-7xk4q"] Nov 03 20:24:58.712217 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:58.712189 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-9jmbp/e2e-test-runtime-update-node-0-0-278bv" Nov 03 20:24:58.743170 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:58.743085 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-9jmbp/e2e-test-runtime-update-node-0-0-278bv" podStartSLOduration=2.743070166 podStartE2EDuration="2.743070166s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:24:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:24:58.741433877 +0000 UTC m=+1408.308324024" watchObservedRunningTime="2026-11-03 20:24:58.743070166 +0000 UTC m=+1408.309960314" Nov 03 20:24:58.765043 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:58.765016 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-9jmbp/e2e-test-runtime-update-node-0-0-8xbm4"] Nov 03 20:24:58.765365 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:58.765353 5857 cpu_manager.go:414] "containerMap: removing container" podUID="1a399777-e963-466d-8359-c70252abe2f2" containerName="node" Nov 03 20:24:58.765408 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:58.765366 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1a399777-e963-466d-8359-c70252abe2f2" containerName="node" Nov 03 20:24:58.765408 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:58.765374 5857 cpu_manager.go:414] "containerMap: removing container" podUID="b7ea44d4-1de1-4e4e-bb5f-b4fafa0a8487" containerName="node" Nov 03 20:24:58.765408 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:58.765379 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b7ea44d4-1de1-4e4e-bb5f-b4fafa0a8487" containerName="node" Nov 03 20:24:58.765499 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:58.765433 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="1a399777-e963-466d-8359-c70252abe2f2" containerName="node" Nov 03 20:24:58.765499 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:58.765440 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="b7ea44d4-1de1-4e4e-bb5f-b4fafa0a8487" containerName="node" Nov 03 20:24:58.768333 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:58.768317 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-9jmbp/e2e-test-runtime-update-node-0-0-8xbm4" Nov 03 20:24:58.825879 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:58.825857 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-9jmbp/e2e-test-runtime-update-node-0-0-8xbm4"] Nov 03 20:24:58.830636 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:58.830616 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b7ea44d4-1de1-4e4e-bb5f-b4fafa0a8487-kube-api-access-zqz9h\" (UniqueName: \"kubernetes.io/projected/b7ea44d4-1de1-4e4e-bb5f-b4fafa0a8487-kube-api-access-zqz9h\") pod \"b7ea44d4-1de1-4e4e-bb5f-b4fafa0a8487\" (UID: \"b7ea44d4-1de1-4e4e-bb5f-b4fafa0a8487\") " Nov 03 20:24:58.830806 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:58.830792 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbmxw\" (UniqueName: \"kubernetes.io/projected/f6a98740-0e31-436f-9e7d-083ef067d154-kube-api-access-rbmxw\") pod \"e2e-test-runtime-update-node-0-0-8xbm4\" (UID: \"f6a98740-0e31-436f-9e7d-083ef067d154\") " pod="e2e-9jmbp/e2e-test-runtime-update-node-0-0-8xbm4" Nov 03 20:24:58.833138 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:58.833104 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7ea44d4-1de1-4e4e-bb5f-b4fafa0a8487-kube-api-access-zqz9h" pod "b7ea44d4-1de1-4e4e-bb5f-b4fafa0a8487" (UID: "b7ea44d4-1de1-4e4e-bb5f-b4fafa0a8487"). InnerVolumeSpecName "kube-api-access-zqz9h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:24:58.931861 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:58.931828 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbmxw\" (UniqueName: \"kubernetes.io/projected/f6a98740-0e31-436f-9e7d-083ef067d154-kube-api-access-rbmxw\") pod \"e2e-test-runtime-update-node-0-0-8xbm4\" (UID: \"f6a98740-0e31-436f-9e7d-083ef067d154\") " pod="e2e-9jmbp/e2e-test-runtime-update-node-0-0-8xbm4" Nov 03 20:24:58.932028 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:58.931926 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqz9h\" (UniqueName: \"kubernetes.io/projected/b7ea44d4-1de1-4e4e-bb5f-b4fafa0a8487-kube-api-access-zqz9h\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:24:58.992982 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:58.992954 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbmxw\" (UniqueName: \"kubernetes.io/projected/f6a98740-0e31-436f-9e7d-083ef067d154-kube-api-access-rbmxw\") pod \"e2e-test-runtime-update-node-0-0-8xbm4\" (UID: \"f6a98740-0e31-436f-9e7d-083ef067d154\") " pod="e2e-9jmbp/e2e-test-runtime-update-node-0-0-8xbm4" Nov 03 20:24:59.079723 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:59.079639 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-9jmbp/e2e-test-runtime-update-node-0-0-8xbm4" Nov 03 20:24:59.185582 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:59.185526 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-9jmbp/e2e-test-runtime-update-node-0-0-8xbm4"] Nov 03 20:24:59.457740 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:59.457705 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-9jmbp/e2e-test-runtime-update-node-0-0-8xbm4"] Nov 03 20:24:59.460753 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:24:59.460724 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6a98740_0e31_436f_9e7d_083ef067d154.slice/crio-a8d062627d2631ebc03c900fbf1a15ded3a82421d74d4688f133d92ef2398c9b WatchSource:0}: Error finding container a8d062627d2631ebc03c900fbf1a15ded3a82421d74d4688f133d92ef2398c9b: Status 404 returned error can't find the container with id a8d062627d2631ebc03c900fbf1a15ded3a82421d74d4688f133d92ef2398c9b Nov 03 20:24:59.472395 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:59.472366 5857 generic.go:356] "Generic (PLEG): container finished" podID="b7ea44d4-1de1-4e4e-bb5f-b4fafa0a8487" containerID="b75ed947cc7d2701bdfc07d53fa0c597d9e90571d3c9b221ef1bb99520a8982d" exitCode=0 Nov 03 20:24:59.472771 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:59.472411 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-9jmbp/e2e-test-runtime-update-node-0-0-278bv" Nov 03 20:24:59.472771 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:59.472445 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-9jmbp/e2e-test-runtime-update-node-0-0-278bv" event={"ID":"b7ea44d4-1de1-4e4e-bb5f-b4fafa0a8487","Type":"ContainerDied","Data":"b75ed947cc7d2701bdfc07d53fa0c597d9e90571d3c9b221ef1bb99520a8982d"} Nov 03 20:24:59.472771 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:59.472483 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-9jmbp/e2e-test-runtime-update-node-0-0-278bv" event={"ID":"b7ea44d4-1de1-4e4e-bb5f-b4fafa0a8487","Type":"ContainerDied","Data":"ab6b4fda9896218abf1604ee457da96d77d8db8e9360d53ff286a819afe5469b"} Nov 03 20:24:59.472771 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:59.472498 5857 scope.go:122] "RemoveContainer" containerID="b75ed947cc7d2701bdfc07d53fa0c597d9e90571d3c9b221ef1bb99520a8982d" Nov 03 20:24:59.475364 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:59.475341 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-9jmbp/e2e-test-runtime-update-node-0-0-8xbm4" event={"ID":"f6a98740-0e31-436f-9e7d-083ef067d154","Type":"ContainerStarted","Data":"a8d062627d2631ebc03c900fbf1a15ded3a82421d74d4688f133d92ef2398c9b"} Nov 03 20:24:59.484516 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:59.484493 5857 scope.go:122] "RemoveContainer" containerID="b75ed947cc7d2701bdfc07d53fa0c597d9e90571d3c9b221ef1bb99520a8982d" Nov 03 20:24:59.485103 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:24:59.485084 5857 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b75ed947cc7d2701bdfc07d53fa0c597d9e90571d3c9b221ef1bb99520a8982d\": container with ID starting with b75ed947cc7d2701bdfc07d53fa0c597d9e90571d3c9b221ef1bb99520a8982d not found: ID does not exist" containerID="b75ed947cc7d2701bdfc07d53fa0c597d9e90571d3c9b221ef1bb99520a8982d" Nov 03 20:24:59.485182 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:59.485112 5857 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b75ed947cc7d2701bdfc07d53fa0c597d9e90571d3c9b221ef1bb99520a8982d"} err="failed to get container status \"b75ed947cc7d2701bdfc07d53fa0c597d9e90571d3c9b221ef1bb99520a8982d\": rpc error: code = NotFound desc = could not find container \"b75ed947cc7d2701bdfc07d53fa0c597d9e90571d3c9b221ef1bb99520a8982d\": container with ID starting with b75ed947cc7d2701bdfc07d53fa0c597d9e90571d3c9b221ef1bb99520a8982d not found: ID does not exist" Nov 03 20:24:59.634436 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:59.634401 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-9jmbp/e2e-test-runtime-update-node-0-0-278bv"] Nov 03 20:24:59.666842 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:24:59.666805 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-9jmbp/e2e-test-runtime-update-node-0-0-278bv"] Nov 03 20:25:00.069125 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:00.069093 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-wjgb4/progression-enabled-node-0-0-whcb9"] Nov 03 20:25:00.072652 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:00.072637 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-wjgb4/progression-enabled-node-0-0-whcb9" Nov 03 20:25:00.131736 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:00.131684 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-wjgb4\"/\"openshift-service-ca.crt\"" Nov 03 20:25:00.133466 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:00.133445 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-wjgb4/progression-enabled-node-0-0-whcb9"] Nov 03 20:25:00.143139 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:00.143116 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr2g7\" (UniqueName: \"kubernetes.io/projected/d614379a-fcd5-421c-a575-6d474e7c1b5b-kube-api-access-nr2g7\") pod \"progression-enabled-node-0-0-whcb9\" (UID: \"d614379a-fcd5-421c-a575-6d474e7c1b5b\") " pod="rhai-e2e-progression-wjgb4/progression-enabled-node-0-0-whcb9" Nov 03 20:25:00.178050 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:00.178030 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-wjgb4\"/\"kube-root-ca.crt\"" Nov 03 20:25:00.178050 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:00.178043 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-wjgb4\"/\"default-dockercfg-svwp4\"" Nov 03 20:25:00.244421 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:00.244389 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr2g7\" (UniqueName: \"kubernetes.io/projected/d614379a-fcd5-421c-a575-6d474e7c1b5b-kube-api-access-nr2g7\") pod \"progression-enabled-node-0-0-whcb9\" (UID: \"d614379a-fcd5-421c-a575-6d474e7c1b5b\") " pod="rhai-e2e-progression-wjgb4/progression-enabled-node-0-0-whcb9" Nov 03 20:25:00.305335 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:00.305301 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr2g7\" (UniqueName: \"kubernetes.io/projected/d614379a-fcd5-421c-a575-6d474e7c1b5b-kube-api-access-nr2g7\") pod \"progression-enabled-node-0-0-whcb9\" (UID: \"d614379a-fcd5-421c-a575-6d474e7c1b5b\") " pod="rhai-e2e-progression-wjgb4/progression-enabled-node-0-0-whcb9" Nov 03 20:25:00.385141 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:00.385066 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-wjgb4/progression-enabled-node-0-0-whcb9" Nov 03 20:25:00.482028 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:00.481994 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-9jmbp/e2e-test-runtime-update-node-0-0-8xbm4" event={"ID":"f6a98740-0e31-436f-9e7d-083ef067d154","Type":"ContainerStarted","Data":"081b47285baf00803179ab86860f5a1ee9ea44070af9059132b57c26445e1602"} Nov 03 20:25:00.482028 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:00.482019 5857 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-9jmbp/e2e-test-runtime-update-node-0-0-8xbm4" podUID="f6a98740-0e31-436f-9e7d-083ef067d154" containerName="node" containerID="cri-o://081b47285baf00803179ab86860f5a1ee9ea44070af9059132b57c26445e1602" gracePeriod=30 Nov 03 20:25:00.578632 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:00.578602 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1a399777-e963-466d-8359-c70252abe2f2" path="/var/lib/kubelet/pods/1a399777-e963-466d-8359-c70252abe2f2/volumes" Nov 03 20:25:00.578923 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:00.578911 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b7ea44d4-1de1-4e4e-bb5f-b4fafa0a8487" path="/var/lib/kubelet/pods/b7ea44d4-1de1-4e4e-bb5f-b4fafa0a8487/volumes" Nov 03 20:25:00.597860 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:00.597801 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-9jmbp/e2e-test-runtime-update-node-0-0-8xbm4" podStartSLOduration=2.597783363 podStartE2EDuration="2.597783363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:24:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:25:00.597240731 +0000 UTC m=+1410.164130880" watchObservedRunningTime="2026-11-03 20:25:00.597783363 +0000 UTC m=+1410.164673515" Nov 03 20:25:00.736161 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:00.736136 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-9jmbp/e2e-test-runtime-update-node-0-0-8xbm4" Nov 03 20:25:00.811002 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:00.810968 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-wjgb4/progression-enabled-node-0-0-whcb9"] Nov 03 20:25:00.813895 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:25:00.813861 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd614379a_fcd5_421c_a575_6d474e7c1b5b.slice/crio-e0cb39d908f0f2bcc0f6c7627e99396be345e4447c970f4340fb2b1ab29a0291 WatchSource:0}: Error finding container e0cb39d908f0f2bcc0f6c7627e99396be345e4447c970f4340fb2b1ab29a0291: Status 404 returned error can't find the container with id e0cb39d908f0f2bcc0f6c7627e99396be345e4447c970f4340fb2b1ab29a0291 Nov 03 20:25:00.850076 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:00.850053 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f6a98740-0e31-436f-9e7d-083ef067d154-kube-api-access-rbmxw\" (UniqueName: \"kubernetes.io/projected/f6a98740-0e31-436f-9e7d-083ef067d154-kube-api-access-rbmxw\") pod \"f6a98740-0e31-436f-9e7d-083ef067d154\" (UID: \"f6a98740-0e31-436f-9e7d-083ef067d154\") " Nov 03 20:25:00.852816 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:00.852782 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6a98740-0e31-436f-9e7d-083ef067d154-kube-api-access-rbmxw" pod "f6a98740-0e31-436f-9e7d-083ef067d154" (UID: "f6a98740-0e31-436f-9e7d-083ef067d154"). InnerVolumeSpecName "kube-api-access-rbmxw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:25:00.950971 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:00.950891 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbmxw\" (UniqueName: \"kubernetes.io/projected/f6a98740-0e31-436f-9e7d-083ef067d154-kube-api-access-rbmxw\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:25:01.489863 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:01.489823 5857 generic.go:356] "Generic (PLEG): container finished" podID="f6a98740-0e31-436f-9e7d-083ef067d154" containerID="081b47285baf00803179ab86860f5a1ee9ea44070af9059132b57c26445e1602" exitCode=0 Nov 03 20:25:01.490288 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:01.489870 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-9jmbp/e2e-test-runtime-update-node-0-0-8xbm4" Nov 03 20:25:01.490288 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:01.489903 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-9jmbp/e2e-test-runtime-update-node-0-0-8xbm4" event={"ID":"f6a98740-0e31-436f-9e7d-083ef067d154","Type":"ContainerDied","Data":"081b47285baf00803179ab86860f5a1ee9ea44070af9059132b57c26445e1602"} Nov 03 20:25:01.490288 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:01.489963 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-9jmbp/e2e-test-runtime-update-node-0-0-8xbm4" event={"ID":"f6a98740-0e31-436f-9e7d-083ef067d154","Type":"ContainerDied","Data":"a8d062627d2631ebc03c900fbf1a15ded3a82421d74d4688f133d92ef2398c9b"} Nov 03 20:25:01.490288 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:01.489991 5857 scope.go:122] "RemoveContainer" containerID="081b47285baf00803179ab86860f5a1ee9ea44070af9059132b57c26445e1602" Nov 03 20:25:01.491398 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:01.491333 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-wjgb4/progression-enabled-node-0-0-whcb9" event={"ID":"d614379a-fcd5-421c-a575-6d474e7c1b5b","Type":"ContainerStarted","Data":"e0cb39d908f0f2bcc0f6c7627e99396be345e4447c970f4340fb2b1ab29a0291"} Nov 03 20:25:01.499375 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:01.499360 5857 scope.go:122] "RemoveContainer" containerID="081b47285baf00803179ab86860f5a1ee9ea44070af9059132b57c26445e1602" Nov 03 20:25:01.499629 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:25:01.499604 5857 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"081b47285baf00803179ab86860f5a1ee9ea44070af9059132b57c26445e1602\": container with ID starting with 081b47285baf00803179ab86860f5a1ee9ea44070af9059132b57c26445e1602 not found: ID does not exist" containerID="081b47285baf00803179ab86860f5a1ee9ea44070af9059132b57c26445e1602" Nov 03 20:25:01.499711 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:01.499639 5857 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"081b47285baf00803179ab86860f5a1ee9ea44070af9059132b57c26445e1602"} err="failed to get container status \"081b47285baf00803179ab86860f5a1ee9ea44070af9059132b57c26445e1602\": rpc error: code = NotFound desc = could not find container \"081b47285baf00803179ab86860f5a1ee9ea44070af9059132b57c26445e1602\": container with ID starting with 081b47285baf00803179ab86860f5a1ee9ea44070af9059132b57c26445e1602 not found: ID does not exist" Nov 03 20:25:01.651529 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:01.651495 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-9jmbp/e2e-test-runtime-update-node-0-0-8xbm4"] Nov 03 20:25:01.700905 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:01.700872 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-9jmbp/e2e-test-runtime-update-node-0-0-8xbm4"] Nov 03 20:25:02.575580 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:02.575530 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f6a98740-0e31-436f-9e7d-083ef067d154" path="/var/lib/kubelet/pods/f6a98740-0e31-436f-9e7d-083ef067d154/volumes" Nov 03 20:25:19.508923 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:25:19.508878 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:25:23.316742 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:23.316714 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-xwgz9/e2e-deadline-job-node-0-0-9vkwz" Nov 03 20:25:23.370142 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:23.370108 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aaf3ac30-7559-4875-a2a2-c7d414019f99-kube-api-access-m9pdn\" (UniqueName: \"kubernetes.io/projected/aaf3ac30-7559-4875-a2a2-c7d414019f99-kube-api-access-m9pdn\") pod \"aaf3ac30-7559-4875-a2a2-c7d414019f99\" (UID: \"aaf3ac30-7559-4875-a2a2-c7d414019f99\") " Nov 03 20:25:23.372648 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:23.372623 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaf3ac30-7559-4875-a2a2-c7d414019f99-kube-api-access-m9pdn" pod "aaf3ac30-7559-4875-a2a2-c7d414019f99" (UID: "aaf3ac30-7559-4875-a2a2-c7d414019f99"). InnerVolumeSpecName "kube-api-access-m9pdn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:25:23.470910 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:23.470877 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9pdn\" (UniqueName: \"kubernetes.io/projected/aaf3ac30-7559-4875-a2a2-c7d414019f99-kube-api-access-m9pdn\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:25:23.634099 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:23.634059 5857 generic.go:356] "Generic (PLEG): container finished" podID="aaf3ac30-7559-4875-a2a2-c7d414019f99" containerID="d670eaf586dcba6a4493605e2433a73fb8d74e5015953a6c5084748f9d0424af" exitCode=137 Nov 03 20:25:23.634298 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:23.634127 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-xwgz9/e2e-deadline-job-node-0-0-9vkwz" event={"ID":"aaf3ac30-7559-4875-a2a2-c7d414019f99","Type":"ContainerDied","Data":"d670eaf586dcba6a4493605e2433a73fb8d74e5015953a6c5084748f9d0424af"} Nov 03 20:25:23.634298 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:23.634164 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-xwgz9/e2e-deadline-job-node-0-0-9vkwz" event={"ID":"aaf3ac30-7559-4875-a2a2-c7d414019f99","Type":"ContainerDied","Data":"b8749f44dea8f285076b88282d85ca844623ecd3e1d60a7106466ebaf82543c5"} Nov 03 20:25:23.634298 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:23.634182 5857 scope.go:122] "RemoveContainer" containerID="d670eaf586dcba6a4493605e2433a73fb8d74e5015953a6c5084748f9d0424af" Nov 03 20:25:23.634298 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:23.634132 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-xwgz9/e2e-deadline-job-node-0-0-9vkwz" Nov 03 20:25:23.645147 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:23.645120 5857 scope.go:122] "RemoveContainer" containerID="d670eaf586dcba6a4493605e2433a73fb8d74e5015953a6c5084748f9d0424af" Nov 03 20:25:23.645517 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:25:23.645490 5857 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d670eaf586dcba6a4493605e2433a73fb8d74e5015953a6c5084748f9d0424af\": container with ID starting with d670eaf586dcba6a4493605e2433a73fb8d74e5015953a6c5084748f9d0424af not found: ID does not exist" containerID="d670eaf586dcba6a4493605e2433a73fb8d74e5015953a6c5084748f9d0424af" Nov 03 20:25:23.645620 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:23.645531 5857 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d670eaf586dcba6a4493605e2433a73fb8d74e5015953a6c5084748f9d0424af"} err="failed to get container status \"d670eaf586dcba6a4493605e2433a73fb8d74e5015953a6c5084748f9d0424af\": rpc error: code = NotFound desc = could not find container \"d670eaf586dcba6a4493605e2433a73fb8d74e5015953a6c5084748f9d0424af\": container with ID starting with d670eaf586dcba6a4493605e2433a73fb8d74e5015953a6c5084748f9d0424af not found: ID does not exist" Nov 03 20:25:23.796518 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:23.796437 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-xwgz9/e2e-deadline-job-node-0-0-9vkwz"] Nov 03 20:25:23.800370 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:23.800350 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-xwgz9/e2e-deadline-job-node-0-0-9vkwz"] Nov 03 20:25:24.573611 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:25:24.573575 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="aaf3ac30-7559-4875-a2a2-c7d414019f99" path="/var/lib/kubelet/pods/aaf3ac30-7559-4875-a2a2-c7d414019f99/volumes" Nov 03 20:25:49.510010 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:25:49.509892 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:26:09.900619 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:09.900579 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-wjgb4/progression-enabled-node-0-0-whcb9" event={"ID":"d614379a-fcd5-421c-a575-6d474e7c1b5b","Type":"ContainerStarted","Data":"86b12ccb210b0490e067bf3faa6c2230e486447c573d8e0ea65ea0bf37eb1fd0"} Nov 03 20:26:10.018345 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:10.018288 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="rhai-e2e-progression-wjgb4/progression-enabled-node-0-0-whcb9" podStartSLOduration=2.848562473 podStartE2EDuration="1m11.018274614s" totalImagesPullingTime="1m8.169712141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:24:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:26:10.016461008 +0000 UTC m=+1479.583351169" watchObservedRunningTime="2026-11-03 20:26:10.018274614 +0000 UTC m=+1479.585164759" Nov 03 20:26:19.499891 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:26:19.499846 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:26:31.005915 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:31.005825 5857 generic.go:356] "Generic (PLEG): container finished" podID="d614379a-fcd5-421c-a575-6d474e7c1b5b" containerID="86b12ccb210b0490e067bf3faa6c2230e486447c573d8e0ea65ea0bf37eb1fd0" exitCode=0 Nov 03 20:26:31.006351 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:31.005908 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-wjgb4/progression-enabled-node-0-0-whcb9" event={"ID":"d614379a-fcd5-421c-a575-6d474e7c1b5b","Type":"ContainerDied","Data":"86b12ccb210b0490e067bf3faa6c2230e486447c573d8e0ea65ea0bf37eb1fd0"} Nov 03 20:26:32.153030 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:32.153005 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-wjgb4/progression-enabled-node-0-0-whcb9" Nov 03 20:26:32.293981 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:32.293891 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d614379a-fcd5-421c-a575-6d474e7c1b5b-kube-api-access-nr2g7\" (UniqueName: \"kubernetes.io/projected/d614379a-fcd5-421c-a575-6d474e7c1b5b-kube-api-access-nr2g7\") pod \"d614379a-fcd5-421c-a575-6d474e7c1b5b\" (UID: \"d614379a-fcd5-421c-a575-6d474e7c1b5b\") " Nov 03 20:26:32.296401 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:32.296355 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d614379a-fcd5-421c-a575-6d474e7c1b5b-kube-api-access-nr2g7" pod "d614379a-fcd5-421c-a575-6d474e7c1b5b" (UID: "d614379a-fcd5-421c-a575-6d474e7c1b5b"). InnerVolumeSpecName "kube-api-access-nr2g7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:26:32.394431 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:32.394402 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nr2g7\" (UniqueName: \"kubernetes.io/projected/d614379a-fcd5-421c-a575-6d474e7c1b5b-kube-api-access-nr2g7\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:26:33.022769 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:33.022735 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-wjgb4/progression-enabled-node-0-0-whcb9" Nov 03 20:26:33.022944 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:33.022739 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-wjgb4/progression-enabled-node-0-0-whcb9" event={"ID":"d614379a-fcd5-421c-a575-6d474e7c1b5b","Type":"ContainerDied","Data":"e0cb39d908f0f2bcc0f6c7627e99396be345e4447c970f4340fb2b1ab29a0291"} Nov 03 20:26:33.022944 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:33.022879 5857 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e0cb39d908f0f2bcc0f6c7627e99396be345e4447c970f4340fb2b1ab29a0291" Nov 03 20:26:35.806359 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:35.806325 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-wjgb4/progression-disabled-node-0-0-mr6cj"] Nov 03 20:26:35.806782 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:35.806679 5857 cpu_manager.go:414] "containerMap: removing container" podUID="f6a98740-0e31-436f-9e7d-083ef067d154" containerName="node" Nov 03 20:26:35.806782 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:35.806690 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f6a98740-0e31-436f-9e7d-083ef067d154" containerName="node" Nov 03 20:26:35.806782 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:35.806701 5857 cpu_manager.go:414] "containerMap: removing container" podUID="aaf3ac30-7559-4875-a2a2-c7d414019f99" containerName="node" Nov 03 20:26:35.806782 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:35.806705 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aaf3ac30-7559-4875-a2a2-c7d414019f99" containerName="node" Nov 03 20:26:35.806782 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:35.806715 5857 cpu_manager.go:414] "containerMap: removing container" podUID="d614379a-fcd5-421c-a575-6d474e7c1b5b" containerName="node" Nov 03 20:26:35.806782 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:35.806721 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d614379a-fcd5-421c-a575-6d474e7c1b5b" containerName="node" Nov 03 20:26:35.806973 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:35.806789 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="f6a98740-0e31-436f-9e7d-083ef067d154" containerName="node" Nov 03 20:26:35.806973 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:35.806797 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="aaf3ac30-7559-4875-a2a2-c7d414019f99" containerName="node" Nov 03 20:26:35.806973 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:35.806802 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="d614379a-fcd5-421c-a575-6d474e7c1b5b" containerName="node" Nov 03 20:26:35.823626 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:35.823609 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-wjgb4/progression-disabled-node-0-0-mr6cj" Nov 03 20:26:35.925031 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:35.924997 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-wjgb4\"/\"kube-root-ca.crt\"" Nov 03 20:26:35.925031 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:35.925003 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-wjgb4\"/\"openshift-service-ca.crt\"" Nov 03 20:26:35.925284 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:35.925041 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-wjgb4\"/\"default-dockercfg-svwp4\"" Nov 03 20:26:35.925456 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:35.925436 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trqch\" (UniqueName: \"kubernetes.io/projected/1fee5df0-90d4-457f-b3e3-9d5a44182212-kube-api-access-trqch\") pod \"progression-disabled-node-0-0-mr6cj\" (UID: \"1fee5df0-90d4-457f-b3e3-9d5a44182212\") " pod="rhai-e2e-progression-wjgb4/progression-disabled-node-0-0-mr6cj" Nov 03 20:26:35.926622 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:35.926598 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-wjgb4/progression-disabled-node-0-0-mr6cj"] Nov 03 20:26:36.025973 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:36.025943 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trqch\" (UniqueName: \"kubernetes.io/projected/1fee5df0-90d4-457f-b3e3-9d5a44182212-kube-api-access-trqch\") pod \"progression-disabled-node-0-0-mr6cj\" (UID: \"1fee5df0-90d4-457f-b3e3-9d5a44182212\") " pod="rhai-e2e-progression-wjgb4/progression-disabled-node-0-0-mr6cj" Nov 03 20:26:36.086967 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:36.086897 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trqch\" (UniqueName: \"kubernetes.io/projected/1fee5df0-90d4-457f-b3e3-9d5a44182212-kube-api-access-trqch\") pod \"progression-disabled-node-0-0-mr6cj\" (UID: \"1fee5df0-90d4-457f-b3e3-9d5a44182212\") " pod="rhai-e2e-progression-wjgb4/progression-disabled-node-0-0-mr6cj" Nov 03 20:26:36.147365 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:36.147335 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-wjgb4/progression-disabled-node-0-0-mr6cj" Nov 03 20:26:36.582862 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:36.582784 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-wjgb4/progression-disabled-node-0-0-mr6cj"] Nov 03 20:26:36.585633 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:26:36.585608 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fee5df0_90d4_457f_b3e3_9d5a44182212.slice/crio-fad935bfab0ace8e049735a5e0d3d05c3ca465a585ed3ee142cb7c3dc6ebcf2a WatchSource:0}: Error finding container fad935bfab0ace8e049735a5e0d3d05c3ca465a585ed3ee142cb7c3dc6ebcf2a: Status 404 returned error can't find the container with id fad935bfab0ace8e049735a5e0d3d05c3ca465a585ed3ee142cb7c3dc6ebcf2a Nov 03 20:26:37.044841 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:37.044806 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-wjgb4/progression-disabled-node-0-0-mr6cj" event={"ID":"1fee5df0-90d4-457f-b3e3-9d5a44182212","Type":"ContainerStarted","Data":"600273e5ab9febf0fa6c72bbf5c71593d9675d5b775bbfcce6d8bb8b1eb9d331"} Nov 03 20:26:37.045226 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:37.044859 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-wjgb4/progression-disabled-node-0-0-mr6cj" event={"ID":"1fee5df0-90d4-457f-b3e3-9d5a44182212","Type":"ContainerStarted","Data":"fad935bfab0ace8e049735a5e0d3d05c3ca465a585ed3ee142cb7c3dc6ebcf2a"} Nov 03 20:26:37.160988 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:37.160929 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="rhai-e2e-progression-wjgb4/progression-disabled-node-0-0-mr6cj" podStartSLOduration=2.160909733 podStartE2EDuration="2.160909733s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:26:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:26:37.159903756 +0000 UTC m=+1506.726793904" watchObservedRunningTime="2026-11-03 20:26:37.160909733 +0000 UTC m=+1506.727799881" Nov 03 20:26:49.499279 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:26:49.499172 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:26:58.149512 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:58.149481 5857 generic.go:356] "Generic (PLEG): container finished" podID="1fee5df0-90d4-457f-b3e3-9d5a44182212" containerID="600273e5ab9febf0fa6c72bbf5c71593d9675d5b775bbfcce6d8bb8b1eb9d331" exitCode=0 Nov 03 20:26:58.149874 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:58.149555 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-wjgb4/progression-disabled-node-0-0-mr6cj" event={"ID":"1fee5df0-90d4-457f-b3e3-9d5a44182212","Type":"ContainerDied","Data":"600273e5ab9febf0fa6c72bbf5c71593d9675d5b775bbfcce6d8bb8b1eb9d331"} Nov 03 20:26:59.284597 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:59.284549 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-wjgb4/progression-disabled-node-0-0-mr6cj" Nov 03 20:26:59.430396 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:59.430322 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1fee5df0-90d4-457f-b3e3-9d5a44182212-kube-api-access-trqch\" (UniqueName: \"kubernetes.io/projected/1fee5df0-90d4-457f-b3e3-9d5a44182212-kube-api-access-trqch\") pod \"1fee5df0-90d4-457f-b3e3-9d5a44182212\" (UID: \"1fee5df0-90d4-457f-b3e3-9d5a44182212\") " Nov 03 20:26:59.432523 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:59.432498 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fee5df0-90d4-457f-b3e3-9d5a44182212-kube-api-access-trqch" pod "1fee5df0-90d4-457f-b3e3-9d5a44182212" (UID: "1fee5df0-90d4-457f-b3e3-9d5a44182212"). InnerVolumeSpecName "kube-api-access-trqch". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:26:59.531617 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:26:59.531588 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trqch\" (UniqueName: \"kubernetes.io/projected/1fee5df0-90d4-457f-b3e3-9d5a44182212-kube-api-access-trqch\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:27:00.161129 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:00.161102 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-wjgb4/progression-disabled-node-0-0-mr6cj" Nov 03 20:27:00.161129 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:00.161119 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-wjgb4/progression-disabled-node-0-0-mr6cj" event={"ID":"1fee5df0-90d4-457f-b3e3-9d5a44182212","Type":"ContainerDied","Data":"fad935bfab0ace8e049735a5e0d3d05c3ca465a585ed3ee142cb7c3dc6ebcf2a"} Nov 03 20:27:00.161355 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:00.161168 5857 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fad935bfab0ace8e049735a5e0d3d05c3ca465a585ed3ee142cb7c3dc6ebcf2a" Nov 03 20:27:10.512536 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:10.512463 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-wjgb4/progression-invalid-node-0-0-q8bpg"] Nov 03 20:27:10.512942 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:10.512812 5857 cpu_manager.go:414] "containerMap: removing container" podUID="1fee5df0-90d4-457f-b3e3-9d5a44182212" containerName="node" Nov 03 20:27:10.512942 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:10.512823 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1fee5df0-90d4-457f-b3e3-9d5a44182212" containerName="node" Nov 03 20:27:10.512942 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:10.512902 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="1fee5df0-90d4-457f-b3e3-9d5a44182212" containerName="node" Nov 03 20:27:10.514698 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:10.514682 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-wjgb4/progression-invalid-node-0-0-q8bpg" Nov 03 20:27:10.518981 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:10.518956 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpndt\" (UniqueName: \"kubernetes.io/projected/b60b1fd5-2948-415a-afac-02b4e6950341-kube-api-access-hpndt\") pod \"progression-invalid-node-0-0-q8bpg\" (UID: \"b60b1fd5-2948-415a-afac-02b4e6950341\") " pod="rhai-e2e-progression-wjgb4/progression-invalid-node-0-0-q8bpg" Nov 03 20:27:10.616106 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:10.616072 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-wjgb4\"/\"openshift-service-ca.crt\"" Nov 03 20:27:10.616106 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:10.616072 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-wjgb4\"/\"kube-root-ca.crt\"" Nov 03 20:27:10.616106 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:10.616102 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-wjgb4\"/\"default-dockercfg-svwp4\"" Nov 03 20:27:10.617539 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:10.617520 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-wjgb4/progression-invalid-node-0-0-q8bpg"] Nov 03 20:27:10.619670 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:10.619652 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpndt\" (UniqueName: \"kubernetes.io/projected/b60b1fd5-2948-415a-afac-02b4e6950341-kube-api-access-hpndt\") pod \"progression-invalid-node-0-0-q8bpg\" (UID: \"b60b1fd5-2948-415a-afac-02b4e6950341\") " pod="rhai-e2e-progression-wjgb4/progression-invalid-node-0-0-q8bpg" Nov 03 20:27:10.686185 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:10.686151 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpndt\" (UniqueName: \"kubernetes.io/projected/b60b1fd5-2948-415a-afac-02b4e6950341-kube-api-access-hpndt\") pod \"progression-invalid-node-0-0-q8bpg\" (UID: \"b60b1fd5-2948-415a-afac-02b4e6950341\") " pod="rhai-e2e-progression-wjgb4/progression-invalid-node-0-0-q8bpg" Nov 03 20:27:10.825055 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:10.824971 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-wjgb4/progression-invalid-node-0-0-q8bpg" Nov 03 20:27:11.245789 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:11.245752 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-wjgb4/progression-invalid-node-0-0-q8bpg"] Nov 03 20:27:11.248667 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:27:11.248640 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb60b1fd5_2948_415a_afac_02b4e6950341.slice/crio-9a9797137bb4bb93b1b130e76da267f84f772a26db9f4dee3d706840e553ac75 WatchSource:0}: Error finding container 9a9797137bb4bb93b1b130e76da267f84f772a26db9f4dee3d706840e553ac75: Status 404 returned error can't find the container with id 9a9797137bb4bb93b1b130e76da267f84f772a26db9f4dee3d706840e553ac75 Nov 03 20:27:12.219931 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:12.219888 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-wjgb4/progression-invalid-node-0-0-q8bpg" event={"ID":"b60b1fd5-2948-415a-afac-02b4e6950341","Type":"ContainerStarted","Data":"ad80b24c42848c5175f825933a1d9dc150f07116d96fd346e9f54d596751da3e"} Nov 03 20:27:12.220369 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:12.219952 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-wjgb4/progression-invalid-node-0-0-q8bpg" event={"ID":"b60b1fd5-2948-415a-afac-02b4e6950341","Type":"ContainerStarted","Data":"9a9797137bb4bb93b1b130e76da267f84f772a26db9f4dee3d706840e553ac75"} Nov 03 20:27:12.377545 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:12.377022 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="rhai-e2e-progression-wjgb4/progression-invalid-node-0-0-q8bpg" podStartSLOduration=2.377001211 podStartE2EDuration="2.377001211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:27:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:27:12.376709224 +0000 UTC m=+1541.943599385" watchObservedRunningTime="2026-11-03 20:27:12.377001211 +0000 UTC m=+1541.943891360" Nov 03 20:27:19.499547 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:27:19.499508 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:27:25.737284 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:25.737249 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-wjgb4/progression-custom-config-node-0-0-c4jsb"] Nov 03 20:27:25.739787 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:25.739765 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-wjgb4/progression-custom-config-node-0-0-c4jsb" Nov 03 20:27:25.842147 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:25.842112 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtbpk\" (UniqueName: \"kubernetes.io/projected/72de211a-07ed-423e-bcfe-9b497635fd9d-kube-api-access-jtbpk\") pod \"progression-custom-config-node-0-0-c4jsb\" (UID: \"72de211a-07ed-423e-bcfe-9b497635fd9d\") " pod="rhai-e2e-progression-wjgb4/progression-custom-config-node-0-0-c4jsb" Nov 03 20:27:25.842671 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:25.842649 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-wjgb4/progression-custom-config-node-0-0-c4jsb"] Nov 03 20:27:25.943546 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:25.943511 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtbpk\" (UniqueName: \"kubernetes.io/projected/72de211a-07ed-423e-bcfe-9b497635fd9d-kube-api-access-jtbpk\") pod \"progression-custom-config-node-0-0-c4jsb\" (UID: \"72de211a-07ed-423e-bcfe-9b497635fd9d\") " pod="rhai-e2e-progression-wjgb4/progression-custom-config-node-0-0-c4jsb" Nov 03 20:27:26.005070 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:26.005000 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtbpk\" (UniqueName: \"kubernetes.io/projected/72de211a-07ed-423e-bcfe-9b497635fd9d-kube-api-access-jtbpk\") pod \"progression-custom-config-node-0-0-c4jsb\" (UID: \"72de211a-07ed-423e-bcfe-9b497635fd9d\") " pod="rhai-e2e-progression-wjgb4/progression-custom-config-node-0-0-c4jsb" Nov 03 20:27:26.050094 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:26.050057 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-wjgb4/progression-custom-config-node-0-0-c4jsb" Nov 03 20:27:26.470595 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:26.470540 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-wjgb4/progression-custom-config-node-0-0-c4jsb"] Nov 03 20:27:26.473384 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:27:26.473359 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72de211a_07ed_423e_bcfe_9b497635fd9d.slice/crio-ccf210287a91313fc96af5b98113107f4831d82831cf78f93cb76cb8549020de WatchSource:0}: Error finding container ccf210287a91313fc96af5b98113107f4831d82831cf78f93cb76cb8549020de: Status 404 returned error can't find the container with id ccf210287a91313fc96af5b98113107f4831d82831cf78f93cb76cb8549020de Nov 03 20:27:27.292650 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:27.292611 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-wjgb4/progression-custom-config-node-0-0-c4jsb" event={"ID":"72de211a-07ed-423e-bcfe-9b497635fd9d","Type":"ContainerStarted","Data":"27da2cd565c7c95e909fee3053195c69c33cbdde7fc1b0d3f7f82310a2b8662d"} Nov 03 20:27:27.293044 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:27.292669 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-wjgb4/progression-custom-config-node-0-0-c4jsb" event={"ID":"72de211a-07ed-423e-bcfe-9b497635fd9d","Type":"ContainerStarted","Data":"ccf210287a91313fc96af5b98113107f4831d82831cf78f93cb76cb8549020de"} Nov 03 20:27:27.408997 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:27.408946 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="rhai-e2e-progression-wjgb4/progression-custom-config-node-0-0-c4jsb" podStartSLOduration=2.408928172 podStartE2EDuration="2.408928172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:27:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:27:27.407921598 +0000 UTC m=+1556.974811746" watchObservedRunningTime="2026-11-03 20:27:27.408928172 +0000 UTC m=+1556.975818319" Nov 03 20:27:32.976514 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:32.976481 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-wjgb4/progression-job-failure-node-0-0-mnvwf"] Nov 03 20:27:32.978870 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:32.978852 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-wjgb4/progression-job-failure-node-0-0-mnvwf" Nov 03 20:27:33.084443 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:33.084411 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-wjgb4/progression-job-failure-node-0-0-mnvwf"] Nov 03 20:27:33.101315 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:33.101285 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-949vg\" (UniqueName: \"kubernetes.io/projected/11bd8610-bab8-464d-900c-2ed1cd69f950-kube-api-access-949vg\") pod \"progression-job-failure-node-0-0-mnvwf\" (UID: \"11bd8610-bab8-464d-900c-2ed1cd69f950\") " pod="rhai-e2e-progression-wjgb4/progression-job-failure-node-0-0-mnvwf" Nov 03 20:27:33.202587 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:33.202535 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-949vg\" (UniqueName: \"kubernetes.io/projected/11bd8610-bab8-464d-900c-2ed1cd69f950-kube-api-access-949vg\") pod \"progression-job-failure-node-0-0-mnvwf\" (UID: \"11bd8610-bab8-464d-900c-2ed1cd69f950\") " pod="rhai-e2e-progression-wjgb4/progression-job-failure-node-0-0-mnvwf" Nov 03 20:27:33.263640 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:33.263557 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-949vg\" (UniqueName: \"kubernetes.io/projected/11bd8610-bab8-464d-900c-2ed1cd69f950-kube-api-access-949vg\") pod \"progression-job-failure-node-0-0-mnvwf\" (UID: \"11bd8610-bab8-464d-900c-2ed1cd69f950\") " pod="rhai-e2e-progression-wjgb4/progression-job-failure-node-0-0-mnvwf" Nov 03 20:27:33.289422 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:33.289401 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-wjgb4/progression-job-failure-node-0-0-mnvwf" Nov 03 20:27:33.324553 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:33.324517 5857 generic.go:356] "Generic (PLEG): container finished" podID="b60b1fd5-2948-415a-afac-02b4e6950341" containerID="ad80b24c42848c5175f825933a1d9dc150f07116d96fd346e9f54d596751da3e" exitCode=0 Nov 03 20:27:33.324709 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:33.324591 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-wjgb4/progression-invalid-node-0-0-q8bpg" event={"ID":"b60b1fd5-2948-415a-afac-02b4e6950341","Type":"ContainerDied","Data":"ad80b24c42848c5175f825933a1d9dc150f07116d96fd346e9f54d596751da3e"} Nov 03 20:27:33.710138 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:33.710108 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-wjgb4/progression-job-failure-node-0-0-mnvwf"] Nov 03 20:27:33.713517 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:27:33.713483 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11bd8610_bab8_464d_900c_2ed1cd69f950.slice/crio-74e2c45539db579b6100c899fb0126f7e08af7c715c67539752aad204c1ccea8 WatchSource:0}: Error finding container 74e2c45539db579b6100c899fb0126f7e08af7c715c67539752aad204c1ccea8: Status 404 returned error can't find the container with id 74e2c45539db579b6100c899fb0126f7e08af7c715c67539752aad204c1ccea8 Nov 03 20:27:34.331127 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:34.331087 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-wjgb4/progression-job-failure-node-0-0-mnvwf" event={"ID":"11bd8610-bab8-464d-900c-2ed1cd69f950","Type":"ContainerStarted","Data":"bd190c52d808dfc37e6fa5ea2c8dbacb103e9f76c7dbee36126d636c5fdd9dd2"} Nov 03 20:27:34.331590 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:34.331141 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-wjgb4/progression-job-failure-node-0-0-mnvwf" event={"ID":"11bd8610-bab8-464d-900c-2ed1cd69f950","Type":"ContainerStarted","Data":"74e2c45539db579b6100c899fb0126f7e08af7c715c67539752aad204c1ccea8"} Nov 03 20:27:34.448397 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:34.448345 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="rhai-e2e-progression-wjgb4/progression-job-failure-node-0-0-mnvwf" podStartSLOduration=2.448328978 podStartE2EDuration="2.448328978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:27:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:27:34.44711413 +0000 UTC m=+1564.014004279" watchObservedRunningTime="2026-11-03 20:27:34.448328978 +0000 UTC m=+1564.015219195" Nov 03 20:27:34.459747 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:34.459718 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-wjgb4/progression-invalid-node-0-0-q8bpg" Nov 03 20:27:34.512433 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:34.512398 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b60b1fd5-2948-415a-afac-02b4e6950341-kube-api-access-hpndt\" (UniqueName: \"kubernetes.io/projected/b60b1fd5-2948-415a-afac-02b4e6950341-kube-api-access-hpndt\") pod \"b60b1fd5-2948-415a-afac-02b4e6950341\" (UID: \"b60b1fd5-2948-415a-afac-02b4e6950341\") " Nov 03 20:27:34.514706 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:34.514677 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b60b1fd5-2948-415a-afac-02b4e6950341-kube-api-access-hpndt" pod "b60b1fd5-2948-415a-afac-02b4e6950341" (UID: "b60b1fd5-2948-415a-afac-02b4e6950341"). InnerVolumeSpecName "kube-api-access-hpndt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:27:34.613862 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:34.613832 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpndt\" (UniqueName: \"kubernetes.io/projected/b60b1fd5-2948-415a-afac-02b4e6950341-kube-api-access-hpndt\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:27:35.337045 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:35.337018 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-wjgb4/progression-invalid-node-0-0-q8bpg" Nov 03 20:27:35.337428 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:35.337017 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-wjgb4/progression-invalid-node-0-0-q8bpg" event={"ID":"b60b1fd5-2948-415a-afac-02b4e6950341","Type":"ContainerDied","Data":"9a9797137bb4bb93b1b130e76da267f84f772a26db9f4dee3d706840e553ac75"} Nov 03 20:27:35.337428 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:35.337136 5857 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9a9797137bb4bb93b1b130e76da267f84f772a26db9f4dee3d706840e553ac75" Nov 03 20:27:43.384996 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:43.384964 5857 generic.go:356] "Generic (PLEG): container finished" podID="11bd8610-bab8-464d-900c-2ed1cd69f950" containerID="bd190c52d808dfc37e6fa5ea2c8dbacb103e9f76c7dbee36126d636c5fdd9dd2" exitCode=1 Nov 03 20:27:43.385437 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:43.385048 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-wjgb4/progression-job-failure-node-0-0-mnvwf" event={"ID":"11bd8610-bab8-464d-900c-2ed1cd69f950","Type":"ContainerDied","Data":"bd190c52d808dfc37e6fa5ea2c8dbacb103e9f76c7dbee36126d636c5fdd9dd2"} Nov 03 20:27:44.516868 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:44.516837 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-wjgb4/progression-job-failure-node-0-0-mnvwf" Nov 03 20:27:44.600892 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:44.600862 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/11bd8610-bab8-464d-900c-2ed1cd69f950-kube-api-access-949vg\" (UniqueName: \"kubernetes.io/projected/11bd8610-bab8-464d-900c-2ed1cd69f950-kube-api-access-949vg\") pod \"11bd8610-bab8-464d-900c-2ed1cd69f950\" (UID: \"11bd8610-bab8-464d-900c-2ed1cd69f950\") " Nov 03 20:27:44.603018 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:44.602991 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11bd8610-bab8-464d-900c-2ed1cd69f950-kube-api-access-949vg" pod "11bd8610-bab8-464d-900c-2ed1cd69f950" (UID: "11bd8610-bab8-464d-900c-2ed1cd69f950"). InnerVolumeSpecName "kube-api-access-949vg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:27:44.702598 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:44.702539 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-949vg\" (UniqueName: \"kubernetes.io/projected/11bd8610-bab8-464d-900c-2ed1cd69f950-kube-api-access-949vg\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:27:45.397070 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:45.397040 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-wjgb4/progression-job-failure-node-0-0-mnvwf" Nov 03 20:27:45.397070 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:45.397044 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-wjgb4/progression-job-failure-node-0-0-mnvwf" event={"ID":"11bd8610-bab8-464d-900c-2ed1cd69f950","Type":"ContainerDied","Data":"74e2c45539db579b6100c899fb0126f7e08af7c715c67539752aad204c1ccea8"} Nov 03 20:27:45.397326 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:45.397087 5857 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="74e2c45539db579b6100c899fb0126f7e08af7c715c67539752aad204c1ccea8" Nov 03 20:27:48.413724 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:48.413692 5857 generic.go:356] "Generic (PLEG): container finished" podID="72de211a-07ed-423e-bcfe-9b497635fd9d" containerID="27da2cd565c7c95e909fee3053195c69c33cbdde7fc1b0d3f7f82310a2b8662d" exitCode=0 Nov 03 20:27:48.414140 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:48.413737 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-wjgb4/progression-custom-config-node-0-0-c4jsb" event={"ID":"72de211a-07ed-423e-bcfe-9b497635fd9d","Type":"ContainerDied","Data":"27da2cd565c7c95e909fee3053195c69c33cbdde7fc1b0d3f7f82310a2b8662d"} Nov 03 20:27:49.125947 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:49.125915 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-wjgb4/progression-no-metrics-node-0-0-947hg"] Nov 03 20:27:49.126260 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:49.126247 5857 cpu_manager.go:414] "containerMap: removing container" podUID="b60b1fd5-2948-415a-afac-02b4e6950341" containerName="node" Nov 03 20:27:49.126305 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:49.126261 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b60b1fd5-2948-415a-afac-02b4e6950341" containerName="node" Nov 03 20:27:49.126305 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:49.126288 5857 cpu_manager.go:414] "containerMap: removing container" podUID="11bd8610-bab8-464d-900c-2ed1cd69f950" containerName="node" Nov 03 20:27:49.126305 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:49.126293 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="11bd8610-bab8-464d-900c-2ed1cd69f950" containerName="node" Nov 03 20:27:49.126399 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:49.126349 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="11bd8610-bab8-464d-900c-2ed1cd69f950" containerName="node" Nov 03 20:27:49.126399 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:49.126360 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="b60b1fd5-2948-415a-afac-02b4e6950341" containerName="node" Nov 03 20:27:49.128142 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:49.128122 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-wjgb4/progression-no-metrics-node-0-0-947hg" Nov 03 20:27:49.188057 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:49.188022 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-wjgb4/progression-no-metrics-node-0-0-947hg"] Nov 03 20:27:49.239178 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:49.239148 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r2vd\" (UniqueName: \"kubernetes.io/projected/b6c90b3f-a723-4412-8b50-43b3d2c01432-kube-api-access-2r2vd\") pod \"progression-no-metrics-node-0-0-947hg\" (UID: \"b6c90b3f-a723-4412-8b50-43b3d2c01432\") " pod="rhai-e2e-progression-wjgb4/progression-no-metrics-node-0-0-947hg" Nov 03 20:27:49.340416 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:49.340381 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r2vd\" (UniqueName: \"kubernetes.io/projected/b6c90b3f-a723-4412-8b50-43b3d2c01432-kube-api-access-2r2vd\") pod \"progression-no-metrics-node-0-0-947hg\" (UID: \"b6c90b3f-a723-4412-8b50-43b3d2c01432\") " pod="rhai-e2e-progression-wjgb4/progression-no-metrics-node-0-0-947hg" Nov 03 20:27:49.401713 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:49.401648 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r2vd\" (UniqueName: \"kubernetes.io/projected/b6c90b3f-a723-4412-8b50-43b3d2c01432-kube-api-access-2r2vd\") pod \"progression-no-metrics-node-0-0-947hg\" (UID: \"b6c90b3f-a723-4412-8b50-43b3d2c01432\") " pod="rhai-e2e-progression-wjgb4/progression-no-metrics-node-0-0-947hg" Nov 03 20:27:49.439047 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:49.439009 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-wjgb4/progression-no-metrics-node-0-0-947hg" Nov 03 20:27:49.507175 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:27:49.507106 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:27:49.562121 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:49.562093 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-wjgb4/progression-custom-config-node-0-0-c4jsb" Nov 03 20:27:49.643325 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:49.643293 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/72de211a-07ed-423e-bcfe-9b497635fd9d-kube-api-access-jtbpk\" (UniqueName: \"kubernetes.io/projected/72de211a-07ed-423e-bcfe-9b497635fd9d-kube-api-access-jtbpk\") pod \"72de211a-07ed-423e-bcfe-9b497635fd9d\" (UID: \"72de211a-07ed-423e-bcfe-9b497635fd9d\") " Nov 03 20:27:49.645509 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:49.645481 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72de211a-07ed-423e-bcfe-9b497635fd9d-kube-api-access-jtbpk" pod "72de211a-07ed-423e-bcfe-9b497635fd9d" (UID: "72de211a-07ed-423e-bcfe-9b497635fd9d"). InnerVolumeSpecName "kube-api-access-jtbpk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:27:49.744580 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:49.744530 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtbpk\" (UniqueName: \"kubernetes.io/projected/72de211a-07ed-423e-bcfe-9b497635fd9d-kube-api-access-jtbpk\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:27:49.827399 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:49.827372 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-wjgb4/progression-no-metrics-node-0-0-947hg"] Nov 03 20:27:49.829692 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:27:49.829659 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6c90b3f_a723_4412_8b50_43b3d2c01432.slice/crio-b098de9947cbcdcaef7e2b9d7c820d299b882c754f2925409e9b3a1df426f853 WatchSource:0}: Error finding container b098de9947cbcdcaef7e2b9d7c820d299b882c754f2925409e9b3a1df426f853: Status 404 returned error can't find the container with id b098de9947cbcdcaef7e2b9d7c820d299b882c754f2925409e9b3a1df426f853 Nov 03 20:27:50.424759 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:50.424720 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-wjgb4/progression-no-metrics-node-0-0-947hg" event={"ID":"b6c90b3f-a723-4412-8b50-43b3d2c01432","Type":"ContainerStarted","Data":"361597f84214dfab7f7a7cd82c509e0c314b439a1bf696cb320dc4445c7c0cb2"} Nov 03 20:27:50.424942 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:50.424780 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-wjgb4/progression-no-metrics-node-0-0-947hg" event={"ID":"b6c90b3f-a723-4412-8b50-43b3d2c01432","Type":"ContainerStarted","Data":"b098de9947cbcdcaef7e2b9d7c820d299b882c754f2925409e9b3a1df426f853"} Nov 03 20:27:50.426133 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:50.426110 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-wjgb4/progression-custom-config-node-0-0-c4jsb" Nov 03 20:27:50.426133 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:50.426123 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-wjgb4/progression-custom-config-node-0-0-c4jsb" event={"ID":"72de211a-07ed-423e-bcfe-9b497635fd9d","Type":"ContainerDied","Data":"ccf210287a91313fc96af5b98113107f4831d82831cf78f93cb76cb8549020de"} Nov 03 20:27:50.426331 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:50.426161 5857 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ccf210287a91313fc96af5b98113107f4831d82831cf78f93cb76cb8549020de" Nov 03 20:27:50.542709 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:50.542657 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="rhai-e2e-progression-wjgb4/progression-no-metrics-node-0-0-947hg" podStartSLOduration=1.5426430660000001 podStartE2EDuration="1.542643066s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:27:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:27:50.541643069 +0000 UTC m=+1580.108533220" watchObservedRunningTime="2026-11-03 20:27:50.542643066 +0000 UTC m=+1580.109533214" Nov 03 20:27:55.453704 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:55.453670 5857 generic.go:356] "Generic (PLEG): container finished" podID="b6c90b3f-a723-4412-8b50-43b3d2c01432" containerID="361597f84214dfab7f7a7cd82c509e0c314b439a1bf696cb320dc4445c7c0cb2" exitCode=0 Nov 03 20:27:55.454088 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:55.453746 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-wjgb4/progression-no-metrics-node-0-0-947hg" event={"ID":"b6c90b3f-a723-4412-8b50-43b3d2c01432","Type":"ContainerDied","Data":"361597f84214dfab7f7a7cd82c509e0c314b439a1bf696cb320dc4445c7c0cb2"} Nov 03 20:27:56.588804 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:56.588780 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-wjgb4/progression-no-metrics-node-0-0-947hg" Nov 03 20:27:56.706799 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:56.706773 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b6c90b3f-a723-4412-8b50-43b3d2c01432-kube-api-access-2r2vd\" (UniqueName: \"kubernetes.io/projected/b6c90b3f-a723-4412-8b50-43b3d2c01432-kube-api-access-2r2vd\") pod \"b6c90b3f-a723-4412-8b50-43b3d2c01432\" (UID: \"b6c90b3f-a723-4412-8b50-43b3d2c01432\") " Nov 03 20:27:56.709007 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:56.708945 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6c90b3f-a723-4412-8b50-43b3d2c01432-kube-api-access-2r2vd" pod "b6c90b3f-a723-4412-8b50-43b3d2c01432" (UID: "b6c90b3f-a723-4412-8b50-43b3d2c01432"). InnerVolumeSpecName "kube-api-access-2r2vd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:27:56.807548 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:56.807514 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2r2vd\" (UniqueName: \"kubernetes.io/projected/b6c90b3f-a723-4412-8b50-43b3d2c01432-kube-api-access-2r2vd\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:27:57.464312 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:57.464275 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-wjgb4/progression-no-metrics-node-0-0-947hg" event={"ID":"b6c90b3f-a723-4412-8b50-43b3d2c01432","Type":"ContainerDied","Data":"b098de9947cbcdcaef7e2b9d7c820d299b882c754f2925409e9b3a1df426f853"} Nov 03 20:27:57.464312 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:57.464314 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-wjgb4/progression-no-metrics-node-0-0-947hg" Nov 03 20:27:57.464521 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:27:57.464330 5857 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b098de9947cbcdcaef7e2b9d7c820d299b882c754f2925409e9b3a1df426f853" Nov 03 20:28:04.490013 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:28:04.489980 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-wjgb4/progression-custom-config-node-0-0-c4jsb"] Nov 03 20:28:04.539625 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:28:04.539586 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-wjgb4/progression-custom-config-node-0-0-c4jsb"] Nov 03 20:28:04.541034 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:28:04.541008 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-wjgb4/progression-disabled-node-0-0-mr6cj"] Nov 03 20:28:04.572509 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:28:04.572480 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="72de211a-07ed-423e-bcfe-9b497635fd9d" path="/var/lib/kubelet/pods/72de211a-07ed-423e-bcfe-9b497635fd9d/volumes" Nov 03 20:28:04.589315 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:28:04.589290 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-wjgb4/progression-disabled-node-0-0-mr6cj"] Nov 03 20:28:04.590914 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:28:04.590865 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-wjgb4/progression-enabled-node-0-0-whcb9"] Nov 03 20:28:04.591911 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:28:04.591896 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-wjgb4/progression-enabled-node-0-0-whcb9"] Nov 03 20:28:04.592930 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:28:04.592910 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-wjgb4/progression-invalid-node-0-0-q8bpg"] Nov 03 20:28:04.601480 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:28:04.601458 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-wjgb4/progression-invalid-node-0-0-q8bpg"] Nov 03 20:28:04.602419 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:28:04.602403 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-wjgb4/progression-job-failure-node-0-0-mnvwf"] Nov 03 20:28:04.638590 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:28:04.638540 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-wjgb4/progression-job-failure-node-0-0-mnvwf"] Nov 03 20:28:04.639496 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:28:04.639484 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-wjgb4/progression-no-metrics-node-0-0-947hg"] Nov 03 20:28:04.640376 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:28:04.640358 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-wjgb4/progression-no-metrics-node-0-0-947hg"] Nov 03 20:28:06.572349 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:28:06.572317 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="11bd8610-bab8-464d-900c-2ed1cd69f950" path="/var/lib/kubelet/pods/11bd8610-bab8-464d-900c-2ed1cd69f950/volumes" Nov 03 20:28:06.572740 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:28:06.572639 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1fee5df0-90d4-457f-b3e3-9d5a44182212" path="/var/lib/kubelet/pods/1fee5df0-90d4-457f-b3e3-9d5a44182212/volumes" Nov 03 20:28:06.572914 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:28:06.572902 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b60b1fd5-2948-415a-afac-02b4e6950341" path="/var/lib/kubelet/pods/b60b1fd5-2948-415a-afac-02b4e6950341/volumes" Nov 03 20:28:06.573169 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:28:06.573158 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b6c90b3f-a723-4412-8b50-43b3d2c01432" path="/var/lib/kubelet/pods/b6c90b3f-a723-4412-8b50-43b3d2c01432/volumes" Nov 03 20:28:06.573777 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:28:06.573762 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d614379a-fcd5-421c-a575-6d474e7c1b5b" path="/var/lib/kubelet/pods/d614379a-fcd5-421c-a575-6d474e7c1b5b/volumes" Nov 03 20:28:19.499465 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:28:19.499427 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:28:49.499052 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:28:49.498970 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:29:09.517791 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:09.517756 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-hscb7/test-trainjob-bfmh4-node-0-0-l7frq"] Nov 03 20:29:09.518407 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:09.518249 5857 cpu_manager.go:414] "containerMap: removing container" podUID="72de211a-07ed-423e-bcfe-9b497635fd9d" containerName="node" Nov 03 20:29:09.518407 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:09.518269 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="72de211a-07ed-423e-bcfe-9b497635fd9d" containerName="node" Nov 03 20:29:09.518407 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:09.518297 5857 cpu_manager.go:414] "containerMap: removing container" podUID="b6c90b3f-a723-4412-8b50-43b3d2c01432" containerName="node" Nov 03 20:29:09.518407 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:09.518305 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b6c90b3f-a723-4412-8b50-43b3d2c01432" containerName="node" Nov 03 20:29:09.518407 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:09.518403 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="72de211a-07ed-423e-bcfe-9b497635fd9d" containerName="node" Nov 03 20:29:09.518714 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:09.518416 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="b6c90b3f-a723-4412-8b50-43b3d2c01432" containerName="node" Nov 03 20:29:09.521539 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:09.521519 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-hscb7/test-trainjob-bfmh4-node-0-0-l7frq" Nov 03 20:29:09.573480 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:09.573453 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-hscb7\"/\"openshift-service-ca.crt\"" Nov 03 20:29:09.622890 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:09.622850 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-hscb7\"/\"kube-root-ca.crt\"" Nov 03 20:29:09.623095 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:09.622915 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-hscb7\"/\"default-dockercfg-7pt27\"" Nov 03 20:29:09.624248 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:09.624224 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-hscb7/test-trainjob-bfmh4-node-0-0-l7frq"] Nov 03 20:29:09.628256 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:09.628236 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ttjz\" (UniqueName: \"kubernetes.io/projected/e60f6e33-bebe-4815-a203-b82151254028-kube-api-access-2ttjz\") pod \"test-trainjob-bfmh4-node-0-0-l7frq\" (UID: \"e60f6e33-bebe-4815-a203-b82151254028\") " pod="test-ns-hscb7/test-trainjob-bfmh4-node-0-0-l7frq" Nov 03 20:29:09.729153 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:09.729124 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ttjz\" (UniqueName: \"kubernetes.io/projected/e60f6e33-bebe-4815-a203-b82151254028-kube-api-access-2ttjz\") pod \"test-trainjob-bfmh4-node-0-0-l7frq\" (UID: \"e60f6e33-bebe-4815-a203-b82151254028\") " pod="test-ns-hscb7/test-trainjob-bfmh4-node-0-0-l7frq" Nov 03 20:29:09.789745 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:09.789676 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ttjz\" (UniqueName: \"kubernetes.io/projected/e60f6e33-bebe-4815-a203-b82151254028-kube-api-access-2ttjz\") pod \"test-trainjob-bfmh4-node-0-0-l7frq\" (UID: \"e60f6e33-bebe-4815-a203-b82151254028\") " pod="test-ns-hscb7/test-trainjob-bfmh4-node-0-0-l7frq" Nov 03 20:29:09.832954 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:09.832931 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-hscb7/test-trainjob-bfmh4-node-0-0-l7frq" Nov 03 20:29:10.209627 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:10.209454 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-hscb7/test-trainjob-bfmh4-node-0-0-l7frq"] Nov 03 20:29:10.212478 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:29:10.212442 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode60f6e33_bebe_4815_a203_b82151254028.slice/crio-97fa1b332edbb3f3e48b1dc181bcb09a1f9aa8c4e2021e90a64bdb75ad693585 WatchSource:0}: Error finding container 97fa1b332edbb3f3e48b1dc181bcb09a1f9aa8c4e2021e90a64bdb75ad693585: Status 404 returned error can't find the container with id 97fa1b332edbb3f3e48b1dc181bcb09a1f9aa8c4e2021e90a64bdb75ad693585 Nov 03 20:29:10.837467 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:10.837433 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-hscb7/test-trainjob-bfmh4-node-0-0-l7frq" event={"ID":"e60f6e33-bebe-4815-a203-b82151254028","Type":"ContainerStarted","Data":"4cf9471e36bbd6dd616bd721c8355a47195c9ba2bb5517fdd22190495205e238"} Nov 03 20:29:10.837881 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:10.837475 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-hscb7/test-trainjob-bfmh4-node-0-0-l7frq" event={"ID":"e60f6e33-bebe-4815-a203-b82151254028","Type":"ContainerStarted","Data":"97fa1b332edbb3f3e48b1dc181bcb09a1f9aa8c4e2021e90a64bdb75ad693585"} Nov 03 20:29:10.953433 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:10.953376 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-hscb7/test-trainjob-bfmh4-node-0-0-l7frq" podStartSLOduration=1.953362261 podStartE2EDuration="1.953362261s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:29:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:29:10.952117602 +0000 UTC m=+1660.519007755" watchObservedRunningTime="2026-11-03 20:29:10.953362261 +0000 UTC m=+1660.520252403" Nov 03 20:29:12.137332 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:12.137306 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:29:14.995248 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:14.995214 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:29:17.883971 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:17.883937 5857 generic.go:356] "Generic (PLEG): container finished" podID="e60f6e33-bebe-4815-a203-b82151254028" containerID="4cf9471e36bbd6dd616bd721c8355a47195c9ba2bb5517fdd22190495205e238" exitCode=0 Nov 03 20:29:17.884399 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:17.883990 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-hscb7/test-trainjob-bfmh4-node-0-0-l7frq" event={"ID":"e60f6e33-bebe-4815-a203-b82151254028","Type":"ContainerDied","Data":"4cf9471e36bbd6dd616bd721c8355a47195c9ba2bb5517fdd22190495205e238"} Nov 03 20:29:17.952243 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:17.952216 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:29:19.026521 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:19.026496 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-hscb7/test-trainjob-bfmh4-node-0-0-l7frq" Nov 03 20:29:19.104898 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:19.104867 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e60f6e33-bebe-4815-a203-b82151254028-kube-api-access-2ttjz\" (UniqueName: \"kubernetes.io/projected/e60f6e33-bebe-4815-a203-b82151254028-kube-api-access-2ttjz\") pod \"e60f6e33-bebe-4815-a203-b82151254028\" (UID: \"e60f6e33-bebe-4815-a203-b82151254028\") " Nov 03 20:29:19.107112 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:19.107090 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e60f6e33-bebe-4815-a203-b82151254028-kube-api-access-2ttjz" pod "e60f6e33-bebe-4815-a203-b82151254028" (UID: "e60f6e33-bebe-4815-a203-b82151254028"). InnerVolumeSpecName "kube-api-access-2ttjz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:29:19.205624 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:19.205596 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ttjz\" (UniqueName: \"kubernetes.io/projected/e60f6e33-bebe-4815-a203-b82151254028-kube-api-access-2ttjz\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:29:19.498752 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:29:19.498662 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:29:19.896624 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:19.896528 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-hscb7/test-trainjob-bfmh4-node-0-0-l7frq" Nov 03 20:29:19.896624 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:19.896579 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-hscb7/test-trainjob-bfmh4-node-0-0-l7frq" event={"ID":"e60f6e33-bebe-4815-a203-b82151254028","Type":"ContainerDied","Data":"97fa1b332edbb3f3e48b1dc181bcb09a1f9aa8c4e2021e90a64bdb75ad693585"} Nov 03 20:29:19.896624 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:19.896617 5857 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="97fa1b332edbb3f3e48b1dc181bcb09a1f9aa8c4e2021e90a64bdb75ad693585" Nov 03 20:29:20.953467 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:20.953435 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:29:21.907968 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:21.907933 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-s28bb/test-trainjob-4z547-node-0-0-xlzwh"] Nov 03 20:29:21.908301 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:21.908289 5857 cpu_manager.go:414] "containerMap: removing container" podUID="e60f6e33-bebe-4815-a203-b82151254028" containerName="node" Nov 03 20:29:21.908342 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:21.908303 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e60f6e33-bebe-4815-a203-b82151254028" containerName="node" Nov 03 20:29:21.908415 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:21.908406 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="e60f6e33-bebe-4815-a203-b82151254028" containerName="node" Nov 03 20:29:21.911457 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:21.911441 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-s28bb/test-trainjob-4z547-node-0-0-xlzwh" Nov 03 20:29:22.013074 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:22.013037 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-s28bb\"/\"openshift-service-ca.crt\"" Nov 03 20:29:22.013477 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:22.013098 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-s28bb\"/\"kube-root-ca.crt\"" Nov 03 20:29:22.013477 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:22.013153 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-s28bb\"/\"default-dockercfg-jgrfl\"" Nov 03 20:29:22.014500 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:22.014478 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-s28bb/test-trainjob-4z547-node-0-0-xlzwh"] Nov 03 20:29:22.030781 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:22.030747 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hff8d\" (UniqueName: \"kubernetes.io/projected/f5c4148f-521c-4b36-9a11-de64a2bd47b4-kube-api-access-hff8d\") pod \"test-trainjob-4z547-node-0-0-xlzwh\" (UID: \"f5c4148f-521c-4b36-9a11-de64a2bd47b4\") " pod="test-ns-s28bb/test-trainjob-4z547-node-0-0-xlzwh" Nov 03 20:29:22.131237 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:22.131204 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hff8d\" (UniqueName: \"kubernetes.io/projected/f5c4148f-521c-4b36-9a11-de64a2bd47b4-kube-api-access-hff8d\") pod \"test-trainjob-4z547-node-0-0-xlzwh\" (UID: \"f5c4148f-521c-4b36-9a11-de64a2bd47b4\") " pod="test-ns-s28bb/test-trainjob-4z547-node-0-0-xlzwh" Nov 03 20:29:22.192336 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:22.192260 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hff8d\" (UniqueName: \"kubernetes.io/projected/f5c4148f-521c-4b36-9a11-de64a2bd47b4-kube-api-access-hff8d\") pod \"test-trainjob-4z547-node-0-0-xlzwh\" (UID: \"f5c4148f-521c-4b36-9a11-de64a2bd47b4\") " pod="test-ns-s28bb/test-trainjob-4z547-node-0-0-xlzwh" Nov 03 20:29:22.223224 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:22.223196 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-s28bb/test-trainjob-4z547-node-0-0-xlzwh" Nov 03 20:29:22.596508 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:22.596484 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-s28bb/test-trainjob-4z547-node-0-0-xlzwh"] Nov 03 20:29:22.598961 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:29:22.598934 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf5c4148f_521c_4b36_9a11_de64a2bd47b4.slice/crio-880ad8db6942e1e4422e47b76f302f6043489eaeada254806ac3c507f090c8d7 WatchSource:0}: Error finding container 880ad8db6942e1e4422e47b76f302f6043489eaeada254806ac3c507f090c8d7: Status 404 returned error can't find the container with id 880ad8db6942e1e4422e47b76f302f6043489eaeada254806ac3c507f090c8d7 Nov 03 20:29:22.600933 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:22.600917 5857 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 03 20:29:22.913764 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:22.913675 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-s28bb/test-trainjob-4z547-node-0-0-xlzwh" event={"ID":"f5c4148f-521c-4b36-9a11-de64a2bd47b4","Type":"ContainerStarted","Data":"880ad8db6942e1e4422e47b76f302f6043489eaeada254806ac3c507f090c8d7"} Nov 03 20:29:23.952760 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:23.952723 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:29:26.953723 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:26.953618 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:29:29.953134 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:29.953104 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:29:30.841679 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:30.841509 5857 scope.go:122] "RemoveContainer" containerID="cfbde3310566b7f752c698faf4d205a39f8351da2b2cc1e464154ff198398f77" Nov 03 20:29:32.953060 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:32.952991 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:29:35.952804 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:35.952712 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:29:38.952415 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:38.952384 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:29:41.953344 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:41.953314 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:29:44.953191 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:44.953145 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:29:47.952389 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:47.952364 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:29:49.501158 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:29:49.501126 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:29:50.952579 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:50.952531 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:29:53.952637 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:53.952604 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:29:56.952572 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:56.952530 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:29:59.952946 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:29:59.952919 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:30:02.956339 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:30:02.956291 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:30:05.952740 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:30:05.952700 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:30:08.952271 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:30:08.952172 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:30:11.952451 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:30:11.952420 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:30:14.956748 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:30:14.956721 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:30:17.953135 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:30:17.953103 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:30:19.499984 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:30:19.499949 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:30:20.952638 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:30:20.952601 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:30:23.952363 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:30:23.952336 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:30:26.952253 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:30:26.952219 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:30:29.952370 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:30:29.952334 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:30:30.881864 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:30:30.881837 5857 scope.go:122] "RemoveContainer" containerID="224059b6df23b04d68b0be882e949cc20f4b3f6af4128ff15c895ad94003690c" Nov 03 20:30:30.891226 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:30:30.891173 5857 scope.go:122] "RemoveContainer" containerID="a277abd13d146dce2017b86aae8fb68845acd18283cdd1a1d0545f8f4b4ea5d0" Nov 03 20:30:30.901239 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:30:30.901216 5857 scope.go:122] "RemoveContainer" containerID="22948c79366601cbc381e787d6effd6b135856d0959dbaa7740e359d3119f719" Nov 03 20:30:32.953485 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:30:32.953421 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:30:35.953028 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:30:35.953001 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:30:38.953329 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:30:38.953295 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:30:41.952993 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:30:41.952962 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:30:44.951769 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:30:44.951738 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:30:47.952496 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:30:47.952458 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:30:49.502062 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:30:49.502026 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:30:50.953024 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:30:50.952994 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:30:53.953054 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:30:53.953023 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:30:56.952438 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:30:56.952410 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:30:59.951929 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:30:59.951849 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:31:02.952848 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:31:02.952822 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:31:05.952762 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:31:05.952729 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:31:08.957378 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:31:08.957312 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:31:11.952616 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:31:11.952586 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:31:14.952521 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:31:14.952492 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:31:17.953373 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:31:17.953341 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:31:19.499736 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:31:19.499701 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:31:20.952815 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:31:20.952785 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:31:23.952444 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:31:23.952410 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:31:26.952510 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:31:26.952482 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:31:29.952087 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:31:29.952056 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:31:32.953041 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:31:32.953009 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:31:35.952577 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:31:35.952526 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:31:38.953048 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:31:38.952950 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:31:41.952679 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:31:41.952637 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:31:44.961735 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:31:44.961701 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:31:47.952037 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:31:47.952008 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:31:49.502005 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:31:49.501966 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:31:50.952216 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:31:50.952186 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:31:53.951858 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:31:53.951829 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:31:56.958497 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:31:56.958444 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:31:59.952680 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:31:59.952625 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:32:02.952666 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:32:02.952621 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:32:05.952620 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:32:05.952542 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:32:08.952351 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:32:08.952324 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:32:11.952862 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:32:11.952834 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:32:14.953234 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:32:14.953199 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:32:17.953633 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:32:17.953595 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:32:19.501228 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:32:19.501191 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:32:20.952408 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:32:20.952376 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:32:23.952326 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:32:23.952298 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:32:26.952482 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:32:26.952403 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:32:29.951986 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:32:29.951960 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:32:30.935499 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:32:30.935473 5857 scope.go:122] "RemoveContainer" containerID="86b12ccb210b0490e067bf3faa6c2230e486447c573d8e0ea65ea0bf37eb1fd0" Nov 03 20:32:32.953828 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:32:32.953795 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:32:35.952705 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:32:35.952672 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:32:38.952732 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:32:38.952702 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:32:41.952400 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:32:41.952372 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:32:44.952117 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:32:44.952080 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:32:47.952259 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:32:47.952226 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:32:49.499770 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:32:49.499729 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:32:50.952658 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:32:50.952629 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:32:53.952637 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:32:53.952609 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:32:56.952179 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:32:56.952152 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:32:59.952950 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:32:59.952919 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:33:02.952507 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:33:02.952476 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:33:05.952471 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:33:05.952442 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:33:08.952539 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:33:08.952450 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:33:11.952973 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:33:11.952947 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:33:14.952139 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:33:14.952107 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:33:17.952080 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:33:17.952052 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:33:19.501497 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:33:19.501449 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:33:20.952615 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:33:20.952589 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:33:23.953016 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:33:23.952980 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:33:26.953228 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:33:26.953192 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:33:29.956857 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:33:29.956824 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:33:30.956485 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:33:30.956452 5857 scope.go:122] "RemoveContainer" containerID="27da2cd565c7c95e909fee3053195c69c33cbdde7fc1b0d3f7f82310a2b8662d" Nov 03 20:33:30.967638 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:33:30.967618 5857 scope.go:122] "RemoveContainer" containerID="ad80b24c42848c5175f825933a1d9dc150f07116d96fd346e9f54d596751da3e" Nov 03 20:33:30.975949 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:33:30.975929 5857 scope.go:122] "RemoveContainer" containerID="600273e5ab9febf0fa6c72bbf5c71593d9675d5b775bbfcce6d8bb8b1eb9d331" Nov 03 20:33:32.953087 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:33:32.953053 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:33:35.952864 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:33:35.952835 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:33:38.952881 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:33:38.952849 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:33:41.952350 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:33:41.952318 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:33:44.953224 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:33:44.953188 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:33:47.955796 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:33:47.955735 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:33:49.501275 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:33:49.501232 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:33:50.952910 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:33:50.952881 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:33:53.958349 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:33:53.958306 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:33:56.952610 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:33:56.952578 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:33:59.952697 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:33:59.952664 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:34:02.952207 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:34:02.952177 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:34:05.953118 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:34:05.953086 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:34:08.952213 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:34:08.952173 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:34:11.952398 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:34:11.952364 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:34:14.953099 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:34:14.953072 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:34:17.951805 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:34:17.951766 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:34:19.499319 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:34:19.499283 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:34:20.953881 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:34:20.953855 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:34:23.952816 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:34:23.952778 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:34:26.952797 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:34:26.952765 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:34:29.951544 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:34:29.951487 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:34:31.004612 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:34:31.004580 5857 scope.go:122] "RemoveContainer" containerID="bd190c52d808dfc37e6fa5ea2c8dbacb103e9f76c7dbee36126d636c5fdd9dd2" Nov 03 20:34:31.014306 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:34:31.014285 5857 scope.go:122] "RemoveContainer" containerID="361597f84214dfab7f7a7cd82c509e0c314b439a1bf696cb320dc4445c7c0cb2" Nov 03 20:34:32.952686 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:34:32.952657 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:34:35.953264 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:34:35.953234 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:34:38.952466 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:34:38.952393 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:34:41.952205 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:34:41.952175 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:34:44.952081 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:34:44.952045 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:34:47.952470 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:34:47.952444 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:34:49.500529 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:34:49.500493 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:34:50.953057 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:34:50.953022 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:34:53.954186 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:34:53.954153 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:34:56.952839 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:34:56.952812 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:34:59.951625 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:34:59.951595 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:35:02.952495 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:35:02.952465 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:35:05.952646 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:35:05.952610 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:35:08.953052 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:35:08.952928 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:35:11.952888 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:35:11.952861 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:35:14.952631 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:35:14.952598 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:35:17.954226 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:35:17.954194 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:35:19.498379 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:35:19.498338 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:35:20.952346 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:35:20.952319 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:35:23.952837 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:35:23.952802 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:35:26.952678 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:35:26.952644 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:35:29.952935 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:35:29.952898 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:35:32.964425 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:35:32.964391 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:35:35.952307 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:35:35.952267 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:35:38.953629 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:35:38.953519 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:35:41.955087 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:35:41.955053 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:35:44.952342 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:35:44.952274 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:35:47.952050 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:35:47.952023 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:35:49.504632 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:35:49.504594 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:35:50.953893 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:35:50.953775 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:35:53.952580 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:35:53.952530 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:35:56.952454 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:35:56.952422 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:35:59.952575 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:35:59.952539 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:36:02.953480 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:36:02.953434 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:36:05.952062 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:36:05.951993 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:36:08.952315 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:36:08.952236 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:36:11.952708 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:36:11.952678 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:36:14.951957 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:36:14.951920 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:36:17.952617 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:36:17.952585 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:36:19.502778 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:36:19.502737 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:36:20.952725 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:36:20.952695 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:36:23.952445 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:36:23.952402 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:36:26.954995 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:36:26.954968 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:36:29.952692 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:36:29.952664 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:36:32.952764 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:36:32.952732 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:36:35.951916 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:36:35.951888 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:36:38.958833 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:36:38.958794 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:36:41.952773 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:36:41.952741 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:36:44.953269 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:36:44.953233 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:36:47.952176 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:36:47.952137 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:36:49.502941 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:36:49.502900 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:36:50.952178 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:36:50.952143 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:36:53.952224 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:36:53.952196 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:36:56.952429 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:36:56.952402 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:36:59.952460 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:36:59.952398 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:37:02.952166 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:37:02.952138 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:37:05.952692 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:37:05.952651 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:37:08.952463 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:37:08.952423 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:37:11.951941 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:37:11.951910 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:37:14.951865 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:37:14.951829 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:37:17.953034 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:37:17.952979 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:37:19.500890 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:37:19.500858 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:37:20.952974 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:37:20.952943 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:37:23.952245 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:37:23.952216 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:37:26.952662 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:37:26.952614 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:37:29.951961 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:37:29.951930 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:37:32.953096 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:37:32.953066 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:37:35.952136 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:37:35.952102 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:37:38.954620 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:37:38.954518 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:37:41.952333 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:37:41.952275 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:37:44.952886 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:37:44.952850 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:37:47.952820 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:37:47.952782 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:37:49.502217 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:37:49.502171 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:37:50.952489 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:37:50.952451 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:37:53.952735 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:37:53.952701 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:37:56.952789 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:37:56.952757 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:37:59.952945 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:37:59.952912 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:38:02.952513 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:02.952451 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:38:05.952765 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:05.952739 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:38:08.953839 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:08.953811 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:38:11.952407 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:11.952365 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:38:14.951823 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:14.951786 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:38:17.952858 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:17.952829 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:38:19.501112 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:38:19.501079 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:38:20.953237 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:20.953211 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:38:23.953205 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:23.953134 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:38:26.952720 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:26.952662 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:38:29.952935 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:29.952897 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:38:32.952668 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:32.952643 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:38:35.952203 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:35.952173 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:38:38.958409 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:38.958370 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:38:41.959630 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:41.959555 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:38:44.952030 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:44.951999 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:38:47.951808 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:47.951776 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:38:48.908009 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:48.907976 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-s28bb/test-trainjob-4z547-node-0-0-xlzwh" event={"ID":"f5c4148f-521c-4b36-9a11-de64a2bd47b4","Type":"ContainerStarted","Data":"331334e9ffb3c57e31a6d9b9fb7f019c9541139009f1f3525963129e1a3dcc97"} Nov 03 20:38:48.959244 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:48.959212 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-s28bb\"/\"default-dockercfg-jgrfl\"" Nov 03 20:38:49.082336 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:49.082301 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-s28bb\"/\"kube-root-ca.crt\"" Nov 03 20:38:49.083720 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:49.083664 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-s28bb/test-trainjob-4z547-node-0-0-xlzwh" podStartSLOduration=2.238207265 podStartE2EDuration="9m28.083648822s" totalImagesPullingTime="9m25.845441557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:29:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:38:49.082866199 +0000 UTC m=+2238.649756347" watchObservedRunningTime="2026-11-03 20:38:49.083648822 +0000 UTC m=+2238.650539016" Nov 03 20:38:49.142958 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:49.142926 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-s28bb\"/\"openshift-service-ca.crt\"" Nov 03 20:38:49.499641 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:38:49.499598 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:38:50.952018 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:50.951989 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:38:51.334882 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:51.334789 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s28bb_test-trainjob-4z547-node-0-0-xlzwh_f5c4148f-521c-4b36-9a11-de64a2bd47b4/node/0.log" Nov 03 20:38:53.952016 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:53.951980 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:38:54.335468 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:54.335376 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s28bb_test-trainjob-4z547-node-0-0-xlzwh_f5c4148f-521c-4b36-9a11-de64a2bd47b4/node/0.log" Nov 03 20:38:54.945039 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:54.945004 5857 generic.go:356] "Generic (PLEG): container finished" podID="f5c4148f-521c-4b36-9a11-de64a2bd47b4" containerID="331334e9ffb3c57e31a6d9b9fb7f019c9541139009f1f3525963129e1a3dcc97" exitCode=0 Nov 03 20:38:54.945201 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:54.945063 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-s28bb/test-trainjob-4z547-node-0-0-xlzwh" event={"ID":"f5c4148f-521c-4b36-9a11-de64a2bd47b4","Type":"ContainerDied","Data":"331334e9ffb3c57e31a6d9b9fb7f019c9541139009f1f3525963129e1a3dcc97"} Nov 03 20:38:56.122025 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:56.122001 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-s28bb/test-trainjob-4z547-node-0-0-xlzwh" Nov 03 20:38:56.196811 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:56.196778 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f5c4148f-521c-4b36-9a11-de64a2bd47b4-kube-api-access-hff8d\" (UniqueName: \"kubernetes.io/projected/f5c4148f-521c-4b36-9a11-de64a2bd47b4-kube-api-access-hff8d\") pod \"f5c4148f-521c-4b36-9a11-de64a2bd47b4\" (UID: \"f5c4148f-521c-4b36-9a11-de64a2bd47b4\") " Nov 03 20:38:56.198974 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:56.198948 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5c4148f-521c-4b36-9a11-de64a2bd47b4-kube-api-access-hff8d" pod "f5c4148f-521c-4b36-9a11-de64a2bd47b4" (UID: "f5c4148f-521c-4b36-9a11-de64a2bd47b4"). InnerVolumeSpecName "kube-api-access-hff8d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:38:56.297600 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:56.297545 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hff8d\" (UniqueName: \"kubernetes.io/projected/f5c4148f-521c-4b36-9a11-de64a2bd47b4-kube-api-access-hff8d\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:38:56.952347 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:56.952320 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:38:56.955929 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:56.955910 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-s28bb/test-trainjob-4z547-node-0-0-xlzwh" Nov 03 20:38:56.955929 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:56.955919 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-s28bb/test-trainjob-4z547-node-0-0-xlzwh" event={"ID":"f5c4148f-521c-4b36-9a11-de64a2bd47b4","Type":"ContainerDied","Data":"880ad8db6942e1e4422e47b76f302f6043489eaeada254806ac3c507f090c8d7"} Nov 03 20:38:56.956080 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:56.955948 5857 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="880ad8db6942e1e4422e47b76f302f6043489eaeada254806ac3c507f090c8d7" Nov 03 20:38:57.335542 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:57.335463 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s28bb_test-trainjob-4z547-node-0-0-xlzwh_f5c4148f-521c-4b36-9a11-de64a2bd47b4/node/0.log" Nov 03 20:38:59.337552 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:59.337520 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-4zw8h/test-trainjob-9bbgj-node-0-0-89dg4"] Nov 03 20:38:59.337916 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:59.337876 5857 cpu_manager.go:414] "containerMap: removing container" podUID="f5c4148f-521c-4b36-9a11-de64a2bd47b4" containerName="node" Nov 03 20:38:59.337916 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:59.337886 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f5c4148f-521c-4b36-9a11-de64a2bd47b4" containerName="node" Nov 03 20:38:59.337988 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:59.337961 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="f5c4148f-521c-4b36-9a11-de64a2bd47b4" containerName="node" Nov 03 20:38:59.607393 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:59.607314 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-4zw8h/test-trainjob-9bbgj-node-0-0-89dg4"] Nov 03 20:38:59.607538 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:59.607458 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-4zw8h/test-trainjob-9bbgj-node-0-0-89dg4" Nov 03 20:38:59.628511 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:59.628483 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj9n2\" (UniqueName: \"kubernetes.io/projected/ad2bd674-05e5-42f2-8096-c1581fc84a5e-kube-api-access-xj9n2\") pod \"test-trainjob-9bbgj-node-0-0-89dg4\" (UID: \"ad2bd674-05e5-42f2-8096-c1581fc84a5e\") " pod="test-ns-4zw8h/test-trainjob-9bbgj-node-0-0-89dg4" Nov 03 20:38:59.659806 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:59.659780 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-4zw8h\"/\"openshift-service-ca.crt\"" Nov 03 20:38:59.709207 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:59.709170 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-4zw8h\"/\"kube-root-ca.crt\"" Nov 03 20:38:59.709207 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:59.709170 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-4zw8h\"/\"default-dockercfg-5nrn9\"" Nov 03 20:38:59.729258 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:59.729228 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj9n2\" (UniqueName: \"kubernetes.io/projected/ad2bd674-05e5-42f2-8096-c1581fc84a5e-kube-api-access-xj9n2\") pod \"test-trainjob-9bbgj-node-0-0-89dg4\" (UID: \"ad2bd674-05e5-42f2-8096-c1581fc84a5e\") " pod="test-ns-4zw8h/test-trainjob-9bbgj-node-0-0-89dg4" Nov 03 20:38:59.790278 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:59.790243 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj9n2\" (UniqueName: \"kubernetes.io/projected/ad2bd674-05e5-42f2-8096-c1581fc84a5e-kube-api-access-xj9n2\") pod \"test-trainjob-9bbgj-node-0-0-89dg4\" (UID: \"ad2bd674-05e5-42f2-8096-c1581fc84a5e\") " pod="test-ns-4zw8h/test-trainjob-9bbgj-node-0-0-89dg4" Nov 03 20:38:59.941286 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:59.941213 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-4zw8h/test-trainjob-9bbgj-node-0-0-89dg4" Nov 03 20:38:59.952228 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:38:59.952202 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:39:00.337025 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:00.336994 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s28bb_test-trainjob-4z547-node-0-0-xlzwh_f5c4148f-521c-4b36-9a11-de64a2bd47b4/node/0.log" Nov 03 20:39:00.339092 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:00.339066 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-4zw8h/test-trainjob-9bbgj-node-0-0-89dg4"] Nov 03 20:39:00.342486 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:39:00.342463 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad2bd674_05e5_42f2_8096_c1581fc84a5e.slice/crio-16b4d63365553711418a64b0d243a42cd92581047e5ad16c16f19b888efdb76a WatchSource:0}: Error finding container 16b4d63365553711418a64b0d243a42cd92581047e5ad16c16f19b888efdb76a: Status 404 returned error can't find the container with id 16b4d63365553711418a64b0d243a42cd92581047e5ad16c16f19b888efdb76a Nov 03 20:39:00.976143 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:00.976105 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-4zw8h/test-trainjob-9bbgj-node-0-0-89dg4" event={"ID":"ad2bd674-05e5-42f2-8096-c1581fc84a5e","Type":"ContainerStarted","Data":"b8240833c3a76dff67acafa3958f5880ebb8c3174b89efda91d4abdc37b71535"} Nov 03 20:39:00.976143 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:00.976144 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-4zw8h/test-trainjob-9bbgj-node-0-0-89dg4" event={"ID":"ad2bd674-05e5-42f2-8096-c1581fc84a5e","Type":"ContainerStarted","Data":"16b4d63365553711418a64b0d243a42cd92581047e5ad16c16f19b888efdb76a"} Nov 03 20:39:01.040032 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:01.040005 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-4zw8h_test-trainjob-9bbgj-node-0-0-89dg4_ad2bd674-05e5-42f2-8096-c1581fc84a5e/node/0.log" Nov 03 20:39:01.092115 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:01.092064 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-4zw8h/test-trainjob-9bbgj-node-0-0-89dg4" podStartSLOduration=2.09204906 podStartE2EDuration="2.09204906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:38:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:39:01.09078713 +0000 UTC m=+2250.657677279" watchObservedRunningTime="2026-11-03 20:39:01.09204906 +0000 UTC m=+2250.658939208" Nov 03 20:39:02.951843 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:02.951792 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:39:03.334141 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:03.334100 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s28bb_test-trainjob-4z547-node-0-0-xlzwh_f5c4148f-521c-4b36-9a11-de64a2bd47b4/node/0.log" Nov 03 20:39:04.040321 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:04.040297 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-4zw8h_test-trainjob-9bbgj-node-0-0-89dg4_ad2bd674-05e5-42f2-8096-c1581fc84a5e/node/0.log" Nov 03 20:39:05.953524 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:05.953475 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:39:06.334212 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:06.334118 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s28bb_test-trainjob-4z547-node-0-0-xlzwh_f5c4148f-521c-4b36-9a11-de64a2bd47b4/node/0.log" Nov 03 20:39:07.039130 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:07.039102 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-4zw8h_test-trainjob-9bbgj-node-0-0-89dg4_ad2bd674-05e5-42f2-8096-c1581fc84a5e/node/0.log" Nov 03 20:39:08.952144 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:08.952043 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:39:09.334678 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:09.334584 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s28bb_test-trainjob-4z547-node-0-0-xlzwh_f5c4148f-521c-4b36-9a11-de64a2bd47b4/node/0.log" Nov 03 20:39:10.039938 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:10.039911 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-4zw8h_test-trainjob-9bbgj-node-0-0-89dg4_ad2bd674-05e5-42f2-8096-c1581fc84a5e/node/0.log" Nov 03 20:39:11.952129 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:11.952103 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:39:12.030223 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:12.030155 5857 generic.go:356] "Generic (PLEG): container finished" podID="ad2bd674-05e5-42f2-8096-c1581fc84a5e" containerID="b8240833c3a76dff67acafa3958f5880ebb8c3174b89efda91d4abdc37b71535" exitCode=0 Nov 03 20:39:12.030223 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:12.030195 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-4zw8h/test-trainjob-9bbgj-node-0-0-89dg4" event={"ID":"ad2bd674-05e5-42f2-8096-c1581fc84a5e","Type":"ContainerDied","Data":"b8240833c3a76dff67acafa3958f5880ebb8c3174b89efda91d4abdc37b71535"} Nov 03 20:39:12.335019 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:12.334949 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s28bb_test-trainjob-4z547-node-0-0-xlzwh_f5c4148f-521c-4b36-9a11-de64a2bd47b4/node/0.log" Nov 03 20:39:13.091972 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:13.091945 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-4zw8h_test-trainjob-9bbgj-node-0-0-89dg4_ad2bd674-05e5-42f2-8096-c1581fc84a5e/node/0.log" Nov 03 20:39:13.184990 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:13.184963 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-4zw8h/test-trainjob-9bbgj-node-0-0-89dg4" Nov 03 20:39:13.245275 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:13.245251 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ad2bd674-05e5-42f2-8096-c1581fc84a5e-kube-api-access-xj9n2\" (UniqueName: \"kubernetes.io/projected/ad2bd674-05e5-42f2-8096-c1581fc84a5e-kube-api-access-xj9n2\") pod \"ad2bd674-05e5-42f2-8096-c1581fc84a5e\" (UID: \"ad2bd674-05e5-42f2-8096-c1581fc84a5e\") " Nov 03 20:39:13.247610 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:13.247590 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad2bd674-05e5-42f2-8096-c1581fc84a5e-kube-api-access-xj9n2" pod "ad2bd674-05e5-42f2-8096-c1581fc84a5e" (UID: "ad2bd674-05e5-42f2-8096-c1581fc84a5e"). InnerVolumeSpecName "kube-api-access-xj9n2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:39:13.346370 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:13.346299 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xj9n2\" (UniqueName: \"kubernetes.io/projected/ad2bd674-05e5-42f2-8096-c1581fc84a5e-kube-api-access-xj9n2\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:39:14.041240 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:14.041212 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-4zw8h/test-trainjob-9bbgj-node-0-0-89dg4" Nov 03 20:39:14.041406 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:14.041251 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-4zw8h/test-trainjob-9bbgj-node-0-0-89dg4" event={"ID":"ad2bd674-05e5-42f2-8096-c1581fc84a5e","Type":"ContainerDied","Data":"16b4d63365553711418a64b0d243a42cd92581047e5ad16c16f19b888efdb76a"} Nov 03 20:39:14.041406 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:14.041287 5857 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="16b4d63365553711418a64b0d243a42cd92581047e5ad16c16f19b888efdb76a" Nov 03 20:39:14.688528 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:14.688501 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-4zw8h_test-trainjob-9bbgj-node-0-0-89dg4_ad2bd674-05e5-42f2-8096-c1581fc84a5e/node/0.log" Nov 03 20:39:14.801087 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:14.801057 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s28bb_test-trainjob-4z547-node-0-0-xlzwh_f5c4148f-521c-4b36-9a11-de64a2bd47b4/node/0.log" Nov 03 20:39:14.913044 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:14.913017 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hscb7_test-trainjob-bfmh4-node-0-0-l7frq_e60f6e33-bebe-4815-a203-b82151254028/node/0.log" Nov 03 20:39:18.876814 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:18.876781 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-rzckn/test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s"] Nov 03 20:39:18.877219 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:18.877150 5857 cpu_manager.go:414] "containerMap: removing container" podUID="ad2bd674-05e5-42f2-8096-c1581fc84a5e" containerName="node" Nov 03 20:39:18.877219 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:18.877161 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ad2bd674-05e5-42f2-8096-c1581fc84a5e" containerName="node" Nov 03 20:39:18.877219 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:18.877218 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="ad2bd674-05e5-42f2-8096-c1581fc84a5e" containerName="node" Nov 03 20:39:18.906738 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:18.906713 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-rzckn/test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s" Nov 03 20:39:18.939249 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:18.939225 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-rzckn/test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s"] Nov 03 20:39:18.987234 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:18.987212 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-rzckn\"/\"openshift-service-ca.crt\"" Nov 03 20:39:18.987411 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:18.987229 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-rzckn\"/\"kube-root-ca.crt\"" Nov 03 20:39:18.987548 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:18.987478 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-rzckn\"/\"default-dockercfg-hjq6b\"" Nov 03 20:39:19.094904 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:19.094863 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j7l5\" (UniqueName: \"kubernetes.io/projected/68fe9447-6933-4854-9c02-5a02006d6df5-kube-api-access-5j7l5\") pod \"test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s\" (UID: \"68fe9447-6933-4854-9c02-5a02006d6df5\") " pod="test-ns-rzckn/test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s" Nov 03 20:39:19.196406 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:19.196327 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j7l5\" (UniqueName: \"kubernetes.io/projected/68fe9447-6933-4854-9c02-5a02006d6df5-kube-api-access-5j7l5\") pod \"test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s\" (UID: \"68fe9447-6933-4854-9c02-5a02006d6df5\") " pod="test-ns-rzckn/test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s" Nov 03 20:39:19.257757 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:19.257729 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j7l5\" (UniqueName: \"kubernetes.io/projected/68fe9447-6933-4854-9c02-5a02006d6df5-kube-api-access-5j7l5\") pod \"test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s\" (UID: \"68fe9447-6933-4854-9c02-5a02006d6df5\") " pod="test-ns-rzckn/test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s" Nov 03 20:39:19.500002 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:39:19.499964 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:39:19.793832 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:19.793756 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-4zw8h/test-trainjob-9bbgj-node-0-0-89dg4"] Nov 03 20:39:19.797301 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:19.797281 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-4zw8h/test-trainjob-9bbgj-node-0-0-89dg4"] Nov 03 20:39:20.094093 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:20.094003 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-s28bb/test-trainjob-4z547-node-0-0-xlzwh"] Nov 03 20:39:20.098317 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:20.098289 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-hscb7/test-trainjob-bfmh4-node-0-0-l7frq"] Nov 03 20:39:20.099392 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:20.099373 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-s28bb/test-trainjob-4z547-node-0-0-xlzwh"] Nov 03 20:39:20.143339 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:20.143304 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-hscb7/test-trainjob-bfmh4-node-0-0-l7frq"] Nov 03 20:39:20.574767 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:20.574731 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ad2bd674-05e5-42f2-8096-c1581fc84a5e" path="/var/lib/kubelet/pods/ad2bd674-05e5-42f2-8096-c1581fc84a5e/volumes" Nov 03 20:39:20.575073 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:20.575060 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e60f6e33-bebe-4815-a203-b82151254028" path="/var/lib/kubelet/pods/e60f6e33-bebe-4815-a203-b82151254028/volumes" Nov 03 20:39:20.575353 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:20.575341 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f5c4148f-521c-4b36-9a11-de64a2bd47b4" path="/var/lib/kubelet/pods/f5c4148f-521c-4b36-9a11-de64a2bd47b4/volumes" Nov 03 20:39:26.157702 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:26.157669 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-c5f89f14-29ea-45da-9a63-4170c7a5ad44\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-081a1c93d4ea2c531\") pod \"test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s\" (UID: \"68fe9447-6933-4854-9c02-5a02006d6df5\") " pod="test-ns-rzckn/test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s" Nov 03 20:39:26.261153 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:26.261121 5857 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-c5f89f14-29ea-45da-9a63-4170c7a5ad44\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-081a1c93d4ea2c531\") pod \"test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s\" (UID: \"68fe9447-6933-4854-9c02-5a02006d6df5\") device path: \"\"" pod="test-ns-rzckn/test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s" Nov 03 20:39:26.359663 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:26.359625 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-c5f89f14-29ea-45da-9a63-4170c7a5ad44\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-081a1c93d4ea2c531\") pod \"test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s\" (UID: \"68fe9447-6933-4854-9c02-5a02006d6df5\") " pod="test-ns-rzckn/test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s" Nov 03 20:39:26.359807 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:26.359782 5857 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-c5f89f14-29ea-45da-9a63-4170c7a5ad44\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-081a1c93d4ea2c531\") pod \"test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s\" (UID: \"68fe9447-6933-4854-9c02-5a02006d6df5\") DevicePath \"\"" pod="test-ns-rzckn/test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s" Nov 03 20:39:26.411664 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:26.411586 5857 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-c5f89f14-29ea-45da-9a63-4170c7a5ad44\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-081a1c93d4ea2c531\") pod \"test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s\" (UID: \"68fe9447-6933-4854-9c02-5a02006d6df5\") DevicePath \"csi-c95997e6c09a89911a9337224bc15892feb7e064a18d2b21b0d53380038f5dd0\"" pod="test-ns-rzckn/test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s" Nov 03 20:39:26.643149 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:26.643116 5857 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-c5f89f14-29ea-45da-9a63-4170c7a5ad44\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-081a1c93d4ea2c531\") pod \"test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s\" (UID: \"68fe9447-6933-4854-9c02-5a02006d6df5\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/13783d7d0d8a82e9ce86272db4908da7748f6ed414ab2a81c806f0f0c87485ff/globalmount\"" pod="test-ns-rzckn/test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s" Nov 03 20:39:26.707400 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:26.707372 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-c5f89f14-29ea-45da-9a63-4170c7a5ad44\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-081a1c93d4ea2c531\") pod \"test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s\" (UID: \"68fe9447-6933-4854-9c02-5a02006d6df5\") " pod="test-ns-rzckn/test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s" Nov 03 20:39:27.035260 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:27.035170 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-rzckn/test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s" Nov 03 20:39:27.419971 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:27.419891 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-rzckn/test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s"] Nov 03 20:39:27.423178 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:39:27.423145 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68fe9447_6933_4854_9c02_5a02006d6df5.slice/crio-861eeafaf8e2fecdd139a511ca02439aab4f4f9d880ba5050e8337fa61e14d7f WatchSource:0}: Error finding container 861eeafaf8e2fecdd139a511ca02439aab4f4f9d880ba5050e8337fa61e14d7f: Status 404 returned error can't find the container with id 861eeafaf8e2fecdd139a511ca02439aab4f4f9d880ba5050e8337fa61e14d7f Nov 03 20:39:27.425101 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:27.425080 5857 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 03 20:39:28.115720 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:28.115687 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-rzckn/test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s" event={"ID":"68fe9447-6933-4854-9c02-5a02006d6df5","Type":"ContainerStarted","Data":"861eeafaf8e2fecdd139a511ca02439aab4f4f9d880ba5050e8337fa61e14d7f"} Nov 03 20:39:31.073197 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:31.073167 5857 scope.go:122] "RemoveContainer" containerID="4cf9471e36bbd6dd616bd721c8355a47195c9ba2bb5517fdd22190495205e238" Nov 03 20:39:36.160057 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:36.160017 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-rzckn/test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s" event={"ID":"68fe9447-6933-4854-9c02-5a02006d6df5","Type":"ContainerStarted","Data":"f5ad70a1821959f71ca6384106c5b6de370590afbfb9d2943e0ab64b25c99173"} Nov 03 20:39:36.276871 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:36.276811 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-rzckn/test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s" podStartSLOduration=13.162011418 podStartE2EDuration="21.276792917s" totalImagesPullingTime="8.114781499s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 20:39:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:39:36.276198334 +0000 UTC m=+2285.843088483" watchObservedRunningTime="2026-11-03 20:39:36.276792917 +0000 UTC m=+2285.843683065" Nov 03 20:39:39.042141 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:39.042106 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:39:41.185004 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:41.184911 5857 generic.go:356] "Generic (PLEG): container finished" podID="68fe9447-6933-4854-9c02-5a02006d6df5" containerID="f5ad70a1821959f71ca6384106c5b6de370590afbfb9d2943e0ab64b25c99173" exitCode=0 Nov 03 20:39:41.185004 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:41.184981 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-rzckn/test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s" event={"ID":"68fe9447-6933-4854-9c02-5a02006d6df5","Type":"ContainerDied","Data":"f5ad70a1821959f71ca6384106c5b6de370590afbfb9d2943e0ab64b25c99173"} Nov 03 20:39:42.043050 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:42.043014 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:39:42.350158 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:42.350132 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-rzckn/test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s" Nov 03 20:39:42.510655 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:42.510625 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/68fe9447-6933-4854-9c02-5a02006d6df5-kube-api-access-5j7l5\" (UniqueName: \"kubernetes.io/projected/68fe9447-6933-4854-9c02-5a02006d6df5-kube-api-access-5j7l5\") pod \"68fe9447-6933-4854-9c02-5a02006d6df5\" (UID: \"68fe9447-6933-4854-9c02-5a02006d6df5\") " Nov 03 20:39:42.510850 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:42.510780 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-081a1c93d4ea2c531\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-081a1c93d4ea2c531\") pod \"68fe9447-6933-4854-9c02-5a02006d6df5\" (UID: \"68fe9447-6933-4854-9c02-5a02006d6df5\") " Nov 03 20:39:42.513080 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:42.513056 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68fe9447-6933-4854-9c02-5a02006d6df5-kube-api-access-5j7l5" pod "68fe9447-6933-4854-9c02-5a02006d6df5" (UID: "68fe9447-6933-4854-9c02-5a02006d6df5"). InnerVolumeSpecName "kube-api-access-5j7l5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:39:42.535729 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:42.535707 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-081a1c93d4ea2c531" pod "68fe9447-6933-4854-9c02-5a02006d6df5" (UID: "68fe9447-6933-4854-9c02-5a02006d6df5"). InnerVolumeSpecName "pvc-c5f89f14-29ea-45da-9a63-4170c7a5ad44". PluginName "kubernetes.io/csi", VolumeGIDValue "" Nov 03 20:39:42.611624 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:42.611593 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5j7l5\" (UniqueName: \"kubernetes.io/projected/68fe9447-6933-4854-9c02-5a02006d6df5-kube-api-access-5j7l5\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:39:42.611768 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:42.611640 5857 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-c5f89f14-29ea-45da-9a63-4170c7a5ad44\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-081a1c93d4ea2c531\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" " Nov 03 20:39:42.635432 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:42.635414 5857 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-c5f89f14-29ea-45da-9a63-4170c7a5ad44" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-081a1c93d4ea2c531") on node "ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:39:42.712782 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:42.712751 5857 reconciler_common.go:299] "Volume detached for volume \"pvc-c5f89f14-29ea-45da-9a63-4170c7a5ad44\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-081a1c93d4ea2c531\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"csi-c95997e6c09a89911a9337224bc15892feb7e064a18d2b21b0d53380038f5dd0\"" Nov 03 20:39:43.195500 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:43.195463 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-rzckn/test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s" event={"ID":"68fe9447-6933-4854-9c02-5a02006d6df5","Type":"ContainerDied","Data":"861eeafaf8e2fecdd139a511ca02439aab4f4f9d880ba5050e8337fa61e14d7f"} Nov 03 20:39:43.195693 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:43.195542 5857 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="861eeafaf8e2fecdd139a511ca02439aab4f4f9d880ba5050e8337fa61e14d7f" Nov 03 20:39:43.195693 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:43.195476 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-rzckn/test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s" Nov 03 20:39:43.628271 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:43.628227 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-rzckn/test-trainjob-lnvrg-model-initializer-0-0-dgdlq"] Nov 03 20:39:43.628823 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:43.628765 5857 cpu_manager.go:414] "containerMap: removing container" podUID="68fe9447-6933-4854-9c02-5a02006d6df5" containerName="dataset-initializer" Nov 03 20:39:43.628823 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:43.628783 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="68fe9447-6933-4854-9c02-5a02006d6df5" containerName="dataset-initializer" Nov 03 20:39:43.628936 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:43.628906 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="68fe9447-6933-4854-9c02-5a02006d6df5" containerName="dataset-initializer" Nov 03 20:39:43.648787 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:43.648758 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-rzckn/test-trainjob-lnvrg-model-initializer-0-0-dgdlq" Nov 03 20:39:43.690388 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:43.690356 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-rzckn/test-trainjob-lnvrg-model-initializer-0-0-dgdlq"] Nov 03 20:39:43.701175 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:43.701151 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-rzckn\"/\"kube-root-ca.crt\"" Nov 03 20:39:43.738016 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:43.737978 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-rzckn\"/\"default-dockercfg-hjq6b\"" Nov 03 20:39:43.738170 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:43.738019 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-rzckn\"/\"openshift-service-ca.crt\"" Nov 03 20:39:43.924408 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:43.924313 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htjjs\" (UniqueName: \"kubernetes.io/projected/6ead5d88-3d79-4c5d-ad43-f815411f6aad-kube-api-access-htjjs\") pod \"test-trainjob-lnvrg-model-initializer-0-0-dgdlq\" (UID: \"6ead5d88-3d79-4c5d-ad43-f815411f6aad\") " pod="test-ns-rzckn/test-trainjob-lnvrg-model-initializer-0-0-dgdlq" Nov 03 20:39:44.025226 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:44.025194 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htjjs\" (UniqueName: \"kubernetes.io/projected/6ead5d88-3d79-4c5d-ad43-f815411f6aad-kube-api-access-htjjs\") pod \"test-trainjob-lnvrg-model-initializer-0-0-dgdlq\" (UID: \"6ead5d88-3d79-4c5d-ad43-f815411f6aad\") " pod="test-ns-rzckn/test-trainjob-lnvrg-model-initializer-0-0-dgdlq" Nov 03 20:39:44.086488 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:44.086456 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htjjs\" (UniqueName: \"kubernetes.io/projected/6ead5d88-3d79-4c5d-ad43-f815411f6aad-kube-api-access-htjjs\") pod \"test-trainjob-lnvrg-model-initializer-0-0-dgdlq\" (UID: \"6ead5d88-3d79-4c5d-ad43-f815411f6aad\") " pod="test-ns-rzckn/test-trainjob-lnvrg-model-initializer-0-0-dgdlq" Nov 03 20:39:45.041395 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:45.041362 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:39:46.544796 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:46.544766 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-c5f89f14-29ea-45da-9a63-4170c7a5ad44\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-081a1c93d4ea2c531\") pod \"test-trainjob-lnvrg-model-initializer-0-0-dgdlq\" (UID: \"6ead5d88-3d79-4c5d-ad43-f815411f6aad\") " pod="test-ns-rzckn/test-trainjob-lnvrg-model-initializer-0-0-dgdlq" Nov 03 20:39:46.648422 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:46.648390 5857 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-c5f89f14-29ea-45da-9a63-4170c7a5ad44\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-081a1c93d4ea2c531\") pod \"test-trainjob-lnvrg-model-initializer-0-0-dgdlq\" (UID: \"6ead5d88-3d79-4c5d-ad43-f815411f6aad\") device path: \"\"" pod="test-ns-rzckn/test-trainjob-lnvrg-model-initializer-0-0-dgdlq" Nov 03 20:39:46.746746 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:46.746705 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-c5f89f14-29ea-45da-9a63-4170c7a5ad44\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-081a1c93d4ea2c531\") pod \"test-trainjob-lnvrg-model-initializer-0-0-dgdlq\" (UID: \"6ead5d88-3d79-4c5d-ad43-f815411f6aad\") " pod="test-ns-rzckn/test-trainjob-lnvrg-model-initializer-0-0-dgdlq" Nov 03 20:39:46.746930 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:46.746829 5857 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-c5f89f14-29ea-45da-9a63-4170c7a5ad44\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-081a1c93d4ea2c531\") pod \"test-trainjob-lnvrg-model-initializer-0-0-dgdlq\" (UID: \"6ead5d88-3d79-4c5d-ad43-f815411f6aad\") DevicePath \"\"" pod="test-ns-rzckn/test-trainjob-lnvrg-model-initializer-0-0-dgdlq" Nov 03 20:39:46.798644 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:46.798519 5857 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-c5f89f14-29ea-45da-9a63-4170c7a5ad44\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-081a1c93d4ea2c531\") pod \"test-trainjob-lnvrg-model-initializer-0-0-dgdlq\" (UID: \"6ead5d88-3d79-4c5d-ad43-f815411f6aad\") DevicePath \"csi-c95997e6c09a89911a9337224bc15892feb7e064a18d2b21b0d53380038f5dd0\"" pod="test-ns-rzckn/test-trainjob-lnvrg-model-initializer-0-0-dgdlq" Nov 03 20:39:46.941673 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:46.941641 5857 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-c5f89f14-29ea-45da-9a63-4170c7a5ad44\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-081a1c93d4ea2c531\") pod \"test-trainjob-lnvrg-model-initializer-0-0-dgdlq\" (UID: \"6ead5d88-3d79-4c5d-ad43-f815411f6aad\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/13783d7d0d8a82e9ce86272db4908da7748f6ed414ab2a81c806f0f0c87485ff/globalmount\"" pod="test-ns-rzckn/test-trainjob-lnvrg-model-initializer-0-0-dgdlq" Nov 03 20:39:47.006661 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:47.006628 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-c5f89f14-29ea-45da-9a63-4170c7a5ad44\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-081a1c93d4ea2c531\") pod \"test-trainjob-lnvrg-model-initializer-0-0-dgdlq\" (UID: \"6ead5d88-3d79-4c5d-ad43-f815411f6aad\") " pod="test-ns-rzckn/test-trainjob-lnvrg-model-initializer-0-0-dgdlq" Nov 03 20:39:47.279438 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:47.279405 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-rzckn/test-trainjob-lnvrg-model-initializer-0-0-dgdlq" Nov 03 20:39:47.654996 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:47.654963 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-rzckn/test-trainjob-lnvrg-model-initializer-0-0-dgdlq"] Nov 03 20:39:47.657599 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:39:47.657555 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ead5d88_3d79_4c5d_ad43_f815411f6aad.slice/crio-8322619da06416ffcf477f8a54cdb2b05a5e59e5d228f7e4eb3c6ff312dbb848 WatchSource:0}: Error finding container 8322619da06416ffcf477f8a54cdb2b05a5e59e5d228f7e4eb3c6ff312dbb848: Status 404 returned error can't find the container with id 8322619da06416ffcf477f8a54cdb2b05a5e59e5d228f7e4eb3c6ff312dbb848 Nov 03 20:39:48.042089 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:48.042058 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:39:48.221766 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:48.221732 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-rzckn/test-trainjob-lnvrg-model-initializer-0-0-dgdlq" event={"ID":"6ead5d88-3d79-4c5d-ad43-f815411f6aad","Type":"ContainerStarted","Data":"8322619da06416ffcf477f8a54cdb2b05a5e59e5d228f7e4eb3c6ff312dbb848"} Nov 03 20:39:49.502117 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:39:49.502080 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:39:51.054252 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:51.054179 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:39:54.054105 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:54.054060 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:39:57.054667 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:39:57.054620 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:40:00.054208 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:40:00.054170 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:40:03.054379 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:40:03.054337 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:40:06.053981 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:40:06.053946 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:40:09.054252 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:40:09.054223 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:40:12.053698 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:40:12.053663 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:40:15.053918 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:40:15.053884 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:40:18.053267 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:40:18.053234 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:40:19.499886 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:40:19.499850 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:40:21.048690 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:40:21.048654 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:40:24.041984 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:40:24.041953 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:40:27.041931 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:40:27.041904 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:40:30.052968 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:40:30.052937 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:40:33.053651 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:40:33.053620 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:40:36.063576 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:40:36.063535 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:40:39.053959 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:40:39.053876 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:40:42.053894 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:40:42.053858 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:40:45.054487 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:40:45.054453 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:40:48.055741 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:40:48.055703 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:40:49.499480 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:40:49.499442 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:40:51.053641 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:40:51.053519 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:40:54.066398 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:40:54.066364 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:40:57.053705 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:40:57.053670 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:41:00.054157 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:41:00.054129 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:41:03.042060 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:41:03.042001 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:41:06.041955 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:41:06.041923 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:41:09.047098 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:41:09.047068 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:41:12.054267 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:41:12.054239 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:41:15.055268 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:41:15.055237 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:41:18.053605 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:41:18.053556 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:41:19.502460 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:41:19.502425 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:41:21.053284 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:41:21.053256 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:41:24.059865 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:41:24.059834 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:41:27.053937 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:41:27.053907 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:41:30.054917 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:41:30.054876 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:41:33.093773 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:41:33.093740 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:41:36.054111 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:41:36.054079 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:41:39.053515 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:41:39.053487 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:41:42.041125 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:41:42.041096 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:41:45.041017 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:41:45.040982 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:41:48.041532 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:41:48.041500 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:41:49.501300 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:41:49.501262 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:41:51.053590 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:41:51.053539 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:41:54.055233 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:41:54.055206 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:41:57.053772 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:41:57.053746 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:42:00.053529 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:42:00.053493 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:42:03.053630 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:42:03.053600 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:42:06.053895 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:42:06.053859 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:42:09.054226 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:42:09.054153 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:42:12.054450 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:42:12.054392 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:42:15.064753 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:42:15.064724 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:42:18.054300 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:42:18.054271 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:42:19.500648 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:42:19.500605 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:42:21.053407 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:42:21.053380 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:42:24.041739 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:42:24.041707 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:42:27.041816 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:42:27.041786 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:42:30.041073 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:42:30.041026 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:42:33.053424 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:42:33.053393 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:42:36.074616 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:42:36.074547 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:42:39.053627 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:42:39.053599 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:42:42.053315 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:42:42.053284 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:42:45.053158 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:42:45.053125 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:42:48.055492 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:42:48.055459 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:42:49.499408 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:42:49.499363 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:42:51.054307 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:42:51.054276 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:42:54.055464 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:42:54.055434 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:42:57.054860 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:42:57.054833 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:43:00.053842 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:00.053813 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:43:03.042848 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:03.042806 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:43:06.042303 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:06.042273 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:43:09.041262 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:09.041229 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:43:10.230291 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:10.230259 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-rzckn/test-trainjob-lnvrg-model-initializer-0-0-dgdlq" event={"ID":"6ead5d88-3d79-4c5d-ad43-f815411f6aad","Type":"ContainerStarted","Data":"a7d989c51dbc42f14625b5f78990e79a5c83bece8f236f280eb66b8e019a7217"} Nov 03 20:43:10.373502 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:10.373446 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-rzckn/test-trainjob-lnvrg-model-initializer-0-0-dgdlq" podStartSLOduration=5.809363057 podStartE2EDuration="3m27.373430513s" totalImagesPullingTime="3m21.564067456s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 20:39:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:43:10.372318296 +0000 UTC m=+2499.939208460" watchObservedRunningTime="2026-11-03 20:43:10.373430513 +0000 UTC m=+2499.940320740" Nov 03 20:43:12.053702 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:12.053655 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:43:12.120446 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:12.120410 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-model-initializer-0-0-dgdlq_6ead5d88-3d79-4c5d-ad43-f815411f6aad/model-initializer/0.log" Nov 03 20:43:15.055696 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:15.055661 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:43:15.122014 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:15.121986 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-model-initializer-0-0-dgdlq_6ead5d88-3d79-4c5d-ad43-f815411f6aad/model-initializer/0.log" Nov 03 20:43:18.053516 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:18.053488 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:43:18.120014 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:18.119971 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-model-initializer-0-0-dgdlq_6ead5d88-3d79-4c5d-ad43-f815411f6aad/model-initializer/0.log" Nov 03 20:43:19.500460 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:43:19.500420 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:43:20.282291 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:20.282262 5857 generic.go:356] "Generic (PLEG): container finished" podID="6ead5d88-3d79-4c5d-ad43-f815411f6aad" containerID="a7d989c51dbc42f14625b5f78990e79a5c83bece8f236f280eb66b8e019a7217" exitCode=0 Nov 03 20:43:20.282415 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:20.282311 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-rzckn/test-trainjob-lnvrg-model-initializer-0-0-dgdlq" event={"ID":"6ead5d88-3d79-4c5d-ad43-f815411f6aad","Type":"ContainerDied","Data":"a7d989c51dbc42f14625b5f78990e79a5c83bece8f236f280eb66b8e019a7217"} Nov 03 20:43:21.054245 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:21.054214 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:43:21.130420 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:21.130399 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-model-initializer-0-0-dgdlq_6ead5d88-3d79-4c5d-ad43-f815411f6aad/model-initializer/0.log" Nov 03 20:43:21.423171 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:21.423145 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-rzckn/test-trainjob-lnvrg-model-initializer-0-0-dgdlq" Nov 03 20:43:21.555156 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:21.555119 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-081a1c93d4ea2c531\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-081a1c93d4ea2c531\") pod \"6ead5d88-3d79-4c5d-ad43-f815411f6aad\" (UID: \"6ead5d88-3d79-4c5d-ad43-f815411f6aad\") " Nov 03 20:43:21.555345 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:21.555218 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6ead5d88-3d79-4c5d-ad43-f815411f6aad-kube-api-access-htjjs\" (UniqueName: \"kubernetes.io/projected/6ead5d88-3d79-4c5d-ad43-f815411f6aad-kube-api-access-htjjs\") pod \"6ead5d88-3d79-4c5d-ad43-f815411f6aad\" (UID: \"6ead5d88-3d79-4c5d-ad43-f815411f6aad\") " Nov 03 20:43:21.557663 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:21.557633 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ead5d88-3d79-4c5d-ad43-f815411f6aad-kube-api-access-htjjs" pod "6ead5d88-3d79-4c5d-ad43-f815411f6aad" (UID: "6ead5d88-3d79-4c5d-ad43-f815411f6aad"). InnerVolumeSpecName "kube-api-access-htjjs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:43:21.558010 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:21.557984 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-081a1c93d4ea2c531" pod "6ead5d88-3d79-4c5d-ad43-f815411f6aad" (UID: "6ead5d88-3d79-4c5d-ad43-f815411f6aad"). InnerVolumeSpecName "pvc-c5f89f14-29ea-45da-9a63-4170c7a5ad44". PluginName "kubernetes.io/csi", VolumeGIDValue "" Nov 03 20:43:21.656410 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:21.656331 5857 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-c5f89f14-29ea-45da-9a63-4170c7a5ad44\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-081a1c93d4ea2c531\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" " Nov 03 20:43:21.656410 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:21.656359 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htjjs\" (UniqueName: \"kubernetes.io/projected/6ead5d88-3d79-4c5d-ad43-f815411f6aad-kube-api-access-htjjs\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:43:21.721787 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:21.721767 5857 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-c5f89f14-29ea-45da-9a63-4170c7a5ad44" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-081a1c93d4ea2c531") on node "ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:43:21.757787 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:21.757763 5857 reconciler_common.go:299] "Volume detached for volume \"pvc-c5f89f14-29ea-45da-9a63-4170c7a5ad44\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-081a1c93d4ea2c531\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"csi-c95997e6c09a89911a9337224bc15892feb7e064a18d2b21b0d53380038f5dd0\"" Nov 03 20:43:22.293116 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:22.293086 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-rzckn/test-trainjob-lnvrg-model-initializer-0-0-dgdlq" Nov 03 20:43:22.293541 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:22.293128 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-rzckn/test-trainjob-lnvrg-model-initializer-0-0-dgdlq" event={"ID":"6ead5d88-3d79-4c5d-ad43-f815411f6aad","Type":"ContainerDied","Data":"8322619da06416ffcf477f8a54cdb2b05a5e59e5d228f7e4eb3c6ff312dbb848"} Nov 03 20:43:22.293541 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:22.293178 5857 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8322619da06416ffcf477f8a54cdb2b05a5e59e5d228f7e4eb3c6ff312dbb848" Nov 03 20:43:22.962334 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:22.962303 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-rzckn/test-trainjob-lnvrg-node-0-0-nqh7l"] Nov 03 20:43:22.962697 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:22.962682 5857 cpu_manager.go:414] "containerMap: removing container" podUID="6ead5d88-3d79-4c5d-ad43-f815411f6aad" containerName="model-initializer" Nov 03 20:43:22.962766 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:22.962698 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6ead5d88-3d79-4c5d-ad43-f815411f6aad" containerName="model-initializer" Nov 03 20:43:22.962766 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:22.962757 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="6ead5d88-3d79-4c5d-ad43-f815411f6aad" containerName="model-initializer" Nov 03 20:43:22.964539 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:22.964522 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-rzckn/test-trainjob-lnvrg-node-0-0-nqh7l" Nov 03 20:43:23.016651 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:23.016625 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-rzckn\"/\"openshift-service-ca.crt\"" Nov 03 20:43:23.065909 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:23.065878 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-rzckn\"/\"kube-root-ca.crt\"" Nov 03 20:43:23.066084 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:23.065971 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-rzckn\"/\"default-dockercfg-hjq6b\"" Nov 03 20:43:23.067515 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:23.067495 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-rzckn/test-trainjob-lnvrg-node-0-0-nqh7l"] Nov 03 20:43:23.167786 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:23.167748 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8gp8\" (UniqueName: \"kubernetes.io/projected/45d3c988-cd59-427c-8b4c-ecedb259c432-kube-api-access-f8gp8\") pod \"test-trainjob-lnvrg-node-0-0-nqh7l\" (UID: \"45d3c988-cd59-427c-8b4c-ecedb259c432\") " pod="test-ns-rzckn/test-trainjob-lnvrg-node-0-0-nqh7l" Nov 03 20:43:23.269151 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:23.269066 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8gp8\" (UniqueName: \"kubernetes.io/projected/45d3c988-cd59-427c-8b4c-ecedb259c432-kube-api-access-f8gp8\") pod \"test-trainjob-lnvrg-node-0-0-nqh7l\" (UID: \"45d3c988-cd59-427c-8b4c-ecedb259c432\") " pod="test-ns-rzckn/test-trainjob-lnvrg-node-0-0-nqh7l" Nov 03 20:43:23.330283 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:23.330255 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8gp8\" (UniqueName: \"kubernetes.io/projected/45d3c988-cd59-427c-8b4c-ecedb259c432-kube-api-access-f8gp8\") pod \"test-trainjob-lnvrg-node-0-0-nqh7l\" (UID: \"45d3c988-cd59-427c-8b4c-ecedb259c432\") " pod="test-ns-rzckn/test-trainjob-lnvrg-node-0-0-nqh7l" Nov 03 20:43:24.053498 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:24.053464 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:43:24.120464 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:24.120438 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-model-initializer-0-0-dgdlq_6ead5d88-3d79-4c5d-ad43-f815411f6aad/model-initializer/0.log" Nov 03 20:43:27.054927 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:27.054897 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:43:27.170894 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:27.170864 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-model-initializer-0-0-dgdlq_6ead5d88-3d79-4c5d-ad43-f815411f6aad/model-initializer/0.log" Nov 03 20:43:30.054404 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:30.054375 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:43:30.121051 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:30.121024 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-model-initializer-0-0-dgdlq_6ead5d88-3d79-4c5d-ad43-f815411f6aad/model-initializer/0.log" Nov 03 20:43:32.649957 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:32.649920 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-c5f89f14-29ea-45da-9a63-4170c7a5ad44\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-081a1c93d4ea2c531\") pod \"test-trainjob-lnvrg-node-0-0-nqh7l\" (UID: \"45d3c988-cd59-427c-8b4c-ecedb259c432\") " pod="test-ns-rzckn/test-trainjob-lnvrg-node-0-0-nqh7l" Nov 03 20:43:32.754003 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:32.753970 5857 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-c5f89f14-29ea-45da-9a63-4170c7a5ad44\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-081a1c93d4ea2c531\") pod \"test-trainjob-lnvrg-node-0-0-nqh7l\" (UID: \"45d3c988-cd59-427c-8b4c-ecedb259c432\") device path: \"\"" pod="test-ns-rzckn/test-trainjob-lnvrg-node-0-0-nqh7l" Nov 03 20:43:32.851492 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:32.851454 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-c5f89f14-29ea-45da-9a63-4170c7a5ad44\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-081a1c93d4ea2c531\") pod \"test-trainjob-lnvrg-node-0-0-nqh7l\" (UID: \"45d3c988-cd59-427c-8b4c-ecedb259c432\") " pod="test-ns-rzckn/test-trainjob-lnvrg-node-0-0-nqh7l" Nov 03 20:43:32.851691 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:32.851609 5857 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-c5f89f14-29ea-45da-9a63-4170c7a5ad44\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-081a1c93d4ea2c531\") pod \"test-trainjob-lnvrg-node-0-0-nqh7l\" (UID: \"45d3c988-cd59-427c-8b4c-ecedb259c432\") DevicePath \"\"" pod="test-ns-rzckn/test-trainjob-lnvrg-node-0-0-nqh7l" Nov 03 20:43:32.903288 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:32.903221 5857 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-c5f89f14-29ea-45da-9a63-4170c7a5ad44\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-081a1c93d4ea2c531\") pod \"test-trainjob-lnvrg-node-0-0-nqh7l\" (UID: \"45d3c988-cd59-427c-8b4c-ecedb259c432\") DevicePath \"csi-c95997e6c09a89911a9337224bc15892feb7e064a18d2b21b0d53380038f5dd0\"" pod="test-ns-rzckn/test-trainjob-lnvrg-node-0-0-nqh7l" Nov 03 20:43:33.038553 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:33.038516 5857 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-c5f89f14-29ea-45da-9a63-4170c7a5ad44\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-081a1c93d4ea2c531\") pod \"test-trainjob-lnvrg-node-0-0-nqh7l\" (UID: \"45d3c988-cd59-427c-8b4c-ecedb259c432\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/13783d7d0d8a82e9ce86272db4908da7748f6ed414ab2a81c806f0f0c87485ff/globalmount\"" pod="test-ns-rzckn/test-trainjob-lnvrg-node-0-0-nqh7l" Nov 03 20:43:33.054990 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:33.054967 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:43:33.103115 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:33.103091 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-c5f89f14-29ea-45da-9a63-4170c7a5ad44\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-081a1c93d4ea2c531\") pod \"test-trainjob-lnvrg-node-0-0-nqh7l\" (UID: \"45d3c988-cd59-427c-8b4c-ecedb259c432\") " pod="test-ns-rzckn/test-trainjob-lnvrg-node-0-0-nqh7l" Nov 03 20:43:33.121177 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:33.121149 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-model-initializer-0-0-dgdlq_6ead5d88-3d79-4c5d-ad43-f815411f6aad/model-initializer/0.log" Nov 03 20:43:33.227159 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:33.227136 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-rzckn\"/\"default-dockercfg-hjq6b\"" Nov 03 20:43:33.237211 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:33.237185 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-rzckn/test-trainjob-lnvrg-node-0-0-nqh7l" Nov 03 20:43:33.630300 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:33.630226 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-rzckn/test-trainjob-lnvrg-node-0-0-nqh7l"] Nov 03 20:43:33.633502 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:43:33.633472 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45d3c988_cd59_427c_8b4c_ecedb259c432.slice/crio-24566a25f78ddbd832253c9650e675e8dcbb1df95c862c8187770b5ad52bca49 WatchSource:0}: Error finding container 24566a25f78ddbd832253c9650e675e8dcbb1df95c862c8187770b5ad52bca49: Status 404 returned error can't find the container with id 24566a25f78ddbd832253c9650e675e8dcbb1df95c862c8187770b5ad52bca49 Nov 03 20:43:34.350417 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:34.350386 5857 generic.go:356] "Generic (PLEG): container finished" podID="45d3c988-cd59-427c-8b4c-ecedb259c432" containerID="68dfd334e6b42e861c6f19b7d4163dc45993bf8e1efaba0cee35c62f95898c33" exitCode=0 Nov 03 20:43:34.350818 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:34.350453 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-rzckn/test-trainjob-lnvrg-node-0-0-nqh7l" event={"ID":"45d3c988-cd59-427c-8b4c-ecedb259c432","Type":"ContainerDied","Data":"68dfd334e6b42e861c6f19b7d4163dc45993bf8e1efaba0cee35c62f95898c33"} Nov 03 20:43:34.350818 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:34.350491 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-rzckn/test-trainjob-lnvrg-node-0-0-nqh7l" event={"ID":"45d3c988-cd59-427c-8b4c-ecedb259c432","Type":"ContainerStarted","Data":"24566a25f78ddbd832253c9650e675e8dcbb1df95c862c8187770b5ad52bca49"} Nov 03 20:43:35.511364 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:35.511341 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-rzckn/test-trainjob-lnvrg-node-0-0-nqh7l" Nov 03 20:43:35.676552 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:35.676473 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/45d3c988-cd59-427c-8b4c-ecedb259c432-kube-api-access-f8gp8\" (UniqueName: \"kubernetes.io/projected/45d3c988-cd59-427c-8b4c-ecedb259c432-kube-api-access-f8gp8\") pod \"45d3c988-cd59-427c-8b4c-ecedb259c432\" (UID: \"45d3c988-cd59-427c-8b4c-ecedb259c432\") " Nov 03 20:43:35.676733 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:35.676617 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-081a1c93d4ea2c531\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-081a1c93d4ea2c531\") pod \"45d3c988-cd59-427c-8b4c-ecedb259c432\" (UID: \"45d3c988-cd59-427c-8b4c-ecedb259c432\") " Nov 03 20:43:35.678841 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:35.678815 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45d3c988-cd59-427c-8b4c-ecedb259c432-kube-api-access-f8gp8" pod "45d3c988-cd59-427c-8b4c-ecedb259c432" (UID: "45d3c988-cd59-427c-8b4c-ecedb259c432"). InnerVolumeSpecName "kube-api-access-f8gp8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:43:35.679596 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:35.679557 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-081a1c93d4ea2c531" pod "45d3c988-cd59-427c-8b4c-ecedb259c432" (UID: "45d3c988-cd59-427c-8b4c-ecedb259c432"). InnerVolumeSpecName "pvc-c5f89f14-29ea-45da-9a63-4170c7a5ad44". PluginName "kubernetes.io/csi", VolumeGIDValue "" Nov 03 20:43:35.778084 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:35.778050 5857 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-c5f89f14-29ea-45da-9a63-4170c7a5ad44\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-081a1c93d4ea2c531\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" " Nov 03 20:43:35.778084 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:35.778085 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8gp8\" (UniqueName: \"kubernetes.io/projected/45d3c988-cd59-427c-8b4c-ecedb259c432-kube-api-access-f8gp8\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:43:35.790299 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:35.790275 5857 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-c5f89f14-29ea-45da-9a63-4170c7a5ad44" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-081a1c93d4ea2c531") on node "ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:43:35.878850 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:35.878821 5857 reconciler_common.go:299] "Volume detached for volume \"pvc-c5f89f14-29ea-45da-9a63-4170c7a5ad44\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-081a1c93d4ea2c531\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"csi-c95997e6c09a89911a9337224bc15892feb7e064a18d2b21b0d53380038f5dd0\"" Nov 03 20:43:36.054463 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:36.054437 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:43:36.121295 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:36.121272 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-model-initializer-0-0-dgdlq_6ead5d88-3d79-4c5d-ad43-f815411f6aad/model-initializer/0.log" Nov 03 20:43:36.187891 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:36.187868 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-node-0-0-nqh7l_45d3c988-cd59-427c-8b4c-ecedb259c432/node/0.log" Nov 03 20:43:36.362181 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:36.362102 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-rzckn/test-trainjob-lnvrg-node-0-0-nqh7l" Nov 03 20:43:36.362181 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:36.362134 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-rzckn/test-trainjob-lnvrg-node-0-0-nqh7l" event={"ID":"45d3c988-cd59-427c-8b4c-ecedb259c432","Type":"ContainerDied","Data":"24566a25f78ddbd832253c9650e675e8dcbb1df95c862c8187770b5ad52bca49"} Nov 03 20:43:36.362181 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:36.362178 5857 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="24566a25f78ddbd832253c9650e675e8dcbb1df95c862c8187770b5ad52bca49" Nov 03 20:43:37.596840 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:37.596801 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s_68fe9447-6933-4854-9c02-5a02006d6df5/dataset-initializer/0.log" Nov 03 20:43:37.663747 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:37.663716 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-model-initializer-0-0-dgdlq_6ead5d88-3d79-4c5d-ad43-f815411f6aad/model-initializer/0.log" Nov 03 20:43:37.732209 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:37.732182 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rzckn_test-trainjob-lnvrg-node-0-0-nqh7l_45d3c988-cd59-427c-8b4c-ecedb259c432/node/0.log" Nov 03 20:43:38.296679 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:38.296641 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-jmkdx/dw-deployment-wp8tc-5db7d8db57-5kxpw"] Nov 03 20:43:38.297066 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:38.297048 5857 cpu_manager.go:414] "containerMap: removing container" podUID="45d3c988-cd59-427c-8b4c-ecedb259c432" containerName="node" Nov 03 20:43:38.297156 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:38.297068 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="45d3c988-cd59-427c-8b4c-ecedb259c432" containerName="node" Nov 03 20:43:38.297221 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:38.297163 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="45d3c988-cd59-427c-8b4c-ecedb259c432" containerName="node" Nov 03 20:43:38.299081 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:38.299060 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-jmkdx/dw-deployment-wp8tc-5db7d8db57-5kxpw" Nov 03 20:43:38.351790 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:38.351766 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-jmkdx\"/\"default-dockercfg-2vzw2\"" Nov 03 20:43:38.401241 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:38.401207 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-jmkdx\"/\"kube-root-ca.crt\"" Nov 03 20:43:38.401241 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:38.401217 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-jmkdx\"/\"openshift-service-ca.crt\"" Nov 03 20:43:38.450953 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:38.450923 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-jmkdx\"/\"config-zb8pd\"" Nov 03 20:43:38.452738 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:38.452722 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-jmkdx/dw-deployment-wp8tc-5db7d8db57-5kxpw"] Nov 03 20:43:38.601606 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:38.601491 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-94a4ba0c-3c19-4b42-87de-3ae35f227dca\" (UniqueName: \"kubernetes.io/nfs/f96fe887-cdd2-4a7d-a6c8-73edad372029-pvc-94a4ba0c-3c19-4b42-87de-3ae35f227dca\") pod \"dw-deployment-wp8tc-5db7d8db57-5kxpw\" (UID: \"f96fe887-cdd2-4a7d-a6c8-73edad372029\") " pod="test-ns-jmkdx/dw-deployment-wp8tc-5db7d8db57-5kxpw" Nov 03 20:43:38.601606 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:38.601555 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4skd\" (UniqueName: \"kubernetes.io/projected/f96fe887-cdd2-4a7d-a6c8-73edad372029-kube-api-access-h4skd\") pod \"dw-deployment-wp8tc-5db7d8db57-5kxpw\" (UID: \"f96fe887-cdd2-4a7d-a6c8-73edad372029\") " pod="test-ns-jmkdx/dw-deployment-wp8tc-5db7d8db57-5kxpw" Nov 03 20:43:38.602014 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:38.601631 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/f96fe887-cdd2-4a7d-a6c8-73edad372029-notebook-config\") pod \"dw-deployment-wp8tc-5db7d8db57-5kxpw\" (UID: \"f96fe887-cdd2-4a7d-a6c8-73edad372029\") " pod="test-ns-jmkdx/dw-deployment-wp8tc-5db7d8db57-5kxpw" Nov 03 20:43:38.702819 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:38.702788 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4skd\" (UniqueName: \"kubernetes.io/projected/f96fe887-cdd2-4a7d-a6c8-73edad372029-kube-api-access-h4skd\") pod \"dw-deployment-wp8tc-5db7d8db57-5kxpw\" (UID: \"f96fe887-cdd2-4a7d-a6c8-73edad372029\") " pod="test-ns-jmkdx/dw-deployment-wp8tc-5db7d8db57-5kxpw" Nov 03 20:43:38.702999 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:38.702844 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/f96fe887-cdd2-4a7d-a6c8-73edad372029-notebook-config\") pod \"dw-deployment-wp8tc-5db7d8db57-5kxpw\" (UID: \"f96fe887-cdd2-4a7d-a6c8-73edad372029\") " pod="test-ns-jmkdx/dw-deployment-wp8tc-5db7d8db57-5kxpw" Nov 03 20:43:38.702999 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:38.702895 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-94a4ba0c-3c19-4b42-87de-3ae35f227dca\" (UniqueName: \"kubernetes.io/nfs/f96fe887-cdd2-4a7d-a6c8-73edad372029-pvc-94a4ba0c-3c19-4b42-87de-3ae35f227dca\") pod \"dw-deployment-wp8tc-5db7d8db57-5kxpw\" (UID: \"f96fe887-cdd2-4a7d-a6c8-73edad372029\") " pod="test-ns-jmkdx/dw-deployment-wp8tc-5db7d8db57-5kxpw" Nov 03 20:43:38.703719 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:38.703642 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/f96fe887-cdd2-4a7d-a6c8-73edad372029-notebook-config\") pod \"dw-deployment-wp8tc-5db7d8db57-5kxpw\" (UID: \"f96fe887-cdd2-4a7d-a6c8-73edad372029\") " pod="test-ns-jmkdx/dw-deployment-wp8tc-5db7d8db57-5kxpw" Nov 03 20:43:38.764161 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:38.764125 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4skd\" (UniqueName: \"kubernetes.io/projected/f96fe887-cdd2-4a7d-a6c8-73edad372029-kube-api-access-h4skd\") pod \"dw-deployment-wp8tc-5db7d8db57-5kxpw\" (UID: \"f96fe887-cdd2-4a7d-a6c8-73edad372029\") " pod="test-ns-jmkdx/dw-deployment-wp8tc-5db7d8db57-5kxpw" Nov 03 20:43:39.226550 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:39.226519 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-94a4ba0c-3c19-4b42-87de-3ae35f227dca\" (UniqueName: \"kubernetes.io/nfs/f96fe887-cdd2-4a7d-a6c8-73edad372029-pvc-94a4ba0c-3c19-4b42-87de-3ae35f227dca\") pod \"dw-deployment-wp8tc-5db7d8db57-5kxpw\" (UID: \"f96fe887-cdd2-4a7d-a6c8-73edad372029\") " pod="test-ns-jmkdx/dw-deployment-wp8tc-5db7d8db57-5kxpw" Nov 03 20:43:39.509875 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:39.509844 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-jmkdx/dw-deployment-wp8tc-5db7d8db57-5kxpw" Nov 03 20:43:39.890410 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:39.890287 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-jmkdx/dw-deployment-wp8tc-5db7d8db57-5kxpw"] Nov 03 20:43:39.893235 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:43:39.893204 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf96fe887_cdd2_4a7d_a6c8_73edad372029.slice/crio-a245ae061f5b8e182f995dd139289711a7615cf73d98442c5f8aeac6ee754f5c WatchSource:0}: Error finding container a245ae061f5b8e182f995dd139289711a7615cf73d98442c5f8aeac6ee754f5c: Status 404 returned error can't find the container with id a245ae061f5b8e182f995dd139289711a7615cf73d98442c5f8aeac6ee754f5c Nov 03 20:43:40.381951 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:40.381912 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-jmkdx/dw-deployment-wp8tc-5db7d8db57-5kxpw" event={"ID":"f96fe887-cdd2-4a7d-a6c8-73edad372029","Type":"ContainerStarted","Data":"a245ae061f5b8e182f995dd139289711a7615cf73d98442c5f8aeac6ee754f5c"} Nov 03 20:43:42.841268 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:42.841231 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-rzckn/test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s"] Nov 03 20:43:42.844983 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:42.844957 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-rzckn/test-trainjob-lnvrg-dataset-initializer-0-0-9ln9s"] Nov 03 20:43:42.851462 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:42.851440 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-rzckn/test-trainjob-lnvrg-model-initializer-0-0-dgdlq"] Nov 03 20:43:42.853836 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:42.853810 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-rzckn/test-trainjob-lnvrg-model-initializer-0-0-dgdlq"] Nov 03 20:43:42.859334 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:42.859309 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-rzckn/test-trainjob-lnvrg-node-0-0-nqh7l"] Nov 03 20:43:42.865708 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:42.865685 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-rzckn/test-trainjob-lnvrg-node-0-0-nqh7l"] Nov 03 20:43:44.573177 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:44.573137 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="45d3c988-cd59-427c-8b4c-ecedb259c432" path="/var/lib/kubelet/pods/45d3c988-cd59-427c-8b4c-ecedb259c432/volumes" Nov 03 20:43:44.573703 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:44.573585 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="68fe9447-6933-4854-9c02-5a02006d6df5" path="/var/lib/kubelet/pods/68fe9447-6933-4854-9c02-5a02006d6df5/volumes" Nov 03 20:43:44.573991 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:43:44.573969 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6ead5d88-3d79-4c5d-ad43-f815411f6aad" path="/var/lib/kubelet/pods/6ead5d88-3d79-4c5d-ad43-f815411f6aad/volumes" Nov 03 20:43:49.500518 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:43:49.500478 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:44:19.500343 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:44:19.500300 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:44:49.501922 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:44:49.501843 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:45:19.507050 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:45:19.506962 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:45:31.144832 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:31.144798 5857 scope.go:122] "RemoveContainer" containerID="331334e9ffb3c57e31a6d9b9fb7f019c9541139009f1f3525963129e1a3dcc97" Nov 03 20:45:31.155527 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:31.155507 5857 scope.go:122] "RemoveContainer" containerID="b8240833c3a76dff67acafa3958f5880ebb8c3174b89efda91d4abdc37b71535" Nov 03 20:45:32.986687 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:32.986646 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-jmkdx/dw-deployment-wp8tc-5db7d8db57-5kxpw" event={"ID":"f96fe887-cdd2-4a7d-a6c8-73edad372029","Type":"ContainerStarted","Data":"b3c0a39daab98be391a35ca617646036a2b34fd71b36ba36213d3497c490bf09"} Nov 03 20:45:33.115222 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:33.115125 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-jmkdx/dw-deployment-wp8tc-5db7d8db57-5kxpw" podStartSLOduration=2.168683614 podStartE2EDuration="1m55.11510742s" totalImagesPullingTime="1m52.946423806s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 20:43:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:45:33.113611299 +0000 UTC m=+2642.680501445" watchObservedRunningTime="2026-11-03 20:45:33.11510742 +0000 UTC m=+2642.681997561" Nov 03 20:45:33.958975 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:33.958948 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:45:34.864767 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:34.864739 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:45:35.025109 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:35.025078 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:45:36.091827 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:36.091793 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:45:37.158359 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:37.158329 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:45:37.864863 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:37.864834 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:45:38.225774 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:38.225745 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:45:39.292436 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:39.292405 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:45:40.359006 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:40.358980 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:45:40.864573 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:40.864528 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:45:41.426687 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:41.426656 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:45:42.493546 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:42.493512 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:45:43.560460 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:43.560421 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:45:43.864546 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:43.864470 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:45:44.627463 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:44.627433 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:45:45.695504 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:45.695471 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:45:46.762255 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:46.762221 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:45:46.865318 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:46.865287 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:45:47.829170 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:47.829145 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:45:48.896448 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:48.896420 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:45:49.500996 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:45:49.500956 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:45:49.865211 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:49.865131 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:45:50.011225 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:50.011194 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:45:51.087218 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:51.087107 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:45:51.632050 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:51.205431 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-jmkdx/d51254f1a0da-node-0-0-tgkdg"] Nov 03 20:45:51.632149 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:51.632098 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-jmkdx/d51254f1a0da-node-0-0-tgkdg" Nov 03 20:45:51.632149 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:51.632120 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-jmkdx/d51254f1a0da-node-0-0-tgkdg"] Nov 03 20:45:51.632222 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:51.632167 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-jmkdx/d51254f1a0da-node-0-1-2mwxg"] Nov 03 20:45:51.649014 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:51.648991 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-jmkdx/d51254f1a0da-node-0-1-2mwxg"] Nov 03 20:45:51.649132 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:51.649079 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-jmkdx/d51254f1a0da-node-0-1-2mwxg" Nov 03 20:45:51.772750 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:51.772721 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7nqf\" (UniqueName: \"kubernetes.io/projected/3542d2de-71f4-4ee9-be53-c2c5409d294d-kube-api-access-s7nqf\") pod \"d51254f1a0da-node-0-0-tgkdg\" (UID: \"3542d2de-71f4-4ee9-be53-c2c5409d294d\") " pod="test-ns-jmkdx/d51254f1a0da-node-0-0-tgkdg" Nov 03 20:45:51.772944 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:51.772852 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-94a4ba0c-3c19-4b42-87de-3ae35f227dca\" (UniqueName: \"kubernetes.io/nfs/3542d2de-71f4-4ee9-be53-c2c5409d294d-pvc-94a4ba0c-3c19-4b42-87de-3ae35f227dca\") pod \"d51254f1a0da-node-0-0-tgkdg\" (UID: \"3542d2de-71f4-4ee9-be53-c2c5409d294d\") " pod="test-ns-jmkdx/d51254f1a0da-node-0-0-tgkdg" Nov 03 20:45:51.873542 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:51.873505 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhrvw\" (UniqueName: \"kubernetes.io/projected/f62433c5-c958-49f9-9e63-9d828a85f40e-kube-api-access-jhrvw\") pod \"d51254f1a0da-node-0-1-2mwxg\" (UID: \"f62433c5-c958-49f9-9e63-9d828a85f40e\") " pod="test-ns-jmkdx/d51254f1a0da-node-0-1-2mwxg" Nov 03 20:45:51.873542 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:51.873556 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-94a4ba0c-3c19-4b42-87de-3ae35f227dca\" (UniqueName: \"kubernetes.io/nfs/3542d2de-71f4-4ee9-be53-c2c5409d294d-pvc-94a4ba0c-3c19-4b42-87de-3ae35f227dca\") pod \"d51254f1a0da-node-0-0-tgkdg\" (UID: \"3542d2de-71f4-4ee9-be53-c2c5409d294d\") " pod="test-ns-jmkdx/d51254f1a0da-node-0-0-tgkdg" Nov 03 20:45:51.873797 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:51.873716 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-94a4ba0c-3c19-4b42-87de-3ae35f227dca\" (UniqueName: \"kubernetes.io/nfs/f62433c5-c958-49f9-9e63-9d828a85f40e-pvc-94a4ba0c-3c19-4b42-87de-3ae35f227dca\") pod \"d51254f1a0da-node-0-1-2mwxg\" (UID: \"f62433c5-c958-49f9-9e63-9d828a85f40e\") " pod="test-ns-jmkdx/d51254f1a0da-node-0-1-2mwxg" Nov 03 20:45:51.873797 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:51.873781 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7nqf\" (UniqueName: \"kubernetes.io/projected/3542d2de-71f4-4ee9-be53-c2c5409d294d-kube-api-access-s7nqf\") pod \"d51254f1a0da-node-0-0-tgkdg\" (UID: \"3542d2de-71f4-4ee9-be53-c2c5409d294d\") " pod="test-ns-jmkdx/d51254f1a0da-node-0-0-tgkdg" Nov 03 20:45:51.911504 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:51.911439 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-94a4ba0c-3c19-4b42-87de-3ae35f227dca\" (UniqueName: \"kubernetes.io/nfs/3542d2de-71f4-4ee9-be53-c2c5409d294d-pvc-94a4ba0c-3c19-4b42-87de-3ae35f227dca\") pod \"d51254f1a0da-node-0-0-tgkdg\" (UID: \"3542d2de-71f4-4ee9-be53-c2c5409d294d\") " pod="test-ns-jmkdx/d51254f1a0da-node-0-0-tgkdg" Nov 03 20:45:51.934672 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:51.934644 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7nqf\" (UniqueName: \"kubernetes.io/projected/3542d2de-71f4-4ee9-be53-c2c5409d294d-kube-api-access-s7nqf\") pod \"d51254f1a0da-node-0-0-tgkdg\" (UID: \"3542d2de-71f4-4ee9-be53-c2c5409d294d\") " pod="test-ns-jmkdx/d51254f1a0da-node-0-0-tgkdg" Nov 03 20:45:51.956297 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:51.956266 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-jmkdx/d51254f1a0da-node-0-0-tgkdg" Nov 03 20:45:51.974462 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:51.974434 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-94a4ba0c-3c19-4b42-87de-3ae35f227dca\" (UniqueName: \"kubernetes.io/nfs/f62433c5-c958-49f9-9e63-9d828a85f40e-pvc-94a4ba0c-3c19-4b42-87de-3ae35f227dca\") pod \"d51254f1a0da-node-0-1-2mwxg\" (UID: \"f62433c5-c958-49f9-9e63-9d828a85f40e\") " pod="test-ns-jmkdx/d51254f1a0da-node-0-1-2mwxg" Nov 03 20:45:51.974642 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:51.974518 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhrvw\" (UniqueName: \"kubernetes.io/projected/f62433c5-c958-49f9-9e63-9d828a85f40e-kube-api-access-jhrvw\") pod \"d51254f1a0da-node-0-1-2mwxg\" (UID: \"f62433c5-c958-49f9-9e63-9d828a85f40e\") " pod="test-ns-jmkdx/d51254f1a0da-node-0-1-2mwxg" Nov 03 20:45:52.011525 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:52.011491 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-94a4ba0c-3c19-4b42-87de-3ae35f227dca\" (UniqueName: \"kubernetes.io/nfs/f62433c5-c958-49f9-9e63-9d828a85f40e-pvc-94a4ba0c-3c19-4b42-87de-3ae35f227dca\") pod \"d51254f1a0da-node-0-1-2mwxg\" (UID: \"f62433c5-c958-49f9-9e63-9d828a85f40e\") " pod="test-ns-jmkdx/d51254f1a0da-node-0-1-2mwxg" Nov 03 20:45:52.036231 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:52.036204 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhrvw\" (UniqueName: \"kubernetes.io/projected/f62433c5-c958-49f9-9e63-9d828a85f40e-kube-api-access-jhrvw\") pod \"d51254f1a0da-node-0-1-2mwxg\" (UID: \"f62433c5-c958-49f9-9e63-9d828a85f40e\") " pod="test-ns-jmkdx/d51254f1a0da-node-0-1-2mwxg" Nov 03 20:45:52.202717 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:52.202694 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:45:52.285678 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:52.285644 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-jmkdx/d51254f1a0da-node-0-1-2mwxg" Nov 03 20:45:52.455173 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:52.455093 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-jmkdx/d51254f1a0da-node-0-0-tgkdg"] Nov 03 20:45:52.457944 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:45:52.457917 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3542d2de_71f4_4ee9_be53_c2c5409d294d.slice/crio-d03a38268b8fb25cea92b2deec22b6738b0a662afa58f9231e6b341403ca4708 WatchSource:0}: Error finding container d03a38268b8fb25cea92b2deec22b6738b0a662afa58f9231e6b341403ca4708: Status 404 returned error can't find the container with id d03a38268b8fb25cea92b2deec22b6738b0a662afa58f9231e6b341403ca4708 Nov 03 20:45:52.683080 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:52.683027 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-jmkdx/d51254f1a0da-node-0-1-2mwxg"] Nov 03 20:45:52.685437 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:45:52.685407 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf62433c5_c958_49f9_9e63_9d828a85f40e.slice/crio-3273e0d40c10d7cb4a297be05b19b84e8a80e66c0a75014d3c01b2abfb37abc6 WatchSource:0}: Error finding container 3273e0d40c10d7cb4a297be05b19b84e8a80e66c0a75014d3c01b2abfb37abc6: Status 404 returned error can't find the container with id 3273e0d40c10d7cb4a297be05b19b84e8a80e66c0a75014d3c01b2abfb37abc6 Nov 03 20:45:53.013544 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:53.013464 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:45:53.085956 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:53.085916 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-jmkdx/d51254f1a0da-node-0-0-tgkdg" event={"ID":"3542d2de-71f4-4ee9-be53-c2c5409d294d","Type":"ContainerStarted","Data":"9d3ad4d61f24a66ac57d6a9ffa97d70663e912052c42fe08ce1c8446508e3d7a"} Nov 03 20:45:53.086170 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:53.085979 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-jmkdx/d51254f1a0da-node-0-0-tgkdg" event={"ID":"3542d2de-71f4-4ee9-be53-c2c5409d294d","Type":"ContainerStarted","Data":"d03a38268b8fb25cea92b2deec22b6738b0a662afa58f9231e6b341403ca4708"} Nov 03 20:45:53.087615 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:53.087590 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-jmkdx/d51254f1a0da-node-0-1-2mwxg" event={"ID":"f62433c5-c958-49f9-9e63-9d828a85f40e","Type":"ContainerStarted","Data":"4018f4af4ea9edc07d2028f0837e44e5169a9570b11e21963804b57aab46a7dc"} Nov 03 20:45:53.087734 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:53.087631 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-jmkdx/d51254f1a0da-node-0-1-2mwxg" event={"ID":"f62433c5-c958-49f9-9e63-9d828a85f40e","Type":"ContainerStarted","Data":"3273e0d40c10d7cb4a297be05b19b84e8a80e66c0a75014d3c01b2abfb37abc6"} Nov 03 20:45:53.208582 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:53.207948 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-jmkdx/d51254f1a0da-node-0-0-tgkdg" podStartSLOduration=3.207749877 podStartE2EDuration="3.207749877s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 20:45:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:45:53.202956312 +0000 UTC m=+2662.769846461" watchObservedRunningTime="2026-11-03 20:45:53.207749877 +0000 UTC m=+2662.774640027" Nov 03 20:45:53.320536 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:53.320414 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-jmkdx/d51254f1a0da-node-0-1-2mwxg" podStartSLOduration=2.3203852019999998 podStartE2EDuration="2.320385202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 20:45:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:45:53.319361238 +0000 UTC m=+2662.886251388" watchObservedRunningTime="2026-11-03 20:45:53.320385202 +0000 UTC m=+2662.887275354" Nov 03 20:45:53.322956 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:53.322924 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:45:54.410858 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:54.410829 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:45:55.527642 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:55.527607 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:45:55.877129 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:55.877053 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_d51254f1a0da-node-0-0-tgkdg_3542d2de-71f4-4ee9-be53-c2c5409d294d/node/0.log" Nov 03 20:45:55.944010 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:55.943986 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_d51254f1a0da-node-0-1-2mwxg_f62433c5-c958-49f9-9e63-9d828a85f40e/node/0.log" Nov 03 20:45:56.012238 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:56.012203 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:45:56.645233 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:56.645207 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:45:57.761978 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:57.761944 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:45:58.877394 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:58.877348 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_d51254f1a0da-node-0-0-tgkdg_3542d2de-71f4-4ee9-be53-c2c5409d294d/node/0.log" Nov 03 20:45:58.879823 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:58.879790 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:45:58.945698 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:58.945603 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_d51254f1a0da-node-0-1-2mwxg_f62433c5-c958-49f9-9e63-9d828a85f40e/node/0.log" Nov 03 20:45:59.015612 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:59.015575 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:45:59.995821 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:45:59.995785 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:01.124345 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:01.124309 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:01.877762 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:01.877730 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_d51254f1a0da-node-0-0-tgkdg_3542d2de-71f4-4ee9-be53-c2c5409d294d/node/0.log" Nov 03 20:46:01.945889 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:01.945855 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_d51254f1a0da-node-0-1-2mwxg_f62433c5-c958-49f9-9e63-9d828a85f40e/node/0.log" Nov 03 20:46:02.015363 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:02.015331 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:02.242180 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:02.242148 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:03.310877 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:03.310846 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:04.439580 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:04.439534 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:04.885283 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:04.885246 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_d51254f1a0da-node-0-0-tgkdg_3542d2de-71f4-4ee9-be53-c2c5409d294d/node/0.log" Nov 03 20:46:04.964981 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:04.964954 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_d51254f1a0da-node-0-1-2mwxg_f62433c5-c958-49f9-9e63-9d828a85f40e/node/0.log" Nov 03 20:46:05.056646 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:05.056612 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:05.577459 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:05.577417 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:06.706548 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:06.706508 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:07.834555 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:07.834516 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:07.877222 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:07.877193 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_d51254f1a0da-node-0-0-tgkdg_3542d2de-71f4-4ee9-be53-c2c5409d294d/node/0.log" Nov 03 20:46:07.948846 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:07.948804 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_d51254f1a0da-node-0-1-2mwxg_f62433c5-c958-49f9-9e63-9d828a85f40e/node/0.log" Nov 03 20:46:08.017857 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:08.017825 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:08.951195 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:08.951155 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:10.078933 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:10.078900 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:10.877696 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:10.877657 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_d51254f1a0da-node-0-0-tgkdg_3542d2de-71f4-4ee9-be53-c2c5409d294d/node/0.log" Nov 03 20:46:10.944477 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:10.944444 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_d51254f1a0da-node-0-1-2mwxg_f62433c5-c958-49f9-9e63-9d828a85f40e/node/0.log" Nov 03 20:46:11.014291 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:11.014244 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:11.207943 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:11.207906 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:12.325139 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:12.325098 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:13.451635 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:13.451596 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:13.877541 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:13.877507 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_d51254f1a0da-node-0-0-tgkdg_3542d2de-71f4-4ee9-be53-c2c5409d294d/node/0.log" Nov 03 20:46:13.943992 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:13.943962 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_d51254f1a0da-node-0-1-2mwxg_f62433c5-c958-49f9-9e63-9d828a85f40e/node/0.log" Nov 03 20:46:14.012422 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:14.012385 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:14.582716 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:14.582676 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:15.700163 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:15.700086 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:16.828933 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:16.828894 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:16.877181 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:16.877158 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_d51254f1a0da-node-0-0-tgkdg_3542d2de-71f4-4ee9-be53-c2c5409d294d/node/0.log" Nov 03 20:46:16.944328 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:16.944290 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_d51254f1a0da-node-0-1-2mwxg_f62433c5-c958-49f9-9e63-9d828a85f40e/node/0.log" Nov 03 20:46:17.015784 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:17.015752 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:17.949227 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:17.949185 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:19.074735 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:19.074696 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:19.521676 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:46:19.521631 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:46:19.879262 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:19.879172 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_d51254f1a0da-node-0-0-tgkdg_3542d2de-71f4-4ee9-be53-c2c5409d294d/node/0.log" Nov 03 20:46:19.946401 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:19.946369 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_d51254f1a0da-node-0-1-2mwxg_f62433c5-c958-49f9-9e63-9d828a85f40e/node/0.log" Nov 03 20:46:20.017614 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:20.017558 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:20.236554 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:20.236505 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:21.355687 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:21.355642 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:22.517534 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:22.517479 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:22.878195 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:22.878096 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_d51254f1a0da-node-0-0-tgkdg_3542d2de-71f4-4ee9-be53-c2c5409d294d/node/0.log" Nov 03 20:46:22.946110 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:22.946070 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_d51254f1a0da-node-0-1-2mwxg_f62433c5-c958-49f9-9e63-9d828a85f40e/node/0.log" Nov 03 20:46:23.017844 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:23.017806 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:23.684093 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:23.684060 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:24.811930 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:24.811872 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:25.877946 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:25.877916 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_d51254f1a0da-node-0-0-tgkdg_3542d2de-71f4-4ee9-be53-c2c5409d294d/node/0.log" Nov 03 20:46:25.977014 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:25.976973 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:25.992866 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:25.992831 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_d51254f1a0da-node-0-1-2mwxg_f62433c5-c958-49f9-9e63-9d828a85f40e/node/0.log" Nov 03 20:46:26.094355 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:26.094324 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:27.096920 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:27.096857 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:28.261925 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:28.261891 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:28.877860 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:28.877831 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_d51254f1a0da-node-0-0-tgkdg_3542d2de-71f4-4ee9-be53-c2c5409d294d/node/0.log" Nov 03 20:46:28.945058 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:28.945023 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_d51254f1a0da-node-0-1-2mwxg_f62433c5-c958-49f9-9e63-9d828a85f40e/node/0.log" Nov 03 20:46:29.016106 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:29.016069 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:29.427784 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:29.427748 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:30.543435 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:30.543402 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:31.197467 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:31.197433 5857 scope.go:122] "RemoveContainer" containerID="f5ad70a1821959f71ca6384106c5b6de370590afbfb9d2943e0ab64b25c99173" Nov 03 20:46:31.357217 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:31.357185 5857 generic.go:356] "Generic (PLEG): container finished" podID="f62433c5-c958-49f9-9e63-9d828a85f40e" containerID="4018f4af4ea9edc07d2028f0837e44e5169a9570b11e21963804b57aab46a7dc" exitCode=0 Nov 03 20:46:31.357419 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:31.357259 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-jmkdx/d51254f1a0da-node-0-1-2mwxg" event={"ID":"f62433c5-c958-49f9-9e63-9d828a85f40e","Type":"ContainerDied","Data":"4018f4af4ea9edc07d2028f0837e44e5169a9570b11e21963804b57aab46a7dc"} Nov 03 20:46:31.358960 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:31.358938 5857 generic.go:356] "Generic (PLEG): container finished" podID="3542d2de-71f4-4ee9-be53-c2c5409d294d" containerID="9d3ad4d61f24a66ac57d6a9ffa97d70663e912052c42fe08ce1c8446508e3d7a" exitCode=0 Nov 03 20:46:31.359070 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:31.359013 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-jmkdx/d51254f1a0da-node-0-0-tgkdg" event={"ID":"3542d2de-71f4-4ee9-be53-c2c5409d294d","Type":"ContainerDied","Data":"9d3ad4d61f24a66ac57d6a9ffa97d70663e912052c42fe08ce1c8446508e3d7a"} Nov 03 20:46:31.707127 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:31.707094 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:31.877112 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:31.877077 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_d51254f1a0da-node-0-0-tgkdg_3542d2de-71f4-4ee9-be53-c2c5409d294d/node/0.log" Nov 03 20:46:31.943674 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:31.943641 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_d51254f1a0da-node-0-1-2mwxg_f62433c5-c958-49f9-9e63-9d828a85f40e/node/0.log" Nov 03 20:46:32.012995 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:32.012919 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:32.520262 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:32.520236 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-jmkdx/d51254f1a0da-node-0-1-2mwxg" Nov 03 20:46:32.522862 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:32.522844 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-jmkdx/d51254f1a0da-node-0-0-tgkdg" Nov 03 20:46:32.677167 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:32.677073 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3542d2de-71f4-4ee9-be53-c2c5409d294d-kube-api-access-s7nqf\" (UniqueName: \"kubernetes.io/projected/3542d2de-71f4-4ee9-be53-c2c5409d294d-kube-api-access-s7nqf\") pod \"3542d2de-71f4-4ee9-be53-c2c5409d294d\" (UID: \"3542d2de-71f4-4ee9-be53-c2c5409d294d\") " Nov 03 20:46:32.677167 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:32.677138 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f62433c5-c958-49f9-9e63-9d828a85f40e-kube-api-access-jhrvw\" (UniqueName: \"kubernetes.io/projected/f62433c5-c958-49f9-9e63-9d828a85f40e-kube-api-access-jhrvw\") pod \"f62433c5-c958-49f9-9e63-9d828a85f40e\" (UID: \"f62433c5-c958-49f9-9e63-9d828a85f40e\") " Nov 03 20:46:32.677413 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:32.677194 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/nfs/3542d2de-71f4-4ee9-be53-c2c5409d294d-pvc-94a4ba0c-3c19-4b42-87de-3ae35f227dca\" (UniqueName: \"kubernetes.io/nfs/3542d2de-71f4-4ee9-be53-c2c5409d294d-pvc-94a4ba0c-3c19-4b42-87de-3ae35f227dca\") pod \"3542d2de-71f4-4ee9-be53-c2c5409d294d\" (UID: \"3542d2de-71f4-4ee9-be53-c2c5409d294d\") " Nov 03 20:46:32.677413 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:32.677233 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/nfs/f62433c5-c958-49f9-9e63-9d828a85f40e-pvc-94a4ba0c-3c19-4b42-87de-3ae35f227dca\" (UniqueName: \"kubernetes.io/nfs/f62433c5-c958-49f9-9e63-9d828a85f40e-pvc-94a4ba0c-3c19-4b42-87de-3ae35f227dca\") pod \"f62433c5-c958-49f9-9e63-9d828a85f40e\" (UID: \"f62433c5-c958-49f9-9e63-9d828a85f40e\") " Nov 03 20:46:32.679787 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:32.679752 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3542d2de-71f4-4ee9-be53-c2c5409d294d-kube-api-access-s7nqf" pod "3542d2de-71f4-4ee9-be53-c2c5409d294d" (UID: "3542d2de-71f4-4ee9-be53-c2c5409d294d"). InnerVolumeSpecName "kube-api-access-s7nqf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:46:32.679787 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:32.679775 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f62433c5-c958-49f9-9e63-9d828a85f40e-kube-api-access-jhrvw" pod "f62433c5-c958-49f9-9e63-9d828a85f40e" (UID: "f62433c5-c958-49f9-9e63-9d828a85f40e"). InnerVolumeSpecName "kube-api-access-jhrvw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:46:32.688273 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:32.688192 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/nfs/f62433c5-c958-49f9-9e63-9d828a85f40e-pvc-94a4ba0c-3c19-4b42-87de-3ae35f227dca" pod "f62433c5-c958-49f9-9e63-9d828a85f40e" (UID: "f62433c5-c958-49f9-9e63-9d828a85f40e"). InnerVolumeSpecName "pvc-94a4ba0c-3c19-4b42-87de-3ae35f227dca". PluginName "kubernetes.io/nfs", VolumeGIDValue "" Nov 03 20:46:32.688413 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:32.688341 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/nfs/3542d2de-71f4-4ee9-be53-c2c5409d294d-pvc-94a4ba0c-3c19-4b42-87de-3ae35f227dca" pod "3542d2de-71f4-4ee9-be53-c2c5409d294d" (UID: "3542d2de-71f4-4ee9-be53-c2c5409d294d"). InnerVolumeSpecName "pvc-94a4ba0c-3c19-4b42-87de-3ae35f227dca". PluginName "kubernetes.io/nfs", VolumeGIDValue "" Nov 03 20:46:32.779357 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:32.779322 5857 reconciler_common.go:299] "Volume detached for volume \"pvc-94a4ba0c-3c19-4b42-87de-3ae35f227dca\" (UniqueName: \"kubernetes.io/nfs/3542d2de-71f4-4ee9-be53-c2c5409d294d-pvc-94a4ba0c-3c19-4b42-87de-3ae35f227dca\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:46:32.779357 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:32.779354 5857 reconciler_common.go:299] "Volume detached for volume \"pvc-94a4ba0c-3c19-4b42-87de-3ae35f227dca\" (UniqueName: \"kubernetes.io/nfs/f62433c5-c958-49f9-9e63-9d828a85f40e-pvc-94a4ba0c-3c19-4b42-87de-3ae35f227dca\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:46:32.779357 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:32.779365 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7nqf\" (UniqueName: \"kubernetes.io/projected/3542d2de-71f4-4ee9-be53-c2c5409d294d-kube-api-access-s7nqf\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:46:32.779357 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:32.779374 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhrvw\" (UniqueName: \"kubernetes.io/projected/f62433c5-c958-49f9-9e63-9d828a85f40e-kube-api-access-jhrvw\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:46:32.880466 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:32.880432 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:33.369988 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:33.369953 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-jmkdx/d51254f1a0da-node-0-0-tgkdg" Nov 03 20:46:33.370169 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:33.370004 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-jmkdx/d51254f1a0da-node-0-0-tgkdg" event={"ID":"3542d2de-71f4-4ee9-be53-c2c5409d294d","Type":"ContainerDied","Data":"d03a38268b8fb25cea92b2deec22b6738b0a662afa58f9231e6b341403ca4708"} Nov 03 20:46:33.370169 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:33.370054 5857 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d03a38268b8fb25cea92b2deec22b6738b0a662afa58f9231e6b341403ca4708" Nov 03 20:46:33.371370 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:33.371350 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-jmkdx/d51254f1a0da-node-0-1-2mwxg" event={"ID":"f62433c5-c958-49f9-9e63-9d828a85f40e","Type":"ContainerDied","Data":"3273e0d40c10d7cb4a297be05b19b84e8a80e66c0a75014d3c01b2abfb37abc6"} Nov 03 20:46:33.371486 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:33.371381 5857 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3273e0d40c10d7cb4a297be05b19b84e8a80e66c0a75014d3c01b2abfb37abc6" Nov 03 20:46:33.371486 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:33.371390 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-jmkdx/d51254f1a0da-node-0-1-2mwxg" Nov 03 20:46:34.048708 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:34.048684 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:34.878593 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:34.878513 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_d51254f1a0da-node-0-0-tgkdg_3542d2de-71f4-4ee9-be53-c2c5409d294d/node/0.log" Nov 03 20:46:34.993622 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:34.993525 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_d51254f1a0da-node-0-1-2mwxg_f62433c5-c958-49f9-9e63-9d828a85f40e/node/0.log" Nov 03 20:46:35.062549 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:35.062522 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:35.214390 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:35.214343 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:36.283395 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:36.283339 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:36.807938 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:36.807907 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_d51254f1a0da-node-0-0-tgkdg_3542d2de-71f4-4ee9-be53-c2c5409d294d/node/0.log" Nov 03 20:46:37.449553 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:37.449517 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:37.583809 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:37.583767 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-jmkdx/d51254f1a0da-node-0-1-2mwxg"] Nov 03 20:46:37.633457 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:37.633419 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-jmkdx/d51254f1a0da-node-0-0-tgkdg"] Nov 03 20:46:37.634609 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:37.634583 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-jmkdx/d51254f1a0da-node-0-1-2mwxg"] Nov 03 20:46:37.683047 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:37.683009 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-jmkdx/d51254f1a0da-node-0-0-tgkdg"] Nov 03 20:46:37.869274 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:37.869197 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:38.567892 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:38.567861 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:38.572334 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:38.572309 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3542d2de-71f4-4ee9-be53-c2c5409d294d" path="/var/lib/kubelet/pods/3542d2de-71f4-4ee9-be53-c2c5409d294d/volumes" Nov 03 20:46:38.572680 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:38.572666 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f62433c5-c958-49f9-9e63-9d828a85f40e" path="/var/lib/kubelet/pods/f62433c5-c958-49f9-9e63-9d828a85f40e/volumes" Nov 03 20:46:38.700790 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:38.700751 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-jmkdx/dw-deployment-wp8tc-5db7d8db57-5kxpw"] Nov 03 20:46:38.701040 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:38.701016 5857 kuberuntime_container.go:898] "Killing container with a grace period" pod="test-ns-jmkdx/dw-deployment-wp8tc-5db7d8db57-5kxpw" podUID="f96fe887-cdd2-4a7d-a6c8-73edad372029" containerName="notebook" containerID="cri-o://b3c0a39daab98be391a35ca617646036a2b34fd71b36ba36213d3497c490bf09" gracePeriod=30 Nov 03 20:46:38.763543 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:38.763512 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jmkdx_dw-deployment-wp8tc-5db7d8db57-5kxpw_f96fe887-cdd2-4a7d-a6c8-73edad372029/notebook/0.log" Nov 03 20:46:41.457313 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:41.457285 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-s4x69/dw-deployment-7bcjc-bbb97867b-tjc26"] Nov 03 20:46:41.457702 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:41.457639 5857 cpu_manager.go:414] "containerMap: removing container" podUID="f62433c5-c958-49f9-9e63-9d828a85f40e" containerName="node" Nov 03 20:46:41.457702 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:41.457651 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f62433c5-c958-49f9-9e63-9d828a85f40e" containerName="node" Nov 03 20:46:41.457702 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:41.457677 5857 cpu_manager.go:414] "containerMap: removing container" podUID="3542d2de-71f4-4ee9-be53-c2c5409d294d" containerName="node" Nov 03 20:46:41.457702 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:41.457681 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3542d2de-71f4-4ee9-be53-c2c5409d294d" containerName="node" Nov 03 20:46:41.457846 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:41.457742 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="f62433c5-c958-49f9-9e63-9d828a85f40e" containerName="node" Nov 03 20:46:41.457846 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:41.457753 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="3542d2de-71f4-4ee9-be53-c2c5409d294d" containerName="node" Nov 03 20:46:41.460200 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:41.460184 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-s4x69/dw-deployment-7bcjc-bbb97867b-tjc26" Nov 03 20:46:41.561818 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:41.561778 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-s4x69\"/\"openshift-service-ca.crt\"" Nov 03 20:46:41.561976 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:41.561906 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-s4x69\"/\"default-dockercfg-425lk\"" Nov 03 20:46:41.611583 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:41.611536 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-s4x69\"/\"kube-root-ca.crt\"" Nov 03 20:46:41.611790 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:41.611587 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-s4x69\"/\"config-rds4r\"" Nov 03 20:46:41.613062 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:41.613042 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-s4x69/dw-deployment-7bcjc-bbb97867b-tjc26"] Nov 03 20:46:41.758206 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:41.758131 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-ab912cb9-553f-4961-86b3-a734ccb9f600\" (UniqueName: \"kubernetes.io/nfs/aebf9ebb-3588-4f55-b363-4694a5b6ad2f-pvc-ab912cb9-553f-4961-86b3-a734ccb9f600\") pod \"dw-deployment-7bcjc-bbb97867b-tjc26\" (UID: \"aebf9ebb-3588-4f55-b363-4694a5b6ad2f\") " pod="test-ns-s4x69/dw-deployment-7bcjc-bbb97867b-tjc26" Nov 03 20:46:41.758206 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:41.758175 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/aebf9ebb-3588-4f55-b363-4694a5b6ad2f-notebook-config\") pod \"dw-deployment-7bcjc-bbb97867b-tjc26\" (UID: \"aebf9ebb-3588-4f55-b363-4694a5b6ad2f\") " pod="test-ns-s4x69/dw-deployment-7bcjc-bbb97867b-tjc26" Nov 03 20:46:41.758386 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:41.758228 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lblvv\" (UniqueName: \"kubernetes.io/projected/aebf9ebb-3588-4f55-b363-4694a5b6ad2f-kube-api-access-lblvv\") pod \"dw-deployment-7bcjc-bbb97867b-tjc26\" (UID: \"aebf9ebb-3588-4f55-b363-4694a5b6ad2f\") " pod="test-ns-s4x69/dw-deployment-7bcjc-bbb97867b-tjc26" Nov 03 20:46:41.859384 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:41.859345 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-ab912cb9-553f-4961-86b3-a734ccb9f600\" (UniqueName: \"kubernetes.io/nfs/aebf9ebb-3588-4f55-b363-4694a5b6ad2f-pvc-ab912cb9-553f-4961-86b3-a734ccb9f600\") pod \"dw-deployment-7bcjc-bbb97867b-tjc26\" (UID: \"aebf9ebb-3588-4f55-b363-4694a5b6ad2f\") " pod="test-ns-s4x69/dw-deployment-7bcjc-bbb97867b-tjc26" Nov 03 20:46:41.859557 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:41.859390 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/aebf9ebb-3588-4f55-b363-4694a5b6ad2f-notebook-config\") pod \"dw-deployment-7bcjc-bbb97867b-tjc26\" (UID: \"aebf9ebb-3588-4f55-b363-4694a5b6ad2f\") " pod="test-ns-s4x69/dw-deployment-7bcjc-bbb97867b-tjc26" Nov 03 20:46:41.859557 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:41.859450 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lblvv\" (UniqueName: \"kubernetes.io/projected/aebf9ebb-3588-4f55-b363-4694a5b6ad2f-kube-api-access-lblvv\") pod \"dw-deployment-7bcjc-bbb97867b-tjc26\" (UID: \"aebf9ebb-3588-4f55-b363-4694a5b6ad2f\") " pod="test-ns-s4x69/dw-deployment-7bcjc-bbb97867b-tjc26" Nov 03 20:46:41.860291 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:41.860266 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/aebf9ebb-3588-4f55-b363-4694a5b6ad2f-notebook-config\") pod \"dw-deployment-7bcjc-bbb97867b-tjc26\" (UID: \"aebf9ebb-3588-4f55-b363-4694a5b6ad2f\") " pod="test-ns-s4x69/dw-deployment-7bcjc-bbb97867b-tjc26" Nov 03 20:46:41.887500 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:41.887463 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-ab912cb9-553f-4961-86b3-a734ccb9f600\" (UniqueName: \"kubernetes.io/nfs/aebf9ebb-3588-4f55-b363-4694a5b6ad2f-pvc-ab912cb9-553f-4961-86b3-a734ccb9f600\") pod \"dw-deployment-7bcjc-bbb97867b-tjc26\" (UID: \"aebf9ebb-3588-4f55-b363-4694a5b6ad2f\") " pod="test-ns-s4x69/dw-deployment-7bcjc-bbb97867b-tjc26" Nov 03 20:46:41.920373 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:41.920347 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lblvv\" (UniqueName: \"kubernetes.io/projected/aebf9ebb-3588-4f55-b363-4694a5b6ad2f-kube-api-access-lblvv\") pod \"dw-deployment-7bcjc-bbb97867b-tjc26\" (UID: \"aebf9ebb-3588-4f55-b363-4694a5b6ad2f\") " pod="test-ns-s4x69/dw-deployment-7bcjc-bbb97867b-tjc26" Nov 03 20:46:42.071346 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:42.071275 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-s4x69/dw-deployment-7bcjc-bbb97867b-tjc26" Nov 03 20:46:42.446602 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:42.446505 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-s4x69/dw-deployment-7bcjc-bbb97867b-tjc26"] Nov 03 20:46:42.449497 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:46:42.449472 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaebf9ebb_3588_4f55_b363_4694a5b6ad2f.slice/crio-ddd7a1208d7bcb6f66e11f3713660341b31c143979e7cb79da3b509900d9e2fe WatchSource:0}: Error finding container ddd7a1208d7bcb6f66e11f3713660341b31c143979e7cb79da3b509900d9e2fe: Status 404 returned error can't find the container with id ddd7a1208d7bcb6f66e11f3713660341b31c143979e7cb79da3b509900d9e2fe Nov 03 20:46:42.450932 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:42.450912 5857 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 03 20:46:43.422104 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:43.422076 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-s4x69/dw-deployment-7bcjc-bbb97867b-tjc26" event={"ID":"aebf9ebb-3588-4f55-b363-4694a5b6ad2f","Type":"ContainerStarted","Data":"ddd7a1208d7bcb6f66e11f3713660341b31c143979e7cb79da3b509900d9e2fe"} Nov 03 20:46:44.429102 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:44.429066 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-s4x69/dw-deployment-7bcjc-bbb97867b-tjc26" event={"ID":"aebf9ebb-3588-4f55-b363-4694a5b6ad2f","Type":"ContainerStarted","Data":"401571b5571de4942724fa1a9c4c5196cf65d308ca8259f9c52b10c92d4c3afb"} Nov 03 20:46:44.546925 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:44.546875 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-s4x69/dw-deployment-7bcjc-bbb97867b-tjc26" podStartSLOduration=3.632309102 podStartE2EDuration="4.546860792s" totalImagesPullingTime="914.55169ms" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 20:46:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:46:44.545363236 +0000 UTC m=+2714.112253385" watchObservedRunningTime="2026-11-03 20:46:44.546860792 +0000 UTC m=+2714.113750939" Nov 03 20:46:44.961317 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:44.961293 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:46:47.961600 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:47.961542 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:46:49.500832 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:46:49.500789 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:46:50.961035 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:50.961001 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:46:53.961913 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:53.961878 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:46:57.037308 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:57.037278 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:46:57.642480 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:57.642445 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:46:58.375847 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:58.375809 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-s4x69/g7e74f20511e-node-0-0-5k77l"] Nov 03 20:46:58.378625 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:58.378606 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-s4x69/g7e74f20511e-node-0-0-5k77l" Nov 03 20:46:58.483664 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:58.483635 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-s4x69/g7e74f20511e-node-0-0-5k77l"] Nov 03 20:46:58.552810 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:58.552776 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-s4x69/g7e74f20511e-node-0-1-4bj4g"] Nov 03 20:46:58.554979 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:58.554949 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-s4x69/g7e74f20511e-node-0-1-4bj4g" Nov 03 20:46:58.604121 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:58.604089 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-ab912cb9-553f-4961-86b3-a734ccb9f600\" (UniqueName: \"kubernetes.io/nfs/6b4b1861-ae78-4ea5-861c-433d68685b89-pvc-ab912cb9-553f-4961-86b3-a734ccb9f600\") pod \"g7e74f20511e-node-0-0-5k77l\" (UID: \"6b4b1861-ae78-4ea5-861c-433d68685b89\") " pod="test-ns-s4x69/g7e74f20511e-node-0-0-5k77l" Nov 03 20:46:58.604286 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:58.604129 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfks4\" (UniqueName: \"kubernetes.io/projected/6b4b1861-ae78-4ea5-861c-433d68685b89-kube-api-access-jfks4\") pod \"g7e74f20511e-node-0-0-5k77l\" (UID: \"6b4b1861-ae78-4ea5-861c-433d68685b89\") " pod="test-ns-s4x69/g7e74f20511e-node-0-0-5k77l" Nov 03 20:46:58.616591 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:58.616547 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-s4x69/g7e74f20511e-node-0-1-4bj4g"] Nov 03 20:46:58.705083 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:58.705049 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-ab912cb9-553f-4961-86b3-a734ccb9f600\" (UniqueName: \"kubernetes.io/nfs/6b4b1861-ae78-4ea5-861c-433d68685b89-pvc-ab912cb9-553f-4961-86b3-a734ccb9f600\") pod \"g7e74f20511e-node-0-0-5k77l\" (UID: \"6b4b1861-ae78-4ea5-861c-433d68685b89\") " pod="test-ns-s4x69/g7e74f20511e-node-0-0-5k77l" Nov 03 20:46:58.705083 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:58.705087 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfks4\" (UniqueName: \"kubernetes.io/projected/6b4b1861-ae78-4ea5-861c-433d68685b89-kube-api-access-jfks4\") pod \"g7e74f20511e-node-0-0-5k77l\" (UID: \"6b4b1861-ae78-4ea5-861c-433d68685b89\") " pod="test-ns-s4x69/g7e74f20511e-node-0-0-5k77l" Nov 03 20:46:58.710330 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:58.710303 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:46:58.741412 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:58.741378 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-ab912cb9-553f-4961-86b3-a734ccb9f600\" (UniqueName: \"kubernetes.io/nfs/6b4b1861-ae78-4ea5-861c-433d68685b89-pvc-ab912cb9-553f-4961-86b3-a734ccb9f600\") pod \"g7e74f20511e-node-0-0-5k77l\" (UID: \"6b4b1861-ae78-4ea5-861c-433d68685b89\") " pod="test-ns-s4x69/g7e74f20511e-node-0-0-5k77l" Nov 03 20:46:58.766259 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:58.766228 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfks4\" (UniqueName: \"kubernetes.io/projected/6b4b1861-ae78-4ea5-861c-433d68685b89-kube-api-access-jfks4\") pod \"g7e74f20511e-node-0-0-5k77l\" (UID: \"6b4b1861-ae78-4ea5-861c-433d68685b89\") " pod="test-ns-s4x69/g7e74f20511e-node-0-0-5k77l" Nov 03 20:46:58.805987 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:58.805965 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5h2x\" (UniqueName: \"kubernetes.io/projected/8aaf1938-1597-4d90-a8d3-baa96036622d-kube-api-access-b5h2x\") pod \"g7e74f20511e-node-0-1-4bj4g\" (UID: \"8aaf1938-1597-4d90-a8d3-baa96036622d\") " pod="test-ns-s4x69/g7e74f20511e-node-0-1-4bj4g" Nov 03 20:46:58.806118 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:58.806004 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-ab912cb9-553f-4961-86b3-a734ccb9f600\" (UniqueName: \"kubernetes.io/nfs/8aaf1938-1597-4d90-a8d3-baa96036622d-pvc-ab912cb9-553f-4961-86b3-a734ccb9f600\") pod \"g7e74f20511e-node-0-1-4bj4g\" (UID: \"8aaf1938-1597-4d90-a8d3-baa96036622d\") " pod="test-ns-s4x69/g7e74f20511e-node-0-1-4bj4g" Nov 03 20:46:58.906589 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:58.906539 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5h2x\" (UniqueName: \"kubernetes.io/projected/8aaf1938-1597-4d90-a8d3-baa96036622d-kube-api-access-b5h2x\") pod \"g7e74f20511e-node-0-1-4bj4g\" (UID: \"8aaf1938-1597-4d90-a8d3-baa96036622d\") " pod="test-ns-s4x69/g7e74f20511e-node-0-1-4bj4g" Nov 03 20:46:58.906751 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:58.906618 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-ab912cb9-553f-4961-86b3-a734ccb9f600\" (UniqueName: \"kubernetes.io/nfs/8aaf1938-1597-4d90-a8d3-baa96036622d-pvc-ab912cb9-553f-4961-86b3-a734ccb9f600\") pod \"g7e74f20511e-node-0-1-4bj4g\" (UID: \"8aaf1938-1597-4d90-a8d3-baa96036622d\") " pod="test-ns-s4x69/g7e74f20511e-node-0-1-4bj4g" Nov 03 20:46:58.948369 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:58.948338 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-ab912cb9-553f-4961-86b3-a734ccb9f600\" (UniqueName: \"kubernetes.io/nfs/8aaf1938-1597-4d90-a8d3-baa96036622d-pvc-ab912cb9-553f-4961-86b3-a734ccb9f600\") pod \"g7e74f20511e-node-0-1-4bj4g\" (UID: \"8aaf1938-1597-4d90-a8d3-baa96036622d\") " pod="test-ns-s4x69/g7e74f20511e-node-0-1-4bj4g" Nov 03 20:46:58.968753 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:58.968701 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5h2x\" (UniqueName: \"kubernetes.io/projected/8aaf1938-1597-4d90-a8d3-baa96036622d-kube-api-access-b5h2x\") pod \"g7e74f20511e-node-0-1-4bj4g\" (UID: \"8aaf1938-1597-4d90-a8d3-baa96036622d\") " pod="test-ns-s4x69/g7e74f20511e-node-0-1-4bj4g" Nov 03 20:46:58.989648 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:58.989620 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-s4x69/g7e74f20511e-node-0-0-5k77l" Nov 03 20:46:59.166387 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:59.166352 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-s4x69/g7e74f20511e-node-0-1-4bj4g" Nov 03 20:46:59.463165 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:59.463131 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-s4x69/g7e74f20511e-node-0-0-5k77l"] Nov 03 20:46:59.502683 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:46:59.502645 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6b4b1861_ae78_4ea5_861c_433d68685b89.slice/crio-d2420587bb6a63beec5c95bdc305bdd28edfcff6f50fc607e5120a3d6d226207 WatchSource:0}: Error finding container d2420587bb6a63beec5c95bdc305bdd28edfcff6f50fc607e5120a3d6d226207: Status 404 returned error can't find the container with id d2420587bb6a63beec5c95bdc305bdd28edfcff6f50fc607e5120a3d6d226207 Nov 03 20:46:59.576315 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:59.576289 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-s4x69/g7e74f20511e-node-0-1-4bj4g"] Nov 03 20:46:59.579050 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:46:59.579030 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8aaf1938_1597_4d90_a8d3_baa96036622d.slice/crio-9f4cd0d9a3c98c0eddd5d521cab3011ab99f1f25df0e522c5a396e2ba25490ef WatchSource:0}: Error finding container 9f4cd0d9a3c98c0eddd5d521cab3011ab99f1f25df0e522c5a396e2ba25490ef: Status 404 returned error can't find the container with id 9f4cd0d9a3c98c0eddd5d521cab3011ab99f1f25df0e522c5a396e2ba25490ef Nov 03 20:46:59.778670 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:59.778508 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:46:59.982192 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:46:59.982146 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:00.511094 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:00.511064 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-s4x69/g7e74f20511e-node-0-1-4bj4g" event={"ID":"8aaf1938-1597-4d90-a8d3-baa96036622d","Type":"ContainerStarted","Data":"b5618cc8ae1d420da6aa6ec42a89caa406c1bc17431f7c26509ee8f33d0d912c"} Nov 03 20:47:00.511648 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:00.511624 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-s4x69/g7e74f20511e-node-0-1-4bj4g" event={"ID":"8aaf1938-1597-4d90-a8d3-baa96036622d","Type":"ContainerStarted","Data":"9f4cd0d9a3c98c0eddd5d521cab3011ab99f1f25df0e522c5a396e2ba25490ef"} Nov 03 20:47:00.512910 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:00.512882 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-s4x69/g7e74f20511e-node-0-0-5k77l" event={"ID":"6b4b1861-ae78-4ea5-861c-433d68685b89","Type":"ContainerStarted","Data":"a805cabb81f21323cd230cf6e75bdaddb4f9aea6a13ea76a0acca7b179003fd6"} Nov 03 20:47:00.513019 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:00.512935 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-s4x69/g7e74f20511e-node-0-0-5k77l" event={"ID":"6b4b1861-ae78-4ea5-861c-433d68685b89","Type":"ContainerStarted","Data":"d2420587bb6a63beec5c95bdc305bdd28edfcff6f50fc607e5120a3d6d226207"} Nov 03 20:47:00.638190 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:00.638124 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-s4x69/g7e74f20511e-node-0-1-4bj4g" podStartSLOduration=2.638104882 podStartE2EDuration="2.638104882s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 20:46:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:47:00.636031153 +0000 UTC m=+2730.202921505" watchObservedRunningTime="2026-11-03 20:47:00.638104882 +0000 UTC m=+2730.204995031" Nov 03 20:47:00.763322 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:00.763184 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-s4x69/g7e74f20511e-node-0-0-5k77l" podStartSLOduration=2.7631645689999997 podStartE2EDuration="2.763164569s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 20:46:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:47:00.763157154 +0000 UTC m=+2730.330047312" watchObservedRunningTime="2026-11-03 20:47:00.763164569 +0000 UTC m=+2730.330054718" Nov 03 20:47:00.897274 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:00.897242 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:02.015968 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:02.015896 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:02.976013 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:02.975970 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:03.090129 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:03.090074 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_g7e74f20511e-node-0-0-5k77l_6b4b1861-ae78-4ea5-861c-433d68685b89/node/0.log" Nov 03 20:47:03.132540 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:03.132504 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:03.157685 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:03.157656 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_g7e74f20511e-node-0-1-4bj4g_8aaf1938-1597-4d90-a8d3-baa96036622d/node/0.log" Nov 03 20:47:04.207784 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:04.207752 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:05.326224 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:05.326184 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:05.975857 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:05.975822 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:06.091134 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:06.091108 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_g7e74f20511e-node-0-0-5k77l_6b4b1861-ae78-4ea5-861c-433d68685b89/node/0.log" Nov 03 20:47:06.159308 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:06.159273 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_g7e74f20511e-node-0-1-4bj4g_8aaf1938-1597-4d90-a8d3-baa96036622d/node/0.log" Nov 03 20:47:06.454675 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:06.454634 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:07.570072 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:07.570041 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:08.689922 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:08.689878 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:08.975289 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:08.975217 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:08.977832 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:08.977803 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-jmkdx/dw-deployment-wp8tc-5db7d8db57-5kxpw" Nov 03 20:47:09.011021 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:09.010991 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/nfs/f96fe887-cdd2-4a7d-a6c8-73edad372029-pvc-94a4ba0c-3c19-4b42-87de-3ae35f227dca\" (UniqueName: \"kubernetes.io/nfs/f96fe887-cdd2-4a7d-a6c8-73edad372029-pvc-94a4ba0c-3c19-4b42-87de-3ae35f227dca\") pod \"f96fe887-cdd2-4a7d-a6c8-73edad372029\" (UID: \"f96fe887-cdd2-4a7d-a6c8-73edad372029\") " Nov 03 20:47:09.011196 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:09.011093 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f96fe887-cdd2-4a7d-a6c8-73edad372029-kube-api-access-h4skd\" (UniqueName: \"kubernetes.io/projected/f96fe887-cdd2-4a7d-a6c8-73edad372029-kube-api-access-h4skd\") pod \"f96fe887-cdd2-4a7d-a6c8-73edad372029\" (UID: \"f96fe887-cdd2-4a7d-a6c8-73edad372029\") " Nov 03 20:47:09.011196 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:09.011143 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f96fe887-cdd2-4a7d-a6c8-73edad372029-notebook-config\" (UniqueName: \"kubernetes.io/configmap/f96fe887-cdd2-4a7d-a6c8-73edad372029-notebook-config\") pod \"f96fe887-cdd2-4a7d-a6c8-73edad372029\" (UID: \"f96fe887-cdd2-4a7d-a6c8-73edad372029\") " Nov 03 20:47:09.011624 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:09.011597 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f96fe887-cdd2-4a7d-a6c8-73edad372029-notebook-config" pod "f96fe887-cdd2-4a7d-a6c8-73edad372029" (UID: "f96fe887-cdd2-4a7d-a6c8-73edad372029"). InnerVolumeSpecName "notebook-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:47:09.013291 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:09.013266 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f96fe887-cdd2-4a7d-a6c8-73edad372029-kube-api-access-h4skd" pod "f96fe887-cdd2-4a7d-a6c8-73edad372029" (UID: "f96fe887-cdd2-4a7d-a6c8-73edad372029"). InnerVolumeSpecName "kube-api-access-h4skd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:47:09.040977 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:09.040943 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/nfs/f96fe887-cdd2-4a7d-a6c8-73edad372029-pvc-94a4ba0c-3c19-4b42-87de-3ae35f227dca" pod "f96fe887-cdd2-4a7d-a6c8-73edad372029" (UID: "f96fe887-cdd2-4a7d-a6c8-73edad372029"). InnerVolumeSpecName "pvc-94a4ba0c-3c19-4b42-87de-3ae35f227dca". PluginName "kubernetes.io/nfs", VolumeGIDValue "" Nov 03 20:47:09.090049 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:09.090007 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_g7e74f20511e-node-0-0-5k77l_6b4b1861-ae78-4ea5-861c-433d68685b89/node/0.log" Nov 03 20:47:09.112557 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:09.112516 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4skd\" (UniqueName: \"kubernetes.io/projected/f96fe887-cdd2-4a7d-a6c8-73edad372029-kube-api-access-h4skd\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:47:09.112557 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:09.112547 5857 reconciler_common.go:299] "Volume detached for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/f96fe887-cdd2-4a7d-a6c8-73edad372029-notebook-config\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:47:09.112557 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:09.112582 5857 reconciler_common.go:299] "Volume detached for volume \"pvc-94a4ba0c-3c19-4b42-87de-3ae35f227dca\" (UniqueName: \"kubernetes.io/nfs/f96fe887-cdd2-4a7d-a6c8-73edad372029-pvc-94a4ba0c-3c19-4b42-87de-3ae35f227dca\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:47:09.156511 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:09.156463 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_g7e74f20511e-node-0-1-4bj4g_8aaf1938-1597-4d90-a8d3-baa96036622d/node/0.log" Nov 03 20:47:09.589873 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:09.589822 5857 generic.go:356] "Generic (PLEG): container finished" podID="f96fe887-cdd2-4a7d-a6c8-73edad372029" containerID="b3c0a39daab98be391a35ca617646036a2b34fd71b36ba36213d3497c490bf09" exitCode=137 Nov 03 20:47:09.590121 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:09.589911 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-jmkdx/dw-deployment-wp8tc-5db7d8db57-5kxpw" event={"ID":"f96fe887-cdd2-4a7d-a6c8-73edad372029","Type":"ContainerDied","Data":"b3c0a39daab98be391a35ca617646036a2b34fd71b36ba36213d3497c490bf09"} Nov 03 20:47:09.590121 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:09.589982 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-jmkdx/dw-deployment-wp8tc-5db7d8db57-5kxpw" event={"ID":"f96fe887-cdd2-4a7d-a6c8-73edad372029","Type":"ContainerDied","Data":"a245ae061f5b8e182f995dd139289711a7615cf73d98442c5f8aeac6ee754f5c"} Nov 03 20:47:09.590121 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:09.590020 5857 scope.go:122] "RemoveContainer" containerID="b3c0a39daab98be391a35ca617646036a2b34fd71b36ba36213d3497c490bf09" Nov 03 20:47:09.590339 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:09.590198 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-jmkdx/dw-deployment-wp8tc-5db7d8db57-5kxpw" Nov 03 20:47:09.618186 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:09.618163 5857 scope.go:122] "RemoveContainer" containerID="b3c0a39daab98be391a35ca617646036a2b34fd71b36ba36213d3497c490bf09" Nov 03 20:47:09.618545 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:47:09.618527 5857 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3c0a39daab98be391a35ca617646036a2b34fd71b36ba36213d3497c490bf09\": container with ID starting with b3c0a39daab98be391a35ca617646036a2b34fd71b36ba36213d3497c490bf09 not found: ID does not exist" containerID="b3c0a39daab98be391a35ca617646036a2b34fd71b36ba36213d3497c490bf09" Nov 03 20:47:09.618662 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:09.618554 5857 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3c0a39daab98be391a35ca617646036a2b34fd71b36ba36213d3497c490bf09"} err="failed to get container status \"b3c0a39daab98be391a35ca617646036a2b34fd71b36ba36213d3497c490bf09\": rpc error: code = NotFound desc = could not find container \"b3c0a39daab98be391a35ca617646036a2b34fd71b36ba36213d3497c490bf09\": container with ID starting with b3c0a39daab98be391a35ca617646036a2b34fd71b36ba36213d3497c490bf09 not found: ID does not exist" Nov 03 20:47:09.757955 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:09.757907 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-jmkdx/dw-deployment-wp8tc-5db7d8db57-5kxpw"] Nov 03 20:47:09.807309 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:09.807272 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-jmkdx/dw-deployment-wp8tc-5db7d8db57-5kxpw"] Nov 03 20:47:09.815204 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:09.815176 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:10.577025 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:10.576984 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f96fe887-cdd2-4a7d-a6c8-73edad372029" path="/var/lib/kubelet/pods/f96fe887-cdd2-4a7d-a6c8-73edad372029/volumes" Nov 03 20:47:10.932907 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:10.932809 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:11.975934 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:11.975888 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:12.059658 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:12.059630 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:12.090834 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:12.090808 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_g7e74f20511e-node-0-0-5k77l_6b4b1861-ae78-4ea5-861c-433d68685b89/node/0.log" Nov 03 20:47:12.157605 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:12.157577 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_g7e74f20511e-node-0-1-4bj4g_8aaf1938-1597-4d90-a8d3-baa96036622d/node/0.log" Nov 03 20:47:13.142077 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:13.142040 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:14.269029 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:14.268993 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:14.977268 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:14.977183 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:15.093007 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:15.092965 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_g7e74f20511e-node-0-0-5k77l_6b4b1861-ae78-4ea5-861c-433d68685b89/node/0.log" Nov 03 20:47:15.160639 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:15.160602 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_g7e74f20511e-node-0-1-4bj4g_8aaf1938-1597-4d90-a8d3-baa96036622d/node/0.log" Nov 03 20:47:15.388547 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:15.388422 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:16.503383 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:16.503346 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:17.631856 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:17.631826 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:17.976781 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:17.976745 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:18.090508 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:18.090475 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_g7e74f20511e-node-0-0-5k77l_6b4b1861-ae78-4ea5-861c-433d68685b89/node/0.log" Nov 03 20:47:18.157858 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:18.157826 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_g7e74f20511e-node-0-1-4bj4g_8aaf1938-1597-4d90-a8d3-baa96036622d/node/0.log" Nov 03 20:47:18.761791 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:18.761744 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:19.518027 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:47:19.517957 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:47:19.877539 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:19.877442 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:20.975821 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:20.975788 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:21.006316 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:21.006287 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:21.091029 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:21.090985 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_g7e74f20511e-node-0-0-5k77l_6b4b1861-ae78-4ea5-861c-433d68685b89/node/0.log" Nov 03 20:47:21.181770 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:21.181743 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_g7e74f20511e-node-0-1-4bj4g_8aaf1938-1597-4d90-a8d3-baa96036622d/node/0.log" Nov 03 20:47:22.144048 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:22.144001 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:23.308412 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:23.308379 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:23.975107 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:23.975064 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:24.090993 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:24.090942 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_g7e74f20511e-node-0-0-5k77l_6b4b1861-ae78-4ea5-861c-433d68685b89/node/0.log" Nov 03 20:47:24.157731 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:24.157696 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_g7e74f20511e-node-0-1-4bj4g_8aaf1938-1597-4d90-a8d3-baa96036622d/node/0.log" Nov 03 20:47:24.436323 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:24.436228 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:25.507054 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:25.507011 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:26.635733 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:26.635688 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:26.979358 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:26.979324 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:27.093472 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:27.093433 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_g7e74f20511e-node-0-0-5k77l_6b4b1861-ae78-4ea5-861c-433d68685b89/node/0.log" Nov 03 20:47:27.160676 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:27.160632 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_g7e74f20511e-node-0-1-4bj4g_8aaf1938-1597-4d90-a8d3-baa96036622d/node/0.log" Nov 03 20:47:27.762768 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:27.762742 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:28.879948 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:28.879919 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:29.976968 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:29.976936 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:30.007673 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:30.007641 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:30.091857 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:30.091823 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_g7e74f20511e-node-0-0-5k77l_6b4b1861-ae78-4ea5-861c-433d68685b89/node/0.log" Nov 03 20:47:30.158341 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:30.158313 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_g7e74f20511e-node-0-1-4bj4g_8aaf1938-1597-4d90-a8d3-baa96036622d/node/0.log" Nov 03 20:47:30.763449 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:30.763415 5857 generic.go:356] "Generic (PLEG): container finished" podID="6b4b1861-ae78-4ea5-861c-433d68685b89" containerID="a805cabb81f21323cd230cf6e75bdaddb4f9aea6a13ea76a0acca7b179003fd6" exitCode=0 Nov 03 20:47:30.763626 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:30.763490 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-s4x69/g7e74f20511e-node-0-0-5k77l" event={"ID":"6b4b1861-ae78-4ea5-861c-433d68685b89","Type":"ContainerDied","Data":"a805cabb81f21323cd230cf6e75bdaddb4f9aea6a13ea76a0acca7b179003fd6"} Nov 03 20:47:30.765206 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:30.765183 5857 generic.go:356] "Generic (PLEG): container finished" podID="8aaf1938-1597-4d90-a8d3-baa96036622d" containerID="b5618cc8ae1d420da6aa6ec42a89caa406c1bc17431f7c26509ee8f33d0d912c" exitCode=0 Nov 03 20:47:30.765308 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:30.765240 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-s4x69/g7e74f20511e-node-0-1-4bj4g" event={"ID":"8aaf1938-1597-4d90-a8d3-baa96036622d","Type":"ContainerDied","Data":"b5618cc8ae1d420da6aa6ec42a89caa406c1bc17431f7c26509ee8f33d0d912c"} Nov 03 20:47:31.142981 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:31.142949 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:31.910736 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:31.910712 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-s4x69/g7e74f20511e-node-0-1-4bj4g" Nov 03 20:47:31.935384 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:31.935359 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-s4x69/g7e74f20511e-node-0-0-5k77l" Nov 03 20:47:32.063578 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:32.063487 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/nfs/8aaf1938-1597-4d90-a8d3-baa96036622d-pvc-ab912cb9-553f-4961-86b3-a734ccb9f600\" (UniqueName: \"kubernetes.io/nfs/8aaf1938-1597-4d90-a8d3-baa96036622d-pvc-ab912cb9-553f-4961-86b3-a734ccb9f600\") pod \"8aaf1938-1597-4d90-a8d3-baa96036622d\" (UID: \"8aaf1938-1597-4d90-a8d3-baa96036622d\") " Nov 03 20:47:32.063578 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:32.063532 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8aaf1938-1597-4d90-a8d3-baa96036622d-kube-api-access-b5h2x\" (UniqueName: \"kubernetes.io/projected/8aaf1938-1597-4d90-a8d3-baa96036622d-kube-api-access-b5h2x\") pod \"8aaf1938-1597-4d90-a8d3-baa96036622d\" (UID: \"8aaf1938-1597-4d90-a8d3-baa96036622d\") " Nov 03 20:47:32.063785 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:32.063645 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6b4b1861-ae78-4ea5-861c-433d68685b89-kube-api-access-jfks4\" (UniqueName: \"kubernetes.io/projected/6b4b1861-ae78-4ea5-861c-433d68685b89-kube-api-access-jfks4\") pod \"6b4b1861-ae78-4ea5-861c-433d68685b89\" (UID: \"6b4b1861-ae78-4ea5-861c-433d68685b89\") " Nov 03 20:47:32.063785 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:32.063698 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/nfs/6b4b1861-ae78-4ea5-861c-433d68685b89-pvc-ab912cb9-553f-4961-86b3-a734ccb9f600\" (UniqueName: \"kubernetes.io/nfs/6b4b1861-ae78-4ea5-861c-433d68685b89-pvc-ab912cb9-553f-4961-86b3-a734ccb9f600\") pod \"6b4b1861-ae78-4ea5-861c-433d68685b89\" (UID: \"6b4b1861-ae78-4ea5-861c-433d68685b89\") " Nov 03 20:47:32.065933 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:32.065900 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b4b1861-ae78-4ea5-861c-433d68685b89-kube-api-access-jfks4" pod "6b4b1861-ae78-4ea5-861c-433d68685b89" (UID: "6b4b1861-ae78-4ea5-861c-433d68685b89"). InnerVolumeSpecName "kube-api-access-jfks4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:47:32.066063 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:32.065941 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8aaf1938-1597-4d90-a8d3-baa96036622d-kube-api-access-b5h2x" pod "8aaf1938-1597-4d90-a8d3-baa96036622d" (UID: "8aaf1938-1597-4d90-a8d3-baa96036622d"). InnerVolumeSpecName "kube-api-access-b5h2x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:47:32.075677 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:32.075652 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/nfs/6b4b1861-ae78-4ea5-861c-433d68685b89-pvc-ab912cb9-553f-4961-86b3-a734ccb9f600" pod "6b4b1861-ae78-4ea5-861c-433d68685b89" (UID: "6b4b1861-ae78-4ea5-861c-433d68685b89"). InnerVolumeSpecName "pvc-ab912cb9-553f-4961-86b3-a734ccb9f600". PluginName "kubernetes.io/nfs", VolumeGIDValue "" Nov 03 20:47:32.075837 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:32.075821 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/nfs/8aaf1938-1597-4d90-a8d3-baa96036622d-pvc-ab912cb9-553f-4961-86b3-a734ccb9f600" pod "8aaf1938-1597-4d90-a8d3-baa96036622d" (UID: "8aaf1938-1597-4d90-a8d3-baa96036622d"). InnerVolumeSpecName "pvc-ab912cb9-553f-4961-86b3-a734ccb9f600". PluginName "kubernetes.io/nfs", VolumeGIDValue "" Nov 03 20:47:32.164812 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:32.164783 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfks4\" (UniqueName: \"kubernetes.io/projected/6b4b1861-ae78-4ea5-861c-433d68685b89-kube-api-access-jfks4\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:47:32.164812 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:32.164810 5857 reconciler_common.go:299] "Volume detached for volume \"pvc-ab912cb9-553f-4961-86b3-a734ccb9f600\" (UniqueName: \"kubernetes.io/nfs/6b4b1861-ae78-4ea5-861c-433d68685b89-pvc-ab912cb9-553f-4961-86b3-a734ccb9f600\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:47:32.165219 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:32.164821 5857 reconciler_common.go:299] "Volume detached for volume \"pvc-ab912cb9-553f-4961-86b3-a734ccb9f600\" (UniqueName: \"kubernetes.io/nfs/8aaf1938-1597-4d90-a8d3-baa96036622d-pvc-ab912cb9-553f-4961-86b3-a734ccb9f600\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:47:32.165219 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:32.164831 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5h2x\" (UniqueName: \"kubernetes.io/projected/8aaf1938-1597-4d90-a8d3-baa96036622d-kube-api-access-b5h2x\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:47:32.270534 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:32.270501 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:32.776992 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:32.776956 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-s4x69/g7e74f20511e-node-0-1-4bj4g" Nov 03 20:47:32.776992 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:32.776985 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-s4x69/g7e74f20511e-node-0-1-4bj4g" event={"ID":"8aaf1938-1597-4d90-a8d3-baa96036622d","Type":"ContainerDied","Data":"9f4cd0d9a3c98c0eddd5d521cab3011ab99f1f25df0e522c5a396e2ba25490ef"} Nov 03 20:47:32.777215 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:32.777035 5857 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9f4cd0d9a3c98c0eddd5d521cab3011ab99f1f25df0e522c5a396e2ba25490ef" Nov 03 20:47:32.778452 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:32.778422 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-s4x69/g7e74f20511e-node-0-0-5k77l" Nov 03 20:47:32.778630 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:32.778454 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-s4x69/g7e74f20511e-node-0-0-5k77l" event={"ID":"6b4b1861-ae78-4ea5-861c-433d68685b89","Type":"ContainerDied","Data":"d2420587bb6a63beec5c95bdc305bdd28edfcff6f50fc607e5120a3d6d226207"} Nov 03 20:47:32.778630 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:32.778491 5857 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d2420587bb6a63beec5c95bdc305bdd28edfcff6f50fc607e5120a3d6d226207" Nov 03 20:47:32.978586 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:32.978534 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:33.143795 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:33.143721 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_g7e74f20511e-node-0-0-5k77l_6b4b1861-ae78-4ea5-861c-433d68685b89/node/0.log" Nov 03 20:47:33.210263 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:33.210236 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_g7e74f20511e-node-0-1-4bj4g_8aaf1938-1597-4d90-a8d3-baa96036622d/node/0.log" Nov 03 20:47:33.399827 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:33.399753 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:34.468477 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:34.468444 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:35.595720 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:35.595689 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:35.976108 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:35.976076 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:36.047336 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:36.047309 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_g7e74f20511e-node-0-0-5k77l_6b4b1861-ae78-4ea5-861c-433d68685b89/node/0.log" Nov 03 20:47:36.113588 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:36.113550 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_g7e74f20511e-node-0-1-4bj4g_8aaf1938-1597-4d90-a8d3-baa96036622d/node/0.log" Nov 03 20:47:36.189170 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:36.189136 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_g7e74f20511e-node-0-0-5k77l_6b4b1861-ae78-4ea5-861c-433d68685b89/node/0.log" Nov 03 20:47:36.762215 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:36.762180 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:37.027254 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:37.027158 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-s4x69/g7e74f20511e-node-0-0-5k77l"] Nov 03 20:47:37.028324 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:37.028301 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-s4x69/g7e74f20511e-node-0-1-4bj4g"] Nov 03 20:47:37.067831 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:37.067799 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-s4x69/g7e74f20511e-node-0-1-4bj4g"] Nov 03 20:47:37.076206 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:37.076175 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-s4x69/g7e74f20511e-node-0-0-5k77l"] Nov 03 20:47:37.889459 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:37.889427 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:38.026615 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:38.026555 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-s4x69/dw-deployment-7bcjc-bbb97867b-tjc26"] Nov 03 20:47:38.026803 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:38.026779 5857 kuberuntime_container.go:898] "Killing container with a grace period" pod="test-ns-s4x69/dw-deployment-7bcjc-bbb97867b-tjc26" podUID="aebf9ebb-3588-4f55-b363-4694a5b6ad2f" containerName="notebook" containerID="cri-o://401571b5571de4942724fa1a9c4c5196cf65d308ca8259f9c52b10c92d4c3afb" gracePeriod=30 Nov 03 20:47:38.166103 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:38.166033 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-s4x69_dw-deployment-7bcjc-bbb97867b-tjc26_aebf9ebb-3588-4f55-b363-4694a5b6ad2f/notebook/0.log" Nov 03 20:47:38.572774 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:38.572740 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6b4b1861-ae78-4ea5-861c-433d68685b89" path="/var/lib/kubelet/pods/6b4b1861-ae78-4ea5-861c-433d68685b89/volumes" Nov 03 20:47:38.573108 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:38.573094 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8aaf1938-1597-4d90-a8d3-baa96036622d" path="/var/lib/kubelet/pods/8aaf1938-1597-4d90-a8d3-baa96036622d/volumes" Nov 03 20:47:40.346326 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:40.346294 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-544ct/test-preemption-trainjob-w8pzr-node-0-0-n9b5h"] Nov 03 20:47:40.346734 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:40.346649 5857 cpu_manager.go:414] "containerMap: removing container" podUID="8aaf1938-1597-4d90-a8d3-baa96036622d" containerName="node" Nov 03 20:47:40.346734 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:40.346661 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8aaf1938-1597-4d90-a8d3-baa96036622d" containerName="node" Nov 03 20:47:40.346734 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:40.346686 5857 cpu_manager.go:414] "containerMap: removing container" podUID="f96fe887-cdd2-4a7d-a6c8-73edad372029" containerName="notebook" Nov 03 20:47:40.346734 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:40.346691 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f96fe887-cdd2-4a7d-a6c8-73edad372029" containerName="notebook" Nov 03 20:47:40.346734 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:40.346697 5857 cpu_manager.go:414] "containerMap: removing container" podUID="6b4b1861-ae78-4ea5-861c-433d68685b89" containerName="node" Nov 03 20:47:40.346734 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:40.346701 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6b4b1861-ae78-4ea5-861c-433d68685b89" containerName="node" Nov 03 20:47:40.346919 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:40.346767 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="f96fe887-cdd2-4a7d-a6c8-73edad372029" containerName="notebook" Nov 03 20:47:40.346919 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:40.346774 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="6b4b1861-ae78-4ea5-861c-433d68685b89" containerName="node" Nov 03 20:47:40.346919 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:40.346783 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="8aaf1938-1597-4d90-a8d3-baa96036622d" containerName="node" Nov 03 20:47:40.351309 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:40.351291 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-544ct/test-preemption-trainjob-w8pzr-node-0-0-n9b5h" Nov 03 20:47:40.432736 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:40.432699 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqpzn\" (UniqueName: \"kubernetes.io/projected/1810806b-8b5a-4911-a235-e11c183d5986-kube-api-access-hqpzn\") pod \"test-preemption-trainjob-w8pzr-node-0-0-n9b5h\" (UID: \"1810806b-8b5a-4911-a235-e11c183d5986\") " pod="test-ns-544ct/test-preemption-trainjob-w8pzr-node-0-0-n9b5h" Nov 03 20:47:40.452968 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:40.452941 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-544ct\"/\"kube-root-ca.crt\"" Nov 03 20:47:40.453100 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:40.453080 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-544ct\"/\"openshift-service-ca.crt\"" Nov 03 20:47:40.453160 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:40.453114 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-544ct\"/\"default-dockercfg-s69xk\"" Nov 03 20:47:40.454490 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:40.454473 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-544ct/test-preemption-trainjob-w8pzr-node-0-0-n9b5h"] Nov 03 20:47:40.533450 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:40.533423 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqpzn\" (UniqueName: \"kubernetes.io/projected/1810806b-8b5a-4911-a235-e11c183d5986-kube-api-access-hqpzn\") pod \"test-preemption-trainjob-w8pzr-node-0-0-n9b5h\" (UID: \"1810806b-8b5a-4911-a235-e11c183d5986\") " pod="test-ns-544ct/test-preemption-trainjob-w8pzr-node-0-0-n9b5h" Nov 03 20:47:40.594129 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:40.594095 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqpzn\" (UniqueName: \"kubernetes.io/projected/1810806b-8b5a-4911-a235-e11c183d5986-kube-api-access-hqpzn\") pod \"test-preemption-trainjob-w8pzr-node-0-0-n9b5h\" (UID: \"1810806b-8b5a-4911-a235-e11c183d5986\") " pod="test-ns-544ct/test-preemption-trainjob-w8pzr-node-0-0-n9b5h" Nov 03 20:47:40.663819 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:40.663740 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-544ct/test-preemption-trainjob-w8pzr-node-0-0-n9b5h" Nov 03 20:47:41.040845 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:41.040813 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-544ct/test-preemption-trainjob-w8pzr-node-0-0-n9b5h"] Nov 03 20:47:41.043970 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:47:41.043937 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1810806b_8b5a_4911_a235_e11c183d5986.slice/crio-08f42c4927456220c0b7daf3737c34527744fa592f7948a6440413f3866951cb WatchSource:0}: Error finding container 08f42c4927456220c0b7daf3737c34527744fa592f7948a6440413f3866951cb: Status 404 returned error can't find the container with id 08f42c4927456220c0b7daf3737c34527744fa592f7948a6440413f3866951cb Nov 03 20:47:41.828638 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:41.828596 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-544ct/test-preemption-trainjob-w8pzr-node-0-0-n9b5h" event={"ID":"1810806b-8b5a-4911-a235-e11c183d5986","Type":"ContainerStarted","Data":"fb6e16be0516dca9445b0ce71d2e5d02d08de6bad1e1fbe0c704a9303ed2026d"} Nov 03 20:47:41.828638 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:41.828646 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-544ct/test-preemption-trainjob-w8pzr-node-0-0-n9b5h" event={"ID":"1810806b-8b5a-4911-a235-e11c183d5986","Type":"ContainerStarted","Data":"08f42c4927456220c0b7daf3737c34527744fa592f7948a6440413f3866951cb"} Nov 03 20:47:41.944237 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:41.944178 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-544ct/test-preemption-trainjob-w8pzr-node-0-0-n9b5h" podStartSLOduration=1.944161571 podStartE2EDuration="1.944161571s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:47:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:47:41.943408896 +0000 UTC m=+2771.510299045" watchObservedRunningTime="2026-11-03 20:47:41.944161571 +0000 UTC m=+2771.511051720" Nov 03 20:47:43.970865 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:43.970832 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-544ct/test-preemption-trainjob-w8pzr-node-0-0-n9b5h"] Nov 03 20:47:43.971319 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:43.971000 5857 kuberuntime_container.go:898] "Killing container with a grace period" pod="test-ns-544ct/test-preemption-trainjob-w8pzr-node-0-0-n9b5h" podUID="1810806b-8b5a-4911-a235-e11c183d5986" containerName="node" containerID="cri-o://fb6e16be0516dca9445b0ce71d2e5d02d08de6bad1e1fbe0c704a9303ed2026d" gracePeriod=30 Nov 03 20:47:44.040925 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:44.040899 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-544ct_test-preemption-trainjob-w8pzr-node-0-0-n9b5h_1810806b-8b5a-4911-a235-e11c183d5986/node/0.log" Nov 03 20:47:47.491147 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:47.491098 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-dlmm7/test-mpi-trainjob-hzgn6-node-0-0-2kh7b"] Nov 03 20:47:47.497416 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:47.497379 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-dlmm7/test-mpi-trainjob-hzgn6-node-0-0-2kh7b" Nov 03 20:47:47.550892 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:47.550862 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-dlmm7\"/\"test-mpi-trainjob-hzgn6-mpi-ssh-auth\"" Nov 03 20:47:47.588159 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:47.588122 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"mpi-test-script\" (UniqueName: \"kubernetes.io/configmap/6ab25141-d8c8-4963-ba67-84d5fff73af8-mpi-test-script\") pod \"test-mpi-trainjob-hzgn6-node-0-0-2kh7b\" (UID: \"6ab25141-d8c8-4963-ba67-84d5fff73af8\") " pod="test-ns-dlmm7/test-mpi-trainjob-hzgn6-node-0-0-2kh7b" Nov 03 20:47:47.588159 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:47.588159 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"mpi-ssh-auth\" (UniqueName: \"kubernetes.io/secret/6ab25141-d8c8-4963-ba67-84d5fff73af8-mpi-ssh-auth\") pod \"test-mpi-trainjob-hzgn6-node-0-0-2kh7b\" (UID: \"6ab25141-d8c8-4963-ba67-84d5fff73af8\") " pod="test-ns-dlmm7/test-mpi-trainjob-hzgn6-node-0-0-2kh7b" Nov 03 20:47:47.588354 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:47.588270 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4ltv\" (UniqueName: \"kubernetes.io/projected/6ab25141-d8c8-4963-ba67-84d5fff73af8-kube-api-access-q4ltv\") pod \"test-mpi-trainjob-hzgn6-node-0-0-2kh7b\" (UID: \"6ab25141-d8c8-4963-ba67-84d5fff73af8\") " pod="test-ns-dlmm7/test-mpi-trainjob-hzgn6-node-0-0-2kh7b" Nov 03 20:47:47.600411 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:47.600380 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-dlmm7\"/\"openshift-service-ca.crt\"" Nov 03 20:47:47.600543 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:47.600529 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-dlmm7\"/\"default-dockercfg-85kl4\"" Nov 03 20:47:47.600650 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:47.600614 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-dlmm7\"/\"kube-root-ca.crt\"" Nov 03 20:47:47.600710 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:47.600657 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-dlmm7\"/\"config-q5p7l\"" Nov 03 20:47:47.601853 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:47.601821 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-dlmm7/test-mpi-trainjob-hzgn6-node-0-0-2kh7b"] Nov 03 20:47:47.689218 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:47.689184 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4ltv\" (UniqueName: \"kubernetes.io/projected/6ab25141-d8c8-4963-ba67-84d5fff73af8-kube-api-access-q4ltv\") pod \"test-mpi-trainjob-hzgn6-node-0-0-2kh7b\" (UID: \"6ab25141-d8c8-4963-ba67-84d5fff73af8\") " pod="test-ns-dlmm7/test-mpi-trainjob-hzgn6-node-0-0-2kh7b" Nov 03 20:47:47.689363 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:47.689239 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"mpi-test-script\" (UniqueName: \"kubernetes.io/configmap/6ab25141-d8c8-4963-ba67-84d5fff73af8-mpi-test-script\") pod \"test-mpi-trainjob-hzgn6-node-0-0-2kh7b\" (UID: \"6ab25141-d8c8-4963-ba67-84d5fff73af8\") " pod="test-ns-dlmm7/test-mpi-trainjob-hzgn6-node-0-0-2kh7b" Nov 03 20:47:47.689421 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:47.689397 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"mpi-ssh-auth\" (UniqueName: \"kubernetes.io/secret/6ab25141-d8c8-4963-ba67-84d5fff73af8-mpi-ssh-auth\") pod \"test-mpi-trainjob-hzgn6-node-0-0-2kh7b\" (UID: \"6ab25141-d8c8-4963-ba67-84d5fff73af8\") " pod="test-ns-dlmm7/test-mpi-trainjob-hzgn6-node-0-0-2kh7b" Nov 03 20:47:47.689890 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:47.689869 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"mpi-test-script\" (UniqueName: \"kubernetes.io/configmap/6ab25141-d8c8-4963-ba67-84d5fff73af8-mpi-test-script\") pod \"test-mpi-trainjob-hzgn6-node-0-0-2kh7b\" (UID: \"6ab25141-d8c8-4963-ba67-84d5fff73af8\") " pod="test-ns-dlmm7/test-mpi-trainjob-hzgn6-node-0-0-2kh7b" Nov 03 20:47:47.692139 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:47.692120 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"mpi-ssh-auth\" (UniqueName: \"kubernetes.io/secret/6ab25141-d8c8-4963-ba67-84d5fff73af8-mpi-ssh-auth\") pod \"test-mpi-trainjob-hzgn6-node-0-0-2kh7b\" (UID: \"6ab25141-d8c8-4963-ba67-84d5fff73af8\") " pod="test-ns-dlmm7/test-mpi-trainjob-hzgn6-node-0-0-2kh7b" Nov 03 20:47:47.750121 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:47.750055 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4ltv\" (UniqueName: \"kubernetes.io/projected/6ab25141-d8c8-4963-ba67-84d5fff73af8-kube-api-access-q4ltv\") pod \"test-mpi-trainjob-hzgn6-node-0-0-2kh7b\" (UID: \"6ab25141-d8c8-4963-ba67-84d5fff73af8\") " pod="test-ns-dlmm7/test-mpi-trainjob-hzgn6-node-0-0-2kh7b" Nov 03 20:47:47.810088 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:47.810051 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-dlmm7/test-mpi-trainjob-hzgn6-node-0-0-2kh7b" Nov 03 20:47:48.186273 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:48.186200 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-dlmm7/test-mpi-trainjob-hzgn6-node-0-0-2kh7b"] Nov 03 20:47:48.220871 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:47:48.220837 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6ab25141_d8c8_4963_ba67_84d5fff73af8.slice/crio-a8d433b6c8536dc354177906eafa4ef9af2b3410b7ffd157818e3e00220d430e WatchSource:0}: Error finding container a8d433b6c8536dc354177906eafa4ef9af2b3410b7ffd157818e3e00220d430e: Status 404 returned error can't find the container with id a8d433b6c8536dc354177906eafa4ef9af2b3410b7ffd157818e3e00220d430e Nov 03 20:47:48.867958 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:48.867914 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-dlmm7/test-mpi-trainjob-hzgn6-node-0-0-2kh7b" event={"ID":"6ab25141-d8c8-4963-ba67-84d5fff73af8","Type":"ContainerStarted","Data":"165a0d922d8f01b37cb41da5d171ea5e4f6f8d3cf4887fec15c2a36317b1f2fb"} Nov 03 20:47:48.868378 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:48.867975 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-dlmm7/test-mpi-trainjob-hzgn6-node-0-0-2kh7b" event={"ID":"6ab25141-d8c8-4963-ba67-84d5fff73af8","Type":"ContainerStarted","Data":"a8d433b6c8536dc354177906eafa4ef9af2b3410b7ffd157818e3e00220d430e"} Nov 03 20:47:48.868378 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:48.868018 5857 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-dlmm7/test-mpi-trainjob-hzgn6-node-0-0-2kh7b" Nov 03 20:47:48.985058 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:48.984998 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-dlmm7/test-mpi-trainjob-hzgn6-node-0-0-2kh7b" podStartSLOduration=1.98497982 podStartE2EDuration="1.98497982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:47:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:47:48.984345595 +0000 UTC m=+2778.551235743" watchObservedRunningTime="2026-11-03 20:47:48.98497982 +0000 UTC m=+2778.551869969" Nov 03 20:47:49.500773 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:47:49.500740 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:47:49.843277 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:49.843205 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dlmm7_test-mpi-trainjob-hzgn6-node-0-0-2kh7b_6ab25141-d8c8-4963-ba67-84d5fff73af8/node/0.log" Nov 03 20:47:52.843660 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:52.843592 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dlmm7_test-mpi-trainjob-hzgn6-node-0-0-2kh7b_6ab25141-d8c8-4963-ba67-84d5fff73af8/node/0.log" Nov 03 20:47:55.843502 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:55.843471 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dlmm7_test-mpi-trainjob-hzgn6-node-0-0-2kh7b_6ab25141-d8c8-4963-ba67-84d5fff73af8/node/0.log" Nov 03 20:47:58.844600 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:58.844555 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dlmm7_test-mpi-trainjob-hzgn6-node-0-0-2kh7b_6ab25141-d8c8-4963-ba67-84d5fff73af8/node/0.log" Nov 03 20:47:59.875763 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:47:59.875734 5857 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-dlmm7/test-mpi-trainjob-hzgn6-node-0-0-2kh7b" Nov 03 20:48:01.921358 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:01.921322 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dlmm7_test-mpi-trainjob-hzgn6-node-0-0-2kh7b_6ab25141-d8c8-4963-ba67-84d5fff73af8/node/0.log" Nov 03 20:48:04.922418 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:04.922385 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dlmm7_test-mpi-trainjob-hzgn6-node-0-0-2kh7b_6ab25141-d8c8-4963-ba67-84d5fff73af8/node/0.log" Nov 03 20:48:07.921039 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:07.920967 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dlmm7_test-mpi-trainjob-hzgn6-node-0-0-2kh7b_6ab25141-d8c8-4963-ba67-84d5fff73af8/node/0.log" Nov 03 20:48:08.213047 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:08.213024 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-s4x69/dw-deployment-7bcjc-bbb97867b-tjc26" Nov 03 20:48:08.254702 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:08.254675 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aebf9ebb-3588-4f55-b363-4694a5b6ad2f-kube-api-access-lblvv\" (UniqueName: \"kubernetes.io/projected/aebf9ebb-3588-4f55-b363-4694a5b6ad2f-kube-api-access-lblvv\") pod \"aebf9ebb-3588-4f55-b363-4694a5b6ad2f\" (UID: \"aebf9ebb-3588-4f55-b363-4694a5b6ad2f\") " Nov 03 20:48:08.254841 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:08.254722 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/aebf9ebb-3588-4f55-b363-4694a5b6ad2f-notebook-config\" (UniqueName: \"kubernetes.io/configmap/aebf9ebb-3588-4f55-b363-4694a5b6ad2f-notebook-config\") pod \"aebf9ebb-3588-4f55-b363-4694a5b6ad2f\" (UID: \"aebf9ebb-3588-4f55-b363-4694a5b6ad2f\") " Nov 03 20:48:08.254841 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:08.254759 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/nfs/aebf9ebb-3588-4f55-b363-4694a5b6ad2f-pvc-ab912cb9-553f-4961-86b3-a734ccb9f600\" (UniqueName: \"kubernetes.io/nfs/aebf9ebb-3588-4f55-b363-4694a5b6ad2f-pvc-ab912cb9-553f-4961-86b3-a734ccb9f600\") pod \"aebf9ebb-3588-4f55-b363-4694a5b6ad2f\" (UID: \"aebf9ebb-3588-4f55-b363-4694a5b6ad2f\") " Nov 03 20:48:08.255105 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:08.255072 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aebf9ebb-3588-4f55-b363-4694a5b6ad2f-notebook-config" pod "aebf9ebb-3588-4f55-b363-4694a5b6ad2f" (UID: "aebf9ebb-3588-4f55-b363-4694a5b6ad2f"). InnerVolumeSpecName "notebook-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:48:08.257058 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:08.257030 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aebf9ebb-3588-4f55-b363-4694a5b6ad2f-kube-api-access-lblvv" pod "aebf9ebb-3588-4f55-b363-4694a5b6ad2f" (UID: "aebf9ebb-3588-4f55-b363-4694a5b6ad2f"). InnerVolumeSpecName "kube-api-access-lblvv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:48:08.281007 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:08.280981 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/nfs/aebf9ebb-3588-4f55-b363-4694a5b6ad2f-pvc-ab912cb9-553f-4961-86b3-a734ccb9f600" pod "aebf9ebb-3588-4f55-b363-4694a5b6ad2f" (UID: "aebf9ebb-3588-4f55-b363-4694a5b6ad2f"). InnerVolumeSpecName "pvc-ab912cb9-553f-4961-86b3-a734ccb9f600". PluginName "kubernetes.io/nfs", VolumeGIDValue "" Nov 03 20:48:08.355413 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:08.355384 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lblvv\" (UniqueName: \"kubernetes.io/projected/aebf9ebb-3588-4f55-b363-4694a5b6ad2f-kube-api-access-lblvv\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:48:08.355413 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:08.355409 5857 reconciler_common.go:299] "Volume detached for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/aebf9ebb-3588-4f55-b363-4694a5b6ad2f-notebook-config\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:48:08.355596 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:08.355419 5857 reconciler_common.go:299] "Volume detached for volume \"pvc-ab912cb9-553f-4961-86b3-a734ccb9f600\" (UniqueName: \"kubernetes.io/nfs/aebf9ebb-3588-4f55-b363-4694a5b6ad2f-pvc-ab912cb9-553f-4961-86b3-a734ccb9f600\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:48:08.970168 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:08.970131 5857 generic.go:356] "Generic (PLEG): container finished" podID="aebf9ebb-3588-4f55-b363-4694a5b6ad2f" containerID="401571b5571de4942724fa1a9c4c5196cf65d308ca8259f9c52b10c92d4c3afb" exitCode=137 Nov 03 20:48:08.970654 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:08.970175 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-s4x69/dw-deployment-7bcjc-bbb97867b-tjc26" Nov 03 20:48:08.970654 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:08.970219 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-s4x69/dw-deployment-7bcjc-bbb97867b-tjc26" event={"ID":"aebf9ebb-3588-4f55-b363-4694a5b6ad2f","Type":"ContainerDied","Data":"401571b5571de4942724fa1a9c4c5196cf65d308ca8259f9c52b10c92d4c3afb"} Nov 03 20:48:08.970654 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:08.970273 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-s4x69/dw-deployment-7bcjc-bbb97867b-tjc26" event={"ID":"aebf9ebb-3588-4f55-b363-4694a5b6ad2f","Type":"ContainerDied","Data":"ddd7a1208d7bcb6f66e11f3713660341b31c143979e7cb79da3b509900d9e2fe"} Nov 03 20:48:08.970654 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:08.970296 5857 scope.go:122] "RemoveContainer" containerID="401571b5571de4942724fa1a9c4c5196cf65d308ca8259f9c52b10c92d4c3afb" Nov 03 20:48:08.990380 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:08.990363 5857 scope.go:122] "RemoveContainer" containerID="401571b5571de4942724fa1a9c4c5196cf65d308ca8259f9c52b10c92d4c3afb" Nov 03 20:48:08.990696 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:48:08.990676 5857 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"401571b5571de4942724fa1a9c4c5196cf65d308ca8259f9c52b10c92d4c3afb\": container with ID starting with 401571b5571de4942724fa1a9c4c5196cf65d308ca8259f9c52b10c92d4c3afb not found: ID does not exist" containerID="401571b5571de4942724fa1a9c4c5196cf65d308ca8259f9c52b10c92d4c3afb" Nov 03 20:48:08.990757 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:08.990705 5857 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"401571b5571de4942724fa1a9c4c5196cf65d308ca8259f9c52b10c92d4c3afb"} err="failed to get container status \"401571b5571de4942724fa1a9c4c5196cf65d308ca8259f9c52b10c92d4c3afb\": rpc error: code = NotFound desc = could not find container \"401571b5571de4942724fa1a9c4c5196cf65d308ca8259f9c52b10c92d4c3afb\": container with ID starting with 401571b5571de4942724fa1a9c4c5196cf65d308ca8259f9c52b10c92d4c3afb not found: ID does not exist" Nov 03 20:48:09.142477 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:09.142440 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-s4x69/dw-deployment-7bcjc-bbb97867b-tjc26"] Nov 03 20:48:09.192135 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:09.192102 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-s4x69/dw-deployment-7bcjc-bbb97867b-tjc26"] Nov 03 20:48:10.572471 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:10.572443 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="aebf9ebb-3588-4f55-b363-4694a5b6ad2f" path="/var/lib/kubelet/pods/aebf9ebb-3588-4f55-b363-4694a5b6ad2f/volumes" Nov 03 20:48:10.921666 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:10.921597 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dlmm7_test-mpi-trainjob-hzgn6-node-0-0-2kh7b_6ab25141-d8c8-4963-ba67-84d5fff73af8/node/0.log" Nov 03 20:48:13.921726 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:13.921691 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dlmm7_test-mpi-trainjob-hzgn6-node-0-0-2kh7b_6ab25141-d8c8-4963-ba67-84d5fff73af8/node/0.log" Nov 03 20:48:14.165547 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:14.165525 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-544ct/test-preemption-trainjob-w8pzr-node-0-0-n9b5h" Nov 03 20:48:14.206320 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:14.206297 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1810806b-8b5a-4911-a235-e11c183d5986-kube-api-access-hqpzn\" (UniqueName: \"kubernetes.io/projected/1810806b-8b5a-4911-a235-e11c183d5986-kube-api-access-hqpzn\") pod \"1810806b-8b5a-4911-a235-e11c183d5986\" (UID: \"1810806b-8b5a-4911-a235-e11c183d5986\") " Nov 03 20:48:14.208611 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:14.208589 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1810806b-8b5a-4911-a235-e11c183d5986-kube-api-access-hqpzn" pod "1810806b-8b5a-4911-a235-e11c183d5986" (UID: "1810806b-8b5a-4911-a235-e11c183d5986"). InnerVolumeSpecName "kube-api-access-hqpzn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:48:14.307745 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:14.307699 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqpzn\" (UniqueName: \"kubernetes.io/projected/1810806b-8b5a-4911-a235-e11c183d5986-kube-api-access-hqpzn\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:48:15.001219 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:15.001174 5857 generic.go:356] "Generic (PLEG): container finished" podID="1810806b-8b5a-4911-a235-e11c183d5986" containerID="fb6e16be0516dca9445b0ce71d2e5d02d08de6bad1e1fbe0c704a9303ed2026d" exitCode=137 Nov 03 20:48:15.001694 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:15.001233 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-544ct/test-preemption-trainjob-w8pzr-node-0-0-n9b5h" Nov 03 20:48:15.001694 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:15.001240 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-544ct/test-preemption-trainjob-w8pzr-node-0-0-n9b5h" event={"ID":"1810806b-8b5a-4911-a235-e11c183d5986","Type":"ContainerDied","Data":"fb6e16be0516dca9445b0ce71d2e5d02d08de6bad1e1fbe0c704a9303ed2026d"} Nov 03 20:48:15.001694 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:15.001286 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-544ct/test-preemption-trainjob-w8pzr-node-0-0-n9b5h" event={"ID":"1810806b-8b5a-4911-a235-e11c183d5986","Type":"ContainerDied","Data":"08f42c4927456220c0b7daf3737c34527744fa592f7948a6440413f3866951cb"} Nov 03 20:48:15.001694 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:15.001298 5857 scope.go:122] "RemoveContainer" containerID="fb6e16be0516dca9445b0ce71d2e5d02d08de6bad1e1fbe0c704a9303ed2026d" Nov 03 20:48:15.009807 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:15.009784 5857 scope.go:122] "RemoveContainer" containerID="fb6e16be0516dca9445b0ce71d2e5d02d08de6bad1e1fbe0c704a9303ed2026d" Nov 03 20:48:15.010065 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:48:15.010044 5857 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb6e16be0516dca9445b0ce71d2e5d02d08de6bad1e1fbe0c704a9303ed2026d\": container with ID starting with fb6e16be0516dca9445b0ce71d2e5d02d08de6bad1e1fbe0c704a9303ed2026d not found: ID does not exist" containerID="fb6e16be0516dca9445b0ce71d2e5d02d08de6bad1e1fbe0c704a9303ed2026d" Nov 03 20:48:15.010129 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:15.010079 5857 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb6e16be0516dca9445b0ce71d2e5d02d08de6bad1e1fbe0c704a9303ed2026d"} err="failed to get container status \"fb6e16be0516dca9445b0ce71d2e5d02d08de6bad1e1fbe0c704a9303ed2026d\": rpc error: code = NotFound desc = could not find container \"fb6e16be0516dca9445b0ce71d2e5d02d08de6bad1e1fbe0c704a9303ed2026d\": container with ID starting with fb6e16be0516dca9445b0ce71d2e5d02d08de6bad1e1fbe0c704a9303ed2026d not found: ID does not exist" Nov 03 20:48:15.164014 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:15.163984 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-544ct/test-preemption-trainjob-w8pzr-node-0-0-n9b5h"] Nov 03 20:48:15.213619 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:15.213590 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-544ct/test-preemption-trainjob-w8pzr-node-0-0-n9b5h"] Nov 03 20:48:16.572915 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:16.572883 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1810806b-8b5a-4911-a235-e11c183d5986" path="/var/lib/kubelet/pods/1810806b-8b5a-4911-a235-e11c183d5986/volumes" Nov 03 20:48:16.921165 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:16.921083 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dlmm7_test-mpi-trainjob-hzgn6-node-0-0-2kh7b_6ab25141-d8c8-4963-ba67-84d5fff73af8/node/0.log" Nov 03 20:48:19.498665 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:48:19.498614 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:48:19.921900 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:19.921825 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dlmm7_test-mpi-trainjob-hzgn6-node-0-0-2kh7b_6ab25141-d8c8-4963-ba67-84d5fff73af8/node/0.log" Nov 03 20:48:22.920955 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:22.920930 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dlmm7_test-mpi-trainjob-hzgn6-node-0-0-2kh7b_6ab25141-d8c8-4963-ba67-84d5fff73af8/node/0.log" Nov 03 20:48:25.921860 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:25.921819 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dlmm7_test-mpi-trainjob-hzgn6-node-0-0-2kh7b_6ab25141-d8c8-4963-ba67-84d5fff73af8/node/0.log" Nov 03 20:48:28.912692 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:28.912662 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dlmm7_test-mpi-trainjob-hzgn6-node-0-0-2kh7b_6ab25141-d8c8-4963-ba67-84d5fff73af8/node/0.log" Nov 03 20:48:31.920700 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:31.920668 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dlmm7_test-mpi-trainjob-hzgn6-node-0-0-2kh7b_6ab25141-d8c8-4963-ba67-84d5fff73af8/node/0.log" Nov 03 20:48:34.920990 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:34.920956 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dlmm7_test-mpi-trainjob-hzgn6-node-0-0-2kh7b_6ab25141-d8c8-4963-ba67-84d5fff73af8/node/0.log" Nov 03 20:48:37.921430 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:37.921397 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dlmm7_test-mpi-trainjob-hzgn6-node-0-0-2kh7b_6ab25141-d8c8-4963-ba67-84d5fff73af8/node/0.log" Nov 03 20:48:40.921781 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:40.921750 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dlmm7_test-mpi-trainjob-hzgn6-node-0-0-2kh7b_6ab25141-d8c8-4963-ba67-84d5fff73af8/node/0.log" Nov 03 20:48:43.920994 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:43.920950 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dlmm7_test-mpi-trainjob-hzgn6-node-0-0-2kh7b_6ab25141-d8c8-4963-ba67-84d5fff73af8/node/0.log" Nov 03 20:48:46.923084 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:46.923054 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dlmm7_test-mpi-trainjob-hzgn6-node-0-0-2kh7b_6ab25141-d8c8-4963-ba67-84d5fff73af8/node/0.log" Nov 03 20:48:49.501326 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:48:49.501288 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:48:49.922163 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:49.922084 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dlmm7_test-mpi-trainjob-hzgn6-node-0-0-2kh7b_6ab25141-d8c8-4963-ba67-84d5fff73af8/node/0.log" Nov 03 20:48:52.921835 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:52.921803 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dlmm7_test-mpi-trainjob-hzgn6-node-0-0-2kh7b_6ab25141-d8c8-4963-ba67-84d5fff73af8/node/0.log" Nov 03 20:48:55.921867 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:55.921843 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dlmm7_test-mpi-trainjob-hzgn6-node-0-0-2kh7b_6ab25141-d8c8-4963-ba67-84d5fff73af8/node/0.log" Nov 03 20:48:58.922110 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:48:58.922078 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dlmm7_test-mpi-trainjob-hzgn6-node-0-0-2kh7b_6ab25141-d8c8-4963-ba67-84d5fff73af8/node/0.log" Nov 03 20:49:01.925680 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:01.925647 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dlmm7_test-mpi-trainjob-hzgn6-node-0-0-2kh7b_6ab25141-d8c8-4963-ba67-84d5fff73af8/node/0.log" Nov 03 20:49:04.922067 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:04.922031 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dlmm7_test-mpi-trainjob-hzgn6-node-0-0-2kh7b_6ab25141-d8c8-4963-ba67-84d5fff73af8/node/0.log" Nov 03 20:49:07.926343 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:07.926312 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dlmm7_test-mpi-trainjob-hzgn6-node-0-0-2kh7b_6ab25141-d8c8-4963-ba67-84d5fff73af8/node/0.log" Nov 03 20:49:08.788759 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:08.788728 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-dlmm7/test-mpi-trainjob-hzgn6-node-0-0-2kh7b"] Nov 03 20:49:08.788980 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:08.788936 5857 kuberuntime_container.go:898] "Killing container with a grace period" pod="test-ns-dlmm7/test-mpi-trainjob-hzgn6-node-0-0-2kh7b" podUID="6ab25141-d8c8-4963-ba67-84d5fff73af8" containerName="node" containerID="cri-o://165a0d922d8f01b37cb41da5d171ea5e4f6f8d3cf4887fec15c2a36317b1f2fb" gracePeriod=30 Nov 03 20:49:09.038448 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:09.038425 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-dlmm7/test-mpi-trainjob-hzgn6-node-0-0-2kh7b" Nov 03 20:49:09.081504 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:09.081444 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6ab25141-d8c8-4963-ba67-84d5fff73af8-mpi-ssh-auth\" (UniqueName: \"kubernetes.io/secret/6ab25141-d8c8-4963-ba67-84d5fff73af8-mpi-ssh-auth\") pod \"6ab25141-d8c8-4963-ba67-84d5fff73af8\" (UID: \"6ab25141-d8c8-4963-ba67-84d5fff73af8\") " Nov 03 20:49:09.081504 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:09.081477 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6ab25141-d8c8-4963-ba67-84d5fff73af8-kube-api-access-q4ltv\" (UniqueName: \"kubernetes.io/projected/6ab25141-d8c8-4963-ba67-84d5fff73af8-kube-api-access-q4ltv\") pod \"6ab25141-d8c8-4963-ba67-84d5fff73af8\" (UID: \"6ab25141-d8c8-4963-ba67-84d5fff73af8\") " Nov 03 20:49:09.081688 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:09.081505 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6ab25141-d8c8-4963-ba67-84d5fff73af8-mpi-test-script\" (UniqueName: \"kubernetes.io/configmap/6ab25141-d8c8-4963-ba67-84d5fff73af8-mpi-test-script\") pod \"6ab25141-d8c8-4963-ba67-84d5fff73af8\" (UID: \"6ab25141-d8c8-4963-ba67-84d5fff73af8\") " Nov 03 20:49:09.081936 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:09.081906 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ab25141-d8c8-4963-ba67-84d5fff73af8-mpi-test-script" pod "6ab25141-d8c8-4963-ba67-84d5fff73af8" (UID: "6ab25141-d8c8-4963-ba67-84d5fff73af8"). InnerVolumeSpecName "mpi-test-script". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:49:09.083913 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:09.083886 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ab25141-d8c8-4963-ba67-84d5fff73af8-kube-api-access-q4ltv" pod "6ab25141-d8c8-4963-ba67-84d5fff73af8" (UID: "6ab25141-d8c8-4963-ba67-84d5fff73af8"). InnerVolumeSpecName "kube-api-access-q4ltv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:49:09.083913 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:09.083895 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ab25141-d8c8-4963-ba67-84d5fff73af8-mpi-ssh-auth" pod "6ab25141-d8c8-4963-ba67-84d5fff73af8" (UID: "6ab25141-d8c8-4963-ba67-84d5fff73af8"). InnerVolumeSpecName "mpi-ssh-auth". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:49:09.182255 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:09.182220 5857 reconciler_common.go:299] "Volume detached for volume \"mpi-test-script\" (UniqueName: \"kubernetes.io/configmap/6ab25141-d8c8-4963-ba67-84d5fff73af8-mpi-test-script\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:49:09.182255 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:09.182248 5857 reconciler_common.go:299] "Volume detached for volume \"mpi-ssh-auth\" (UniqueName: \"kubernetes.io/secret/6ab25141-d8c8-4963-ba67-84d5fff73af8-mpi-ssh-auth\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:49:09.182255 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:09.182258 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4ltv\" (UniqueName: \"kubernetes.io/projected/6ab25141-d8c8-4963-ba67-84d5fff73af8-kube-api-access-q4ltv\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:49:09.286146 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:09.286114 5857 generic.go:356] "Generic (PLEG): container finished" podID="6ab25141-d8c8-4963-ba67-84d5fff73af8" containerID="165a0d922d8f01b37cb41da5d171ea5e4f6f8d3cf4887fec15c2a36317b1f2fb" exitCode=0 Nov 03 20:49:09.286332 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:09.286165 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-dlmm7/test-mpi-trainjob-hzgn6-node-0-0-2kh7b" Nov 03 20:49:09.286332 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:09.286172 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-dlmm7/test-mpi-trainjob-hzgn6-node-0-0-2kh7b" event={"ID":"6ab25141-d8c8-4963-ba67-84d5fff73af8","Type":"ContainerDied","Data":"165a0d922d8f01b37cb41da5d171ea5e4f6f8d3cf4887fec15c2a36317b1f2fb"} Nov 03 20:49:09.286332 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:09.286212 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-dlmm7/test-mpi-trainjob-hzgn6-node-0-0-2kh7b" event={"ID":"6ab25141-d8c8-4963-ba67-84d5fff73af8","Type":"ContainerDied","Data":"a8d433b6c8536dc354177906eafa4ef9af2b3410b7ffd157818e3e00220d430e"} Nov 03 20:49:09.286332 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:09.286233 5857 scope.go:122] "RemoveContainer" containerID="165a0d922d8f01b37cb41da5d171ea5e4f6f8d3cf4887fec15c2a36317b1f2fb" Nov 03 20:49:09.302181 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:09.302162 5857 scope.go:122] "RemoveContainer" containerID="165a0d922d8f01b37cb41da5d171ea5e4f6f8d3cf4887fec15c2a36317b1f2fb" Nov 03 20:49:09.302470 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:49:09.302449 5857 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"165a0d922d8f01b37cb41da5d171ea5e4f6f8d3cf4887fec15c2a36317b1f2fb\": container with ID starting with 165a0d922d8f01b37cb41da5d171ea5e4f6f8d3cf4887fec15c2a36317b1f2fb not found: ID does not exist" containerID="165a0d922d8f01b37cb41da5d171ea5e4f6f8d3cf4887fec15c2a36317b1f2fb" Nov 03 20:49:09.302592 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:09.302478 5857 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"165a0d922d8f01b37cb41da5d171ea5e4f6f8d3cf4887fec15c2a36317b1f2fb"} err="failed to get container status \"165a0d922d8f01b37cb41da5d171ea5e4f6f8d3cf4887fec15c2a36317b1f2fb\": rpc error: code = NotFound desc = could not find container \"165a0d922d8f01b37cb41da5d171ea5e4f6f8d3cf4887fec15c2a36317b1f2fb\": container with ID starting with 165a0d922d8f01b37cb41da5d171ea5e4f6f8d3cf4887fec15c2a36317b1f2fb not found: ID does not exist" Nov 03 20:49:09.449576 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:09.449479 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-dlmm7/test-mpi-trainjob-hzgn6-node-0-0-2kh7b"] Nov 03 20:49:09.455042 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:09.455012 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-dlmm7/test-mpi-trainjob-hzgn6-node-0-0-2kh7b"] Nov 03 20:49:10.572097 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:10.572054 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6ab25141-d8c8-4963-ba67-84d5fff73af8" path="/var/lib/kubelet/pods/6ab25141-d8c8-4963-ba67-84d5fff73af8/volumes" Nov 03 20:49:17.165996 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:17.165958 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-rxdfh/test-trainjob-fail-f4kgz-dataset-initializer-0-0-zclwv"] Nov 03 20:49:17.166381 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:17.166333 5857 cpu_manager.go:414] "containerMap: removing container" podUID="aebf9ebb-3588-4f55-b363-4694a5b6ad2f" containerName="notebook" Nov 03 20:49:17.166381 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:17.166344 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aebf9ebb-3588-4f55-b363-4694a5b6ad2f" containerName="notebook" Nov 03 20:49:17.166381 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:17.166368 5857 cpu_manager.go:414] "containerMap: removing container" podUID="6ab25141-d8c8-4963-ba67-84d5fff73af8" containerName="node" Nov 03 20:49:17.166381 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:17.166373 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6ab25141-d8c8-4963-ba67-84d5fff73af8" containerName="node" Nov 03 20:49:17.166512 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:17.166388 5857 cpu_manager.go:414] "containerMap: removing container" podUID="1810806b-8b5a-4911-a235-e11c183d5986" containerName="node" Nov 03 20:49:17.166512 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:17.166394 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1810806b-8b5a-4911-a235-e11c183d5986" containerName="node" Nov 03 20:49:17.166512 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:17.166445 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="6ab25141-d8c8-4963-ba67-84d5fff73af8" containerName="node" Nov 03 20:49:17.166512 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:17.166454 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="1810806b-8b5a-4911-a235-e11c183d5986" containerName="node" Nov 03 20:49:17.166512 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:17.166461 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="aebf9ebb-3588-4f55-b363-4694a5b6ad2f" containerName="notebook" Nov 03 20:49:17.169470 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:17.169454 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-rxdfh/test-trainjob-fail-f4kgz-dataset-initializer-0-0-zclwv" Nov 03 20:49:17.271213 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:17.271180 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-rxdfh\"/\"kube-root-ca.crt\"" Nov 03 20:49:17.271423 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:17.271405 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-rxdfh\"/\"openshift-service-ca.crt\"" Nov 03 20:49:17.271489 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:17.271419 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-rxdfh\"/\"default-dockercfg-k55xg\"" Nov 03 20:49:17.272741 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:17.272725 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-rxdfh/test-trainjob-fail-f4kgz-dataset-initializer-0-0-zclwv"] Nov 03 20:49:17.356292 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:17.356245 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-989pc\" (UniqueName: \"kubernetes.io/projected/23fe1dda-8686-4659-962c-85efc34d7c73-kube-api-access-989pc\") pod \"test-trainjob-fail-f4kgz-dataset-initializer-0-0-zclwv\" (UID: \"23fe1dda-8686-4659-962c-85efc34d7c73\") " pod="test-ns-rxdfh/test-trainjob-fail-f4kgz-dataset-initializer-0-0-zclwv" Nov 03 20:49:17.457596 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:17.457537 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-989pc\" (UniqueName: \"kubernetes.io/projected/23fe1dda-8686-4659-962c-85efc34d7c73-kube-api-access-989pc\") pod \"test-trainjob-fail-f4kgz-dataset-initializer-0-0-zclwv\" (UID: \"23fe1dda-8686-4659-962c-85efc34d7c73\") " pod="test-ns-rxdfh/test-trainjob-fail-f4kgz-dataset-initializer-0-0-zclwv" Nov 03 20:49:17.518915 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:17.518879 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-989pc\" (UniqueName: \"kubernetes.io/projected/23fe1dda-8686-4659-962c-85efc34d7c73-kube-api-access-989pc\") pod \"test-trainjob-fail-f4kgz-dataset-initializer-0-0-zclwv\" (UID: \"23fe1dda-8686-4659-962c-85efc34d7c73\") " pod="test-ns-rxdfh/test-trainjob-fail-f4kgz-dataset-initializer-0-0-zclwv" Nov 03 20:49:19.500287 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:49:19.500252 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:49:19.575289 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:19.575254 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-1d573c4a-7c98-4568-999a-71e7f9b136e2\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d76de84c7c88db2d\") pod \"test-trainjob-fail-f4kgz-dataset-initializer-0-0-zclwv\" (UID: \"23fe1dda-8686-4659-962c-85efc34d7c73\") " pod="test-ns-rxdfh/test-trainjob-fail-f4kgz-dataset-initializer-0-0-zclwv" Nov 03 20:49:19.679303 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:19.679265 5857 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-1d573c4a-7c98-4568-999a-71e7f9b136e2\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d76de84c7c88db2d\") pod \"test-trainjob-fail-f4kgz-dataset-initializer-0-0-zclwv\" (UID: \"23fe1dda-8686-4659-962c-85efc34d7c73\") device path: \"\"" pod="test-ns-rxdfh/test-trainjob-fail-f4kgz-dataset-initializer-0-0-zclwv" Nov 03 20:49:19.776913 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:19.776811 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-1d573c4a-7c98-4568-999a-71e7f9b136e2\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d76de84c7c88db2d\") pod \"test-trainjob-fail-f4kgz-dataset-initializer-0-0-zclwv\" (UID: \"23fe1dda-8686-4659-962c-85efc34d7c73\") " pod="test-ns-rxdfh/test-trainjob-fail-f4kgz-dataset-initializer-0-0-zclwv" Nov 03 20:49:19.777092 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:19.776965 5857 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-1d573c4a-7c98-4568-999a-71e7f9b136e2\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d76de84c7c88db2d\") pod \"test-trainjob-fail-f4kgz-dataset-initializer-0-0-zclwv\" (UID: \"23fe1dda-8686-4659-962c-85efc34d7c73\") DevicePath \"\"" pod="test-ns-rxdfh/test-trainjob-fail-f4kgz-dataset-initializer-0-0-zclwv" Nov 03 20:49:19.828955 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:19.828915 5857 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-1d573c4a-7c98-4568-999a-71e7f9b136e2\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d76de84c7c88db2d\") pod \"test-trainjob-fail-f4kgz-dataset-initializer-0-0-zclwv\" (UID: \"23fe1dda-8686-4659-962c-85efc34d7c73\") DevicePath \"csi-c924ac3b2202fff2f0a7f784fc9c6065033b714c2579649f71f94a8c0c5237a6\"" pod="test-ns-rxdfh/test-trainjob-fail-f4kgz-dataset-initializer-0-0-zclwv" Nov 03 20:49:20.032928 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:20.032850 5857 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-1d573c4a-7c98-4568-999a-71e7f9b136e2\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d76de84c7c88db2d\") pod \"test-trainjob-fail-f4kgz-dataset-initializer-0-0-zclwv\" (UID: \"23fe1dda-8686-4659-962c-85efc34d7c73\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/ca0f8b64bf711ec4f9671abc991ffc71f0fa46a8fec6e5e79cc5b752a762423d/globalmount\"" pod="test-ns-rxdfh/test-trainjob-fail-f4kgz-dataset-initializer-0-0-zclwv" Nov 03 20:49:20.097067 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:20.097031 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-1d573c4a-7c98-4568-999a-71e7f9b136e2\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d76de84c7c88db2d\") pod \"test-trainjob-fail-f4kgz-dataset-initializer-0-0-zclwv\" (UID: \"23fe1dda-8686-4659-962c-85efc34d7c73\") " pod="test-ns-rxdfh/test-trainjob-fail-f4kgz-dataset-initializer-0-0-zclwv" Nov 03 20:49:20.181895 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:20.181862 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-rxdfh/test-trainjob-fail-f4kgz-dataset-initializer-0-0-zclwv" Nov 03 20:49:20.560804 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:20.560766 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-rxdfh/test-trainjob-fail-f4kgz-dataset-initializer-0-0-zclwv"] Nov 03 20:49:20.595102 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:49:20.595076 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23fe1dda_8686_4659_962c_85efc34d7c73.slice/crio-f9ebc6d79986b0efa114570a821394a947c3ea2c6892758e0e6527e2d18973b0 WatchSource:0}: Error finding container f9ebc6d79986b0efa114570a821394a947c3ea2c6892758e0e6527e2d18973b0: Status 404 returned error can't find the container with id f9ebc6d79986b0efa114570a821394a947c3ea2c6892758e0e6527e2d18973b0 Nov 03 20:49:21.357588 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:21.357524 5857 generic.go:356] "Generic (PLEG): container finished" podID="23fe1dda-8686-4659-962c-85efc34d7c73" containerID="3b96bbc43da36eabf9e010d9358a4d5842bc5c9d2f56480abd5304f1806ee6e6" exitCode=1 Nov 03 20:49:21.357761 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:21.357599 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-rxdfh/test-trainjob-fail-f4kgz-dataset-initializer-0-0-zclwv" event={"ID":"23fe1dda-8686-4659-962c-85efc34d7c73","Type":"ContainerDied","Data":"3b96bbc43da36eabf9e010d9358a4d5842bc5c9d2f56480abd5304f1806ee6e6"} Nov 03 20:49:21.357761 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:21.357682 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-rxdfh/test-trainjob-fail-f4kgz-dataset-initializer-0-0-zclwv" event={"ID":"23fe1dda-8686-4659-962c-85efc34d7c73","Type":"ContainerStarted","Data":"f9ebc6d79986b0efa114570a821394a947c3ea2c6892758e0e6527e2d18973b0"} Nov 03 20:49:22.268648 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:22.268619 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rxdfh_test-trainjob-fail-f4kgz-dataset-initializer-0-0-zclwv_23fe1dda-8686-4659-962c-85efc34d7c73/dataset-initializer/0.log" Nov 03 20:49:22.499784 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:22.499753 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-rxdfh/test-trainjob-fail-f4kgz-dataset-initializer-0-0-zclwv" Nov 03 20:49:22.603594 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:22.603489 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/23fe1dda-8686-4659-962c-85efc34d7c73-kube-api-access-989pc\" (UniqueName: \"kubernetes.io/projected/23fe1dda-8686-4659-962c-85efc34d7c73-kube-api-access-989pc\") pod \"23fe1dda-8686-4659-962c-85efc34d7c73\" (UID: \"23fe1dda-8686-4659-962c-85efc34d7c73\") " Nov 03 20:49:22.603750 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:22.603623 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d76de84c7c88db2d\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d76de84c7c88db2d\") pod \"23fe1dda-8686-4659-962c-85efc34d7c73\" (UID: \"23fe1dda-8686-4659-962c-85efc34d7c73\") " Nov 03 20:49:22.606076 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:22.606046 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23fe1dda-8686-4659-962c-85efc34d7c73-kube-api-access-989pc" pod "23fe1dda-8686-4659-962c-85efc34d7c73" (UID: "23fe1dda-8686-4659-962c-85efc34d7c73"). InnerVolumeSpecName "kube-api-access-989pc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:49:22.606951 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:22.606925 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0d76de84c7c88db2d" pod "23fe1dda-8686-4659-962c-85efc34d7c73" (UID: "23fe1dda-8686-4659-962c-85efc34d7c73"). InnerVolumeSpecName "pvc-1d573c4a-7c98-4568-999a-71e7f9b136e2". PluginName "kubernetes.io/csi", VolumeGIDValue "" Nov 03 20:49:22.705036 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:22.704993 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-989pc\" (UniqueName: \"kubernetes.io/projected/23fe1dda-8686-4659-962c-85efc34d7c73-kube-api-access-989pc\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:49:22.705036 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:22.705039 5857 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-1d573c4a-7c98-4568-999a-71e7f9b136e2\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d76de84c7c88db2d\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" " Nov 03 20:49:22.719157 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:22.719134 5857 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-1d573c4a-7c98-4568-999a-71e7f9b136e2" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0d76de84c7c88db2d") on node "ip-10-0-140-181.us-west-1.compute.internal" Nov 03 20:49:22.806363 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:22.806315 5857 reconciler_common.go:299] "Volume detached for volume \"pvc-1d573c4a-7c98-4568-999a-71e7f9b136e2\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d76de84c7c88db2d\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"csi-c924ac3b2202fff2f0a7f784fc9c6065033b714c2579649f71f94a8c0c5237a6\"" Nov 03 20:49:23.368844 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:23.368813 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-rxdfh/test-trainjob-fail-f4kgz-dataset-initializer-0-0-zclwv" Nov 03 20:49:23.369372 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:23.368850 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-rxdfh/test-trainjob-fail-f4kgz-dataset-initializer-0-0-zclwv" event={"ID":"23fe1dda-8686-4659-962c-85efc34d7c73","Type":"ContainerDied","Data":"f9ebc6d79986b0efa114570a821394a947c3ea2c6892758e0e6527e2d18973b0"} Nov 03 20:49:23.369372 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:23.368894 5857 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f9ebc6d79986b0efa114570a821394a947c3ea2c6892758e0e6527e2d18973b0" Nov 03 20:49:24.859848 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:24.859800 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-rxdfh_test-trainjob-fail-f4kgz-dataset-initializer-0-0-zclwv_23fe1dda-8686-4659-962c-85efc34d7c73/dataset-initializer/0.log" Nov 03 20:49:25.459754 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:25.459718 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-fqksf/dw-deployment-kfjlm-fdcfc9f5-nckb4"] Nov 03 20:49:25.460081 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:25.460069 5857 cpu_manager.go:414] "containerMap: removing container" podUID="23fe1dda-8686-4659-962c-85efc34d7c73" containerName="dataset-initializer" Nov 03 20:49:25.460125 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:25.460082 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="23fe1dda-8686-4659-962c-85efc34d7c73" containerName="dataset-initializer" Nov 03 20:49:25.460165 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:25.460157 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="23fe1dda-8686-4659-962c-85efc34d7c73" containerName="dataset-initializer" Nov 03 20:49:25.463133 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:25.463118 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-fqksf/dw-deployment-kfjlm-fdcfc9f5-nckb4" Nov 03 20:49:25.515259 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:25.515229 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-fqksf\"/\"openshift-service-ca.crt\"" Nov 03 20:49:25.564922 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:25.564877 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-fqksf\"/\"kube-root-ca.crt\"" Nov 03 20:49:25.565084 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:25.564942 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-fqksf\"/\"default-dockercfg-498lm\"" Nov 03 20:49:25.614779 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:25.614711 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-fqksf\"/\"config-pj7vc\"" Nov 03 20:49:25.616203 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:25.616180 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-fqksf/dw-deployment-kfjlm-fdcfc9f5-nckb4"] Nov 03 20:49:25.733649 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:25.733534 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-8dbf68cb-9851-4aae-8e5d-04b205f8a224\" (UniqueName: \"kubernetes.io/nfs/036e29dc-5d2c-45d0-acf7-e64e3bc83e98-pvc-8dbf68cb-9851-4aae-8e5d-04b205f8a224\") pod \"dw-deployment-kfjlm-fdcfc9f5-nckb4\" (UID: \"036e29dc-5d2c-45d0-acf7-e64e3bc83e98\") " pod="test-ns-fqksf/dw-deployment-kfjlm-fdcfc9f5-nckb4" Nov 03 20:49:25.733649 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:25.733601 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcdzk\" (UniqueName: \"kubernetes.io/projected/036e29dc-5d2c-45d0-acf7-e64e3bc83e98-kube-api-access-bcdzk\") pod \"dw-deployment-kfjlm-fdcfc9f5-nckb4\" (UID: \"036e29dc-5d2c-45d0-acf7-e64e3bc83e98\") " pod="test-ns-fqksf/dw-deployment-kfjlm-fdcfc9f5-nckb4" Nov 03 20:49:25.733842 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:25.733699 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/036e29dc-5d2c-45d0-acf7-e64e3bc83e98-notebook-config\") pod \"dw-deployment-kfjlm-fdcfc9f5-nckb4\" (UID: \"036e29dc-5d2c-45d0-acf7-e64e3bc83e98\") " pod="test-ns-fqksf/dw-deployment-kfjlm-fdcfc9f5-nckb4" Nov 03 20:49:25.834448 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:25.834409 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-8dbf68cb-9851-4aae-8e5d-04b205f8a224\" (UniqueName: \"kubernetes.io/nfs/036e29dc-5d2c-45d0-acf7-e64e3bc83e98-pvc-8dbf68cb-9851-4aae-8e5d-04b205f8a224\") pod \"dw-deployment-kfjlm-fdcfc9f5-nckb4\" (UID: \"036e29dc-5d2c-45d0-acf7-e64e3bc83e98\") " pod="test-ns-fqksf/dw-deployment-kfjlm-fdcfc9f5-nckb4" Nov 03 20:49:25.834448 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:25.834454 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcdzk\" (UniqueName: \"kubernetes.io/projected/036e29dc-5d2c-45d0-acf7-e64e3bc83e98-kube-api-access-bcdzk\") pod \"dw-deployment-kfjlm-fdcfc9f5-nckb4\" (UID: \"036e29dc-5d2c-45d0-acf7-e64e3bc83e98\") " pod="test-ns-fqksf/dw-deployment-kfjlm-fdcfc9f5-nckb4" Nov 03 20:49:25.834762 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:25.834500 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/036e29dc-5d2c-45d0-acf7-e64e3bc83e98-notebook-config\") pod \"dw-deployment-kfjlm-fdcfc9f5-nckb4\" (UID: \"036e29dc-5d2c-45d0-acf7-e64e3bc83e98\") " pod="test-ns-fqksf/dw-deployment-kfjlm-fdcfc9f5-nckb4" Nov 03 20:49:25.835343 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:25.835315 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/036e29dc-5d2c-45d0-acf7-e64e3bc83e98-notebook-config\") pod \"dw-deployment-kfjlm-fdcfc9f5-nckb4\" (UID: \"036e29dc-5d2c-45d0-acf7-e64e3bc83e98\") " pod="test-ns-fqksf/dw-deployment-kfjlm-fdcfc9f5-nckb4" Nov 03 20:49:25.862483 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:25.862446 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-8dbf68cb-9851-4aae-8e5d-04b205f8a224\" (UniqueName: \"kubernetes.io/nfs/036e29dc-5d2c-45d0-acf7-e64e3bc83e98-pvc-8dbf68cb-9851-4aae-8e5d-04b205f8a224\") pod \"dw-deployment-kfjlm-fdcfc9f5-nckb4\" (UID: \"036e29dc-5d2c-45d0-acf7-e64e3bc83e98\") " pod="test-ns-fqksf/dw-deployment-kfjlm-fdcfc9f5-nckb4" Nov 03 20:49:25.900644 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:25.900606 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcdzk\" (UniqueName: \"kubernetes.io/projected/036e29dc-5d2c-45d0-acf7-e64e3bc83e98-kube-api-access-bcdzk\") pod \"dw-deployment-kfjlm-fdcfc9f5-nckb4\" (UID: \"036e29dc-5d2c-45d0-acf7-e64e3bc83e98\") " pod="test-ns-fqksf/dw-deployment-kfjlm-fdcfc9f5-nckb4" Nov 03 20:49:26.075382 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:26.075295 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-fqksf/dw-deployment-kfjlm-fdcfc9f5-nckb4" Nov 03 20:49:26.454382 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:26.454355 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-fqksf/dw-deployment-kfjlm-fdcfc9f5-nckb4"] Nov 03 20:49:26.457125 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:49:26.457098 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod036e29dc_5d2c_45d0_acf7_e64e3bc83e98.slice/crio-2ae966a812618a8cb1b83ab0d4b80ab4fa1bc4a5d5516acfb0b28d89d57f9cf3 WatchSource:0}: Error finding container 2ae966a812618a8cb1b83ab0d4b80ab4fa1bc4a5d5516acfb0b28d89d57f9cf3: Status 404 returned error can't find the container with id 2ae966a812618a8cb1b83ab0d4b80ab4fa1bc4a5d5516acfb0b28d89d57f9cf3 Nov 03 20:49:27.392476 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:27.392446 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-fqksf/dw-deployment-kfjlm-fdcfc9f5-nckb4" event={"ID":"036e29dc-5d2c-45d0-acf7-e64e3bc83e98","Type":"ContainerStarted","Data":"2ae966a812618a8cb1b83ab0d4b80ab4fa1bc4a5d5516acfb0b28d89d57f9cf3"} Nov 03 20:49:28.399708 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:28.399665 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-fqksf/dw-deployment-kfjlm-fdcfc9f5-nckb4" event={"ID":"036e29dc-5d2c-45d0-acf7-e64e3bc83e98","Type":"ContainerStarted","Data":"d1942d6198b430a7f6d4abd1153a467832e5a30772df1daed39e00b20a33a173"} Nov 03 20:49:28.517080 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:28.517018 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-fqksf/dw-deployment-kfjlm-fdcfc9f5-nckb4" podStartSLOduration=2.64455953 podStartE2EDuration="3.516999616s" totalImagesPullingTime="872.440086ms" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 20:49:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:49:28.51679343 +0000 UTC m=+2878.083683579" watchObservedRunningTime="2026-11-03 20:49:28.516999616 +0000 UTC m=+2878.083889765" Nov 03 20:49:29.972525 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:29.972482 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-rxdfh/test-trainjob-fail-f4kgz-dataset-initializer-0-0-zclwv"] Nov 03 20:49:29.979958 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:29.979924 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-rxdfh/test-trainjob-fail-f4kgz-dataset-initializer-0-0-zclwv"] Nov 03 20:49:30.573473 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:30.573441 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="23fe1dda-8686-4659-962c-85efc34d7c73" path="/var/lib/kubelet/pods/23fe1dda-8686-4659-962c-85efc34d7c73/volumes" Nov 03 20:49:30.999188 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:30.999161 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:49:31.247672 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:31.247635 5857 scope.go:122] "RemoveContainer" containerID="a7d989c51dbc42f14625b5f78990e79a5c83bece8f236f280eb66b8e019a7217" Nov 03 20:49:34.001654 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:34.001622 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:49:37.015190 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:37.015156 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:49:40.016090 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:40.015998 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:49:43.015606 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:43.015555 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:49:46.014667 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:46.014636 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:49:49.015123 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:49.015095 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:49:49.499930 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:49:49.499893 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:49:52.013772 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:52.013739 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:49:55.014310 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:55.014280 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:49:58.015396 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:49:58.015359 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:50:01.015995 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:50:01.015933 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:50:04.015939 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:50:04.015911 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:50:07.015145 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:50:07.015111 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:50:10.015891 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:50:10.015860 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:50:13.015715 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:50:13.015674 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:50:16.014511 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:50:16.014475 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:50:19.015762 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:50:19.015735 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:50:19.500742 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:50:19.500702 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:50:22.015442 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:50:22.015399 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:50:25.013594 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:50:25.013552 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:50:28.015014 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:50:28.014986 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:50:31.015556 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:50:31.015524 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:50:31.272324 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:50:31.272228 5857 scope.go:122] "RemoveContainer" containerID="68dfd334e6b42e861c6f19b7d4163dc45993bf8e1efaba0cee35c62f95898c33" Nov 03 20:50:34.028473 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:50:34.028444 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:50:37.014481 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:50:37.014433 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:50:40.015733 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:50:40.015702 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:50:43.014773 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:50:43.014739 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:50:46.013997 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:50:46.013968 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:50:49.015639 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:50:49.015607 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:50:49.500961 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:50:49.500917 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:50:52.014620 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:50:52.014584 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:50:55.041161 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:50:55.041131 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:50:58.015373 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:50:58.015341 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:51:01.013584 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:51:01.013539 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:51:04.014893 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:51:04.014865 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:51:07.013641 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:51:07.013612 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:51:10.015177 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:51:10.015090 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:51:13.015282 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:51:13.015254 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:51:16.014130 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:51:16.014099 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:51:19.015756 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:51:19.015727 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:51:19.499975 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:51:19.499940 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:51:22.013542 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:51:22.013508 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:51:24.999974 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:51:24.999948 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:51:28.015510 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:51:28.015480 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:51:31.041728 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:51:31.041699 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:51:34.015346 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:51:34.015300 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:51:37.014330 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:51:37.014289 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:51:40.015024 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:51:40.014988 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:51:43.015631 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:51:43.015596 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:51:46.012880 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:51:46.012846 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:51:49.013235 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:51:49.013202 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:51:49.499149 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:51:49.499111 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:51:52.015412 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:51:52.015385 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:51:55.013409 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:51:55.013377 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:51:58.014918 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:51:58.014881 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:52:01.014833 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:52:01.014789 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:52:04.015280 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:52:04.015231 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:52:07.014549 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:52:07.014516 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:52:10.016050 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:52:10.016020 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:52:13.018513 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:52:13.018485 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:52:16.012976 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:52:16.012945 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:52:19.015398 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:52:19.015367 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:52:19.500759 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:52:19.500720 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:52:22.039695 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:52:22.039666 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:52:25.015190 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:52:25.015161 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:52:28.013597 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:52:28.013543 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:52:31.015150 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:52:31.015118 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:52:31.300200 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:52:31.300119 5857 scope.go:122] "RemoveContainer" containerID="4018f4af4ea9edc07d2028f0837e44e5169a9570b11e21963804b57aab46a7dc" Nov 03 20:52:31.327021 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:52:31.327002 5857 scope.go:122] "RemoveContainer" containerID="9d3ad4d61f24a66ac57d6a9ffa97d70663e912052c42fe08ce1c8446508e3d7a" Nov 03 20:52:34.027998 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:52:34.027967 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:52:37.015095 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:52:37.015062 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:52:40.016539 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:52:40.016451 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:52:43.015348 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:52:43.015310 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:52:46.013463 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:52:46.013435 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:52:49.015345 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:52:49.015318 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:52:49.500071 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:52:49.500035 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:52:52.016108 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:52:52.016078 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:52:55.016143 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:52:55.016104 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:52:58.015371 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:52:58.015341 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:53:01.016036 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:53:01.016001 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:53:04.015584 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:53:04.015543 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:53:07.015184 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:53:07.015154 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:53:10.016513 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:53:10.016482 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:53:13.015527 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:53:13.015495 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:53:16.013121 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:53:16.013090 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:53:19.015359 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:53:19.015323 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:53:19.500590 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:53:19.500535 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:53:22.015527 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:53:22.015497 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:53:25.014468 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:53:25.014436 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:53:28.015258 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:53:28.015229 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:53:31.015074 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:53:31.015045 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:53:31.374518 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:53:31.374431 5857 scope.go:122] "RemoveContainer" containerID="a805cabb81f21323cd230cf6e75bdaddb4f9aea6a13ea76a0acca7b179003fd6" Nov 03 20:53:31.401607 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:53:31.401580 5857 scope.go:122] "RemoveContainer" containerID="b5618cc8ae1d420da6aa6ec42a89caa406c1bc17431f7c26509ee8f33d0d912c" Nov 03 20:53:34.014737 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:53:34.014707 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:53:37.015845 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:53:37.015816 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:53:40.017423 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:53:40.017393 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:53:43.083775 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:53:43.083746 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:53:46.014352 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:53:46.014316 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:53:49.014627 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:53:49.014544 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:53:49.500537 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:53:49.500493 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:53:52.015505 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:53:52.015473 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:53:55.015207 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:53:55.015177 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:53:58.014927 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:53:58.014899 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:54:01.016087 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:54:01.016058 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:54:04.015087 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:54:04.015061 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:54:07.013658 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:54:07.013629 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:54:10.013771 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:54:10.013690 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:54:13.015539 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:54:13.015505 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:54:16.013438 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:54:16.013395 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:54:19.016089 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:54:19.016063 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:54:19.500257 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:54:19.500218 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:54:22.066957 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:54:22.066933 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:54:25.020589 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:54:25.020550 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:54:28.015121 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:54:28.015089 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:54:31.015365 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:54:31.015331 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:54:34.014970 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:54:34.014930 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:54:37.012692 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:54:37.012664 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:54:40.017318 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:54:40.017250 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:54:43.016094 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:54:43.016054 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:54:46.013725 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:54:46.013693 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:54:49.015701 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:54:49.015664 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:54:49.501638 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:54:49.501602 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:54:52.015296 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:54:52.015260 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:54:55.015883 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:54:55.015852 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:54:58.014936 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:54:58.014896 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:55:01.015225 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:55:01.015175 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:55:04.015130 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:55:04.015096 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:55:07.013630 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:55:07.013500 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:55:10.025093 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:55:10.025019 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:55:13.019978 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:55:13.019926 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:55:16.016212 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:55:16.016157 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:55:19.015212 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:55:19.015177 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:55:19.500855 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:55:19.500821 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:55:22.015834 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:55:22.015758 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:55:25.016580 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:55:25.016526 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:55:28.015091 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:55:28.015064 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:55:31.015501 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:55:31.015468 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:55:31.451926 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:55:31.451903 5857 scope.go:122] "RemoveContainer" containerID="3b96bbc43da36eabf9e010d9358a4d5842bc5c9d2f56480abd5304f1806ee6e6" Nov 03 20:55:34.014356 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:55:34.014328 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:55:37.028884 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:55:37.028836 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:55:40.016777 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:55:40.016674 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:55:43.015588 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:55:43.015537 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:55:46.013175 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:55:46.013144 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:55:49.014630 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:55:49.014594 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:55:49.501433 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:55:49.501386 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:55:52.015806 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:55:52.015699 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:55:55.015110 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:55:55.015080 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:55:58.015437 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:55:58.015404 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:56:01.013939 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:56:01.013904 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:56:04.027556 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:56:04.027502 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:56:07.014182 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:56:07.014151 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:56:10.015259 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:56:10.015213 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:56:13.017650 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:56:13.017604 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:56:16.013113 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:56:16.013079 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:56:19.016700 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:56:19.016641 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:56:19.500454 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:56:19.500419 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:56:22.015684 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:56:22.015656 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:56:25.012957 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:56:25.012923 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:56:28.015013 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:56:28.014984 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:56:31.015146 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:56:31.015089 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:56:34.015390 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:56:34.015338 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:56:37.014220 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:56:37.014189 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:56:40.105957 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:56:40.105926 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:56:43.053258 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:56:43.053220 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:56:46.013158 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:56:46.013122 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:56:49.014094 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:56:49.014066 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:56:49.500841 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:56:49.500802 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:56:52.015604 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:56:52.015549 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:56:55.017199 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:56:55.017173 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:56:58.017179 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:56:58.017143 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:57:01.018971 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:01.018915 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:57:04.017985 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:04.017953 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:57:05.985871 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:05.985832 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-fqksf/dw-deployment-kfjlm-fdcfc9f5-nckb4"] Nov 03 20:57:05.986268 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:05.986034 5857 kuberuntime_container.go:898] "Killing container with a grace period" pod="test-ns-fqksf/dw-deployment-kfjlm-fdcfc9f5-nckb4" podUID="036e29dc-5d2c-45d0-acf7-e64e3bc83e98" containerName="notebook" containerID="cri-o://d1942d6198b430a7f6d4abd1153a467832e5a30772df1daed39e00b20a33a173" gracePeriod=30 Nov 03 20:57:06.047520 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:06.047490 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fqksf_dw-deployment-kfjlm-fdcfc9f5-nckb4_036e29dc-5d2c-45d0-acf7-e64e3bc83e98/notebook/0.log" Nov 03 20:57:06.820017 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:06.819980 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-pfdkm/dw-deployment-26797-645cc7f6b7-5xlhn"] Nov 03 20:57:06.823470 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:06.823450 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-pfdkm/dw-deployment-26797-645cc7f6b7-5xlhn" Nov 03 20:57:06.876376 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:06.876343 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-pfdkm\"/\"default-dockercfg-rsxgj\"" Nov 03 20:57:06.925881 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:06.925838 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-pfdkm\"/\"openshift-service-ca.crt\"" Nov 03 20:57:06.925881 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:06.925888 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-pfdkm\"/\"kube-root-ca.crt\"" Nov 03 20:57:06.926109 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:06.925951 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-pfdkm\"/\"config-9trv2\"" Nov 03 20:57:06.976796 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:06.976766 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-pfdkm/dw-deployment-26797-645cc7f6b7-5xlhn"] Nov 03 20:57:07.101097 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:07.101012 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/2c26eaaf-33ee-44af-996e-fab02f2bcb29-notebook-config\") pod \"dw-deployment-26797-645cc7f6b7-5xlhn\" (UID: \"2c26eaaf-33ee-44af-996e-fab02f2bcb29\") " pod="test-ns-pfdkm/dw-deployment-26797-645cc7f6b7-5xlhn" Nov 03 20:57:07.101097 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:07.101076 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbtgr\" (UniqueName: \"kubernetes.io/projected/2c26eaaf-33ee-44af-996e-fab02f2bcb29-kube-api-access-lbtgr\") pod \"dw-deployment-26797-645cc7f6b7-5xlhn\" (UID: \"2c26eaaf-33ee-44af-996e-fab02f2bcb29\") " pod="test-ns-pfdkm/dw-deployment-26797-645cc7f6b7-5xlhn" Nov 03 20:57:07.101515 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:07.101148 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-cdf8e142-4925-4f5c-8a19-0e20e3e4c1ab\" (UniqueName: \"kubernetes.io/nfs/2c26eaaf-33ee-44af-996e-fab02f2bcb29-pvc-cdf8e142-4925-4f5c-8a19-0e20e3e4c1ab\") pod \"dw-deployment-26797-645cc7f6b7-5xlhn\" (UID: \"2c26eaaf-33ee-44af-996e-fab02f2bcb29\") " pod="test-ns-pfdkm/dw-deployment-26797-645cc7f6b7-5xlhn" Nov 03 20:57:07.202218 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:07.202185 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/2c26eaaf-33ee-44af-996e-fab02f2bcb29-notebook-config\") pod \"dw-deployment-26797-645cc7f6b7-5xlhn\" (UID: \"2c26eaaf-33ee-44af-996e-fab02f2bcb29\") " pod="test-ns-pfdkm/dw-deployment-26797-645cc7f6b7-5xlhn" Nov 03 20:57:07.202382 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:07.202250 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbtgr\" (UniqueName: \"kubernetes.io/projected/2c26eaaf-33ee-44af-996e-fab02f2bcb29-kube-api-access-lbtgr\") pod \"dw-deployment-26797-645cc7f6b7-5xlhn\" (UID: \"2c26eaaf-33ee-44af-996e-fab02f2bcb29\") " pod="test-ns-pfdkm/dw-deployment-26797-645cc7f6b7-5xlhn" Nov 03 20:57:07.202382 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:07.202279 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-cdf8e142-4925-4f5c-8a19-0e20e3e4c1ab\" (UniqueName: \"kubernetes.io/nfs/2c26eaaf-33ee-44af-996e-fab02f2bcb29-pvc-cdf8e142-4925-4f5c-8a19-0e20e3e4c1ab\") pod \"dw-deployment-26797-645cc7f6b7-5xlhn\" (UID: \"2c26eaaf-33ee-44af-996e-fab02f2bcb29\") " pod="test-ns-pfdkm/dw-deployment-26797-645cc7f6b7-5xlhn" Nov 03 20:57:07.203044 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:07.203023 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/2c26eaaf-33ee-44af-996e-fab02f2bcb29-notebook-config\") pod \"dw-deployment-26797-645cc7f6b7-5xlhn\" (UID: \"2c26eaaf-33ee-44af-996e-fab02f2bcb29\") " pod="test-ns-pfdkm/dw-deployment-26797-645cc7f6b7-5xlhn" Nov 03 20:57:07.231416 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:07.231389 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-cdf8e142-4925-4f5c-8a19-0e20e3e4c1ab\" (UniqueName: \"kubernetes.io/nfs/2c26eaaf-33ee-44af-996e-fab02f2bcb29-pvc-cdf8e142-4925-4f5c-8a19-0e20e3e4c1ab\") pod \"dw-deployment-26797-645cc7f6b7-5xlhn\" (UID: \"2c26eaaf-33ee-44af-996e-fab02f2bcb29\") " pod="test-ns-pfdkm/dw-deployment-26797-645cc7f6b7-5xlhn" Nov 03 20:57:07.263119 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:07.263089 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbtgr\" (UniqueName: \"kubernetes.io/projected/2c26eaaf-33ee-44af-996e-fab02f2bcb29-kube-api-access-lbtgr\") pod \"dw-deployment-26797-645cc7f6b7-5xlhn\" (UID: \"2c26eaaf-33ee-44af-996e-fab02f2bcb29\") " pod="test-ns-pfdkm/dw-deployment-26797-645cc7f6b7-5xlhn" Nov 03 20:57:07.436500 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:07.436409 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-pfdkm/dw-deployment-26797-645cc7f6b7-5xlhn" Nov 03 20:57:07.814773 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:07.814747 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-pfdkm/dw-deployment-26797-645cc7f6b7-5xlhn"] Nov 03 20:57:07.817622 ip-10-0-140-181 kubenswrapper[5857]: W1103 20:57:07.817552 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c26eaaf_33ee_44af_996e_fab02f2bcb29.slice/crio-f33c7e2c5856bb53dcc4cd6631db10e67262d9be26963cad22993a6daa12a225 WatchSource:0}: Error finding container f33c7e2c5856bb53dcc4cd6631db10e67262d9be26963cad22993a6daa12a225: Status 404 returned error can't find the container with id f33c7e2c5856bb53dcc4cd6631db10e67262d9be26963cad22993a6daa12a225 Nov 03 20:57:07.819020 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:07.819001 5857 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 03 20:57:08.602912 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:08.602880 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-pfdkm/dw-deployment-26797-645cc7f6b7-5xlhn" event={"ID":"2c26eaaf-33ee-44af-996e-fab02f2bcb29","Type":"ContainerStarted","Data":"f33c7e2c5856bb53dcc4cd6631db10e67262d9be26963cad22993a6daa12a225"} Nov 03 20:57:09.608999 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:09.608960 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-pfdkm/dw-deployment-26797-645cc7f6b7-5xlhn" event={"ID":"2c26eaaf-33ee-44af-996e-fab02f2bcb29","Type":"ContainerStarted","Data":"22554b871a5619323ca417e3f7a8512feec3510301c48a9e53baec206ef0b18a"} Nov 03 20:57:09.727357 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:09.727283 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-pfdkm/dw-deployment-26797-645cc7f6b7-5xlhn" podStartSLOduration=2.77576043 podStartE2EDuration="3.727267886s" totalImagesPullingTime="951.507456ms" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 20:57:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:57:09.725338021 +0000 UTC m=+3339.292228215" watchObservedRunningTime="2026-11-03 20:57:09.727267886 +0000 UTC m=+3339.294158034" Nov 03 20:57:12.367650 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:12.367622 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:57:15.363579 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:15.363537 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:57:18.391120 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:18.391085 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:57:19.500278 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:57:19.500245 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:57:21.376319 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:21.376292 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:57:24.390197 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:24.390164 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:57:27.390160 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:27.390127 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:57:30.404194 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:30.404162 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:57:33.390451 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:33.390418 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:57:36.170460 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:36.170438 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-fqksf/dw-deployment-kfjlm-fdcfc9f5-nckb4" Nov 03 20:57:36.260306 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:36.260224 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/nfs/036e29dc-5d2c-45d0-acf7-e64e3bc83e98-pvc-8dbf68cb-9851-4aae-8e5d-04b205f8a224\" (UniqueName: \"kubernetes.io/nfs/036e29dc-5d2c-45d0-acf7-e64e3bc83e98-pvc-8dbf68cb-9851-4aae-8e5d-04b205f8a224\") pod \"036e29dc-5d2c-45d0-acf7-e64e3bc83e98\" (UID: \"036e29dc-5d2c-45d0-acf7-e64e3bc83e98\") " Nov 03 20:57:36.260306 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:36.260269 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/036e29dc-5d2c-45d0-acf7-e64e3bc83e98-notebook-config\" (UniqueName: \"kubernetes.io/configmap/036e29dc-5d2c-45d0-acf7-e64e3bc83e98-notebook-config\") pod \"036e29dc-5d2c-45d0-acf7-e64e3bc83e98\" (UID: \"036e29dc-5d2c-45d0-acf7-e64e3bc83e98\") " Nov 03 20:57:36.260513 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:36.260350 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/036e29dc-5d2c-45d0-acf7-e64e3bc83e98-kube-api-access-bcdzk\" (UniqueName: \"kubernetes.io/projected/036e29dc-5d2c-45d0-acf7-e64e3bc83e98-kube-api-access-bcdzk\") pod \"036e29dc-5d2c-45d0-acf7-e64e3bc83e98\" (UID: \"036e29dc-5d2c-45d0-acf7-e64e3bc83e98\") " Nov 03 20:57:36.260747 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:36.260729 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/036e29dc-5d2c-45d0-acf7-e64e3bc83e98-notebook-config" pod "036e29dc-5d2c-45d0-acf7-e64e3bc83e98" (UID: "036e29dc-5d2c-45d0-acf7-e64e3bc83e98"). InnerVolumeSpecName "notebook-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:57:36.262850 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:36.262822 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/036e29dc-5d2c-45d0-acf7-e64e3bc83e98-kube-api-access-bcdzk" pod "036e29dc-5d2c-45d0-acf7-e64e3bc83e98" (UID: "036e29dc-5d2c-45d0-acf7-e64e3bc83e98"). InnerVolumeSpecName "kube-api-access-bcdzk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:57:36.289937 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:36.289909 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/nfs/036e29dc-5d2c-45d0-acf7-e64e3bc83e98-pvc-8dbf68cb-9851-4aae-8e5d-04b205f8a224" pod "036e29dc-5d2c-45d0-acf7-e64e3bc83e98" (UID: "036e29dc-5d2c-45d0-acf7-e64e3bc83e98"). InnerVolumeSpecName "pvc-8dbf68cb-9851-4aae-8e5d-04b205f8a224". PluginName "kubernetes.io/nfs", VolumeGIDValue "" Nov 03 20:57:36.360939 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:36.360910 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bcdzk\" (UniqueName: \"kubernetes.io/projected/036e29dc-5d2c-45d0-acf7-e64e3bc83e98-kube-api-access-bcdzk\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:57:36.360939 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:36.360923 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:57:36.360939 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:36.360937 5857 reconciler_common.go:299] "Volume detached for volume \"pvc-8dbf68cb-9851-4aae-8e5d-04b205f8a224\" (UniqueName: \"kubernetes.io/nfs/036e29dc-5d2c-45d0-acf7-e64e3bc83e98-pvc-8dbf68cb-9851-4aae-8e5d-04b205f8a224\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:57:36.361215 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:36.360952 5857 reconciler_common.go:299] "Volume detached for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/036e29dc-5d2c-45d0-acf7-e64e3bc83e98-notebook-config\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:57:36.736427 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:36.736394 5857 generic.go:356] "Generic (PLEG): container finished" podID="036e29dc-5d2c-45d0-acf7-e64e3bc83e98" containerID="d1942d6198b430a7f6d4abd1153a467832e5a30772df1daed39e00b20a33a173" exitCode=137 Nov 03 20:57:36.736654 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:36.736446 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-fqksf/dw-deployment-kfjlm-fdcfc9f5-nckb4" event={"ID":"036e29dc-5d2c-45d0-acf7-e64e3bc83e98","Type":"ContainerDied","Data":"d1942d6198b430a7f6d4abd1153a467832e5a30772df1daed39e00b20a33a173"} Nov 03 20:57:36.736654 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:36.736457 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-fqksf/dw-deployment-kfjlm-fdcfc9f5-nckb4" Nov 03 20:57:36.736654 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:36.736509 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-fqksf/dw-deployment-kfjlm-fdcfc9f5-nckb4" event={"ID":"036e29dc-5d2c-45d0-acf7-e64e3bc83e98","Type":"ContainerDied","Data":"2ae966a812618a8cb1b83ab0d4b80ab4fa1bc4a5d5516acfb0b28d89d57f9cf3"} Nov 03 20:57:36.736654 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:36.736530 5857 scope.go:122] "RemoveContainer" containerID="d1942d6198b430a7f6d4abd1153a467832e5a30772df1daed39e00b20a33a173" Nov 03 20:57:36.756620 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:36.756593 5857 scope.go:122] "RemoveContainer" containerID="d1942d6198b430a7f6d4abd1153a467832e5a30772df1daed39e00b20a33a173" Nov 03 20:57:36.756924 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:57:36.756897 5857 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1942d6198b430a7f6d4abd1153a467832e5a30772df1daed39e00b20a33a173\": container with ID starting with d1942d6198b430a7f6d4abd1153a467832e5a30772df1daed39e00b20a33a173 not found: ID does not exist" containerID="d1942d6198b430a7f6d4abd1153a467832e5a30772df1daed39e00b20a33a173" Nov 03 20:57:36.756976 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:36.756934 5857 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1942d6198b430a7f6d4abd1153a467832e5a30772df1daed39e00b20a33a173"} err="failed to get container status \"d1942d6198b430a7f6d4abd1153a467832e5a30772df1daed39e00b20a33a173\": rpc error: code = NotFound desc = could not find container \"d1942d6198b430a7f6d4abd1153a467832e5a30772df1daed39e00b20a33a173\": container with ID starting with d1942d6198b430a7f6d4abd1153a467832e5a30772df1daed39e00b20a33a173 not found: ID does not exist" Nov 03 20:57:36.899414 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:36.899332 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-fqksf/dw-deployment-kfjlm-fdcfc9f5-nckb4"] Nov 03 20:57:36.948746 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:36.948714 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-fqksf/dw-deployment-kfjlm-fdcfc9f5-nckb4"] Nov 03 20:57:38.572493 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:38.572459 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="036e29dc-5d2c-45d0-acf7-e64e3bc83e98" path="/var/lib/kubelet/pods/036e29dc-5d2c-45d0-acf7-e64e3bc83e98/volumes" Nov 03 20:57:39.390046 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:39.390014 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:57:42.388079 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:42.388044 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:57:45.390236 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:45.390205 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:57:48.390313 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:48.390278 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:57:49.500164 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:57:49.500130 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:57:51.392601 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:51.392550 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:57:54.390807 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:54.390759 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:57:57.375090 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:57:57.375059 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:58:00.391260 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:58:00.391229 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:58:03.389116 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:58:03.389081 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:58:06.391112 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:58:06.391077 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:58:09.390330 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:58:09.390301 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:58:12.361164 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:58:12.361134 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:58:15.389643 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:58:15.389600 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:58:18.389220 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:58:18.389185 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:58:19.500827 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:58:19.500788 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:58:21.389208 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:58:21.389171 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:58:24.388869 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:58:24.388839 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:58:27.389743 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:58:27.389714 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:58:30.390265 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:58:30.390231 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:58:33.376057 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:58:33.376026 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:58:36.391490 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:58:36.391457 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:58:39.389435 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:58:39.389359 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:58:42.391261 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:58:42.391230 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:58:45.389286 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:58:45.389254 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:58:48.389397 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:58:48.389365 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:58:49.500439 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:58:49.500402 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:58:51.391082 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:58:51.391047 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:58:54.389400 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:58:54.389366 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:58:57.390349 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:58:57.390311 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:59:00.389347 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:59:00.389314 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:59:03.389116 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:59:03.389089 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:59:06.391319 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:59:06.391285 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:59:09.362263 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:59:09.362233 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:59:12.390945 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:59:12.390916 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:59:15.389824 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:59:15.389793 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:59:18.390142 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:59:18.390105 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:59:19.500629 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:59:19.500588 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:59:21.389863 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:59:21.389832 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:59:24.443167 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:59:24.443135 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:59:27.391578 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:59:27.391543 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:59:30.389323 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:59:30.389283 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:59:33.389401 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:59:33.389372 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:59:36.389672 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:59:36.389640 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:59:39.391011 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:59:39.390983 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:59:42.397003 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:59:42.396972 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:59:45.375265 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:59:45.375237 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:59:48.391594 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:59:48.391545 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:59:49.500382 ip-10-0-140-181 kubenswrapper[5857]: E1103 20:59:49.500349 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 20:59:51.389083 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:59:51.389057 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:59:54.391085 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:59:54.391046 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 20:59:57.390386 ip-10-0-140-181 kubenswrapper[5857]: I1103 20:59:57.390351 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:00:00.390575 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:00:00.390526 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:00:03.391196 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:00:03.391161 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:00:06.389361 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:00:06.389331 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:00:09.391363 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:00:09.391286 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:00:12.389182 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:00:12.389154 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:00:15.391838 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:00:15.391813 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:00:18.390441 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:00:18.390406 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:00:19.500622 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:00:19.500587 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:00:21.374951 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:00:21.374922 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:00:24.391479 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:00:24.391445 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:00:27.388767 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:00:27.388740 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:00:30.388492 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:00:30.388463 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:00:33.407927 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:00:33.407896 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:00:36.390330 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:00:36.390292 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:00:39.392235 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:00:39.392198 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:00:42.374549 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:00:42.374517 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:00:45.392030 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:00:45.391999 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:00:48.390053 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:00:48.390020 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:00:49.499700 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:00:49.499665 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:00:51.391554 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:00:51.391520 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:00:54.390177 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:00:54.390142 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:00:57.370191 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:00:57.370160 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:01:00.390989 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:01:00.390957 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:01:03.389119 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:01:03.389093 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:01:06.391495 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:01:06.391460 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:01:09.390208 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:01:09.390175 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:01:12.391341 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:01:12.391312 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:01:15.391185 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:01:15.391145 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:01:18.390026 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:01:18.389996 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:01:19.503712 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:01:19.500168 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:01:21.390709 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:01:21.390674 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:01:24.389290 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:01:24.389262 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:01:27.390648 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:01:27.390616 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:01:30.389263 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:01:30.389237 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:01:33.388649 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:01:33.388618 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:01:36.391760 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:01:36.391733 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:01:39.391193 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:01:39.391118 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:01:42.390456 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:01:42.390426 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:01:45.390104 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:01:45.390075 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:01:48.389070 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:01:48.389039 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:01:49.501310 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:01:49.501270 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:01:51.388277 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:01:51.388250 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:01:54.390029 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:01:54.389996 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:01:57.391805 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:01:57.391773 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:02:00.389073 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:02:00.389041 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:02:03.388917 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:02:03.388892 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:02:06.390613 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:02:06.390543 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:02:09.390996 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:02:09.390954 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:02:12.392801 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:02:12.392761 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:02:15.391206 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:02:15.391173 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:02:18.398240 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:02:18.398203 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:02:19.500031 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:02:19.499996 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:02:21.392901 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:02:21.392866 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:02:24.389961 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:02:24.389931 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:02:27.390296 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:02:27.390263 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:02:30.390576 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:02:30.390531 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:02:33.375469 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:02:33.375439 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:02:36.389797 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:02:36.389769 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:02:39.391143 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:02:39.391112 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:02:42.389509 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:02:42.389480 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:02:45.402819 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:02:45.402786 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:02:48.391531 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:02:48.391497 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:02:49.500430 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:02:49.500393 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:02:51.390412 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:02:51.390384 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:02:54.388765 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:02:54.388727 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:02:57.393215 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:02:57.393183 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:03:00.390159 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:03:00.390116 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:03:03.375010 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:03:03.374970 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:03:06.390027 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:03:06.389973 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:03:09.390602 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:03:09.390490 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:03:12.393684 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:03:12.393638 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:03:15.390486 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:03:15.390456 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:03:18.390885 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:03:18.390858 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:03:19.500205 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:03:19.500160 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:03:21.389682 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:03:21.389654 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:03:24.389727 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:03:24.389694 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:03:27.391328 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:03:27.391291 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:03:30.392321 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:03:30.392293 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:03:33.375751 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:03:33.375720 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:03:36.391253 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:03:36.391221 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:03:39.391063 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:03:39.391022 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:03:42.392288 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:03:42.392261 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:03:45.390764 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:03:45.390724 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:03:48.391205 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:03:48.391168 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:03:49.500716 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:03:49.500678 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:03:51.391410 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:03:51.391370 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:03:54.389940 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:03:54.389905 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:03:57.390893 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:03:57.390848 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:04:00.391539 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:04:00.391501 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:04:03.362224 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:04:03.362181 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:04:06.390923 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:04:06.390887 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:04:09.430161 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:04:09.430126 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:04:12.390673 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:04:12.390639 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:04:15.389905 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:04:15.389872 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:04:18.390454 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:04:18.390423 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:04:19.500640 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:04:19.500601 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:04:21.390504 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:04:21.390475 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:04:24.388544 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:04:24.388487 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:04:27.443502 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:04:27.443474 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:04:30.390395 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:04:30.390356 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:04:33.391334 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:04:33.391301 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:04:36.393247 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:04:36.393210 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:04:39.390590 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:04:39.390481 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:04:42.392246 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:04:42.392208 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:04:45.390955 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:04:45.390926 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:04:48.390086 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:04:48.390054 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:04:49.501223 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:04:49.501180 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:04:51.389988 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:04:51.389960 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:04:54.392070 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:04:54.392040 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:04:57.390980 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:04:57.390948 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:05:00.390481 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:05:00.390452 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:05:03.391102 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:05:03.391052 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:05:06.391594 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:05:06.391538 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:05:09.390497 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:05:09.390463 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:05:12.390891 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:05:12.390849 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:05:15.391300 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:05:15.391266 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:05:18.390371 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:05:18.390335 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:05:19.500224 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:05:19.500186 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:05:21.389501 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:05:21.389469 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:05:24.389172 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:05:24.389142 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:05:27.391211 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:05:27.391181 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:05:30.391029 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:05:30.391001 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:05:33.399952 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:05:33.399923 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:05:36.390944 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:05:36.390908 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:05:39.391835 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:05:39.391800 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:05:42.391159 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:05:42.391126 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:05:45.389805 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:05:45.389769 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:05:48.390104 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:05:48.390071 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:05:49.501438 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:05:49.501399 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:05:51.391809 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:05:51.391781 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:05:54.389196 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:05:54.389150 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:05:57.391065 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:05:57.391029 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:06:00.391422 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:00.391389 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:06:03.389727 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:03.389696 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:06:04.028734 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:04.028693 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-pfdkm/dw-deployment-26797-645cc7f6b7-5xlhn"] Nov 03 21:06:04.028969 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:04.028932 5857 kuberuntime_container.go:898] "Killing container with a grace period" pod="test-ns-pfdkm/dw-deployment-26797-645cc7f6b7-5xlhn" podUID="2c26eaaf-33ee-44af-996e-fab02f2bcb29" containerName="notebook" containerID="cri-o://22554b871a5619323ca417e3f7a8512feec3510301c48a9e53baec206ef0b18a" gracePeriod=30 Nov 03 21:06:04.160652 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:04.160626 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfdkm_dw-deployment-26797-645cc7f6b7-5xlhn_2c26eaaf-33ee-44af-996e-fab02f2bcb29/notebook/0.log" Nov 03 21:06:04.822071 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:04.822036 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-ksdrs/dw-deployment-zlbk8-7444dc4546-sxwf8"] Nov 03 21:06:04.822462 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:04.822408 5857 cpu_manager.go:414] "containerMap: removing container" podUID="036e29dc-5d2c-45d0-acf7-e64e3bc83e98" containerName="notebook" Nov 03 21:06:04.822462 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:04.822418 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="036e29dc-5d2c-45d0-acf7-e64e3bc83e98" containerName="notebook" Nov 03 21:06:04.822539 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:04.822494 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="036e29dc-5d2c-45d0-acf7-e64e3bc83e98" containerName="notebook" Nov 03 21:06:04.825539 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:04.825524 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-ksdrs/dw-deployment-zlbk8-7444dc4546-sxwf8" Nov 03 21:06:04.926935 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:04.926899 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-ksdrs\"/\"openshift-service-ca.crt\"" Nov 03 21:06:04.927150 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:04.926997 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-ksdrs\"/\"default-dockercfg-k4v27\"" Nov 03 21:06:04.927241 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:04.927219 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-ksdrs\"/\"kube-root-ca.crt\"" Nov 03 21:06:04.927321 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:04.927304 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-ksdrs\"/\"config-xztxj\"" Nov 03 21:06:04.928667 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:04.928646 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-ksdrs/dw-deployment-zlbk8-7444dc4546-sxwf8"] Nov 03 21:06:05.083312 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:05.083218 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-74a8e5be-aa6c-41ea-85c4-0fd83bf60a55\" (UniqueName: \"kubernetes.io/nfs/2787ca9a-53da-4b0f-8128-b03544c143ed-pvc-74a8e5be-aa6c-41ea-85c4-0fd83bf60a55\") pod \"dw-deployment-zlbk8-7444dc4546-sxwf8\" (UID: \"2787ca9a-53da-4b0f-8128-b03544c143ed\") " pod="test-ns-ksdrs/dw-deployment-zlbk8-7444dc4546-sxwf8" Nov 03 21:06:05.083312 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:05.083264 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/2787ca9a-53da-4b0f-8128-b03544c143ed-notebook-config\") pod \"dw-deployment-zlbk8-7444dc4546-sxwf8\" (UID: \"2787ca9a-53da-4b0f-8128-b03544c143ed\") " pod="test-ns-ksdrs/dw-deployment-zlbk8-7444dc4546-sxwf8" Nov 03 21:06:05.083312 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:05.083307 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r24rt\" (UniqueName: \"kubernetes.io/projected/2787ca9a-53da-4b0f-8128-b03544c143ed-kube-api-access-r24rt\") pod \"dw-deployment-zlbk8-7444dc4546-sxwf8\" (UID: \"2787ca9a-53da-4b0f-8128-b03544c143ed\") " pod="test-ns-ksdrs/dw-deployment-zlbk8-7444dc4546-sxwf8" Nov 03 21:06:05.184450 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:05.184418 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-74a8e5be-aa6c-41ea-85c4-0fd83bf60a55\" (UniqueName: \"kubernetes.io/nfs/2787ca9a-53da-4b0f-8128-b03544c143ed-pvc-74a8e5be-aa6c-41ea-85c4-0fd83bf60a55\") pod \"dw-deployment-zlbk8-7444dc4546-sxwf8\" (UID: \"2787ca9a-53da-4b0f-8128-b03544c143ed\") " pod="test-ns-ksdrs/dw-deployment-zlbk8-7444dc4546-sxwf8" Nov 03 21:06:05.184450 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:05.184458 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/2787ca9a-53da-4b0f-8128-b03544c143ed-notebook-config\") pod \"dw-deployment-zlbk8-7444dc4546-sxwf8\" (UID: \"2787ca9a-53da-4b0f-8128-b03544c143ed\") " pod="test-ns-ksdrs/dw-deployment-zlbk8-7444dc4546-sxwf8" Nov 03 21:06:05.184763 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:05.184494 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r24rt\" (UniqueName: \"kubernetes.io/projected/2787ca9a-53da-4b0f-8128-b03544c143ed-kube-api-access-r24rt\") pod \"dw-deployment-zlbk8-7444dc4546-sxwf8\" (UID: \"2787ca9a-53da-4b0f-8128-b03544c143ed\") " pod="test-ns-ksdrs/dw-deployment-zlbk8-7444dc4546-sxwf8" Nov 03 21:06:05.185301 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:05.185209 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/2787ca9a-53da-4b0f-8128-b03544c143ed-notebook-config\") pod \"dw-deployment-zlbk8-7444dc4546-sxwf8\" (UID: \"2787ca9a-53da-4b0f-8128-b03544c143ed\") " pod="test-ns-ksdrs/dw-deployment-zlbk8-7444dc4546-sxwf8" Nov 03 21:06:05.212392 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:05.212356 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-74a8e5be-aa6c-41ea-85c4-0fd83bf60a55\" (UniqueName: \"kubernetes.io/nfs/2787ca9a-53da-4b0f-8128-b03544c143ed-pvc-74a8e5be-aa6c-41ea-85c4-0fd83bf60a55\") pod \"dw-deployment-zlbk8-7444dc4546-sxwf8\" (UID: \"2787ca9a-53da-4b0f-8128-b03544c143ed\") " pod="test-ns-ksdrs/dw-deployment-zlbk8-7444dc4546-sxwf8" Nov 03 21:06:05.245745 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:05.245720 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r24rt\" (UniqueName: \"kubernetes.io/projected/2787ca9a-53da-4b0f-8128-b03544c143ed-kube-api-access-r24rt\") pod \"dw-deployment-zlbk8-7444dc4546-sxwf8\" (UID: \"2787ca9a-53da-4b0f-8128-b03544c143ed\") " pod="test-ns-ksdrs/dw-deployment-zlbk8-7444dc4546-sxwf8" Nov 03 21:06:05.439770 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:05.439687 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-ksdrs/dw-deployment-zlbk8-7444dc4546-sxwf8" Nov 03 21:06:05.816280 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:05.816243 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-ksdrs/dw-deployment-zlbk8-7444dc4546-sxwf8"] Nov 03 21:06:05.819543 ip-10-0-140-181 kubenswrapper[5857]: W1103 21:06:05.819518 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2787ca9a_53da_4b0f_8128_b03544c143ed.slice/crio-55a3f14d26b548aef5c47b45544060a1639a8ba6adabd2d1732734e1df3eeecd WatchSource:0}: Error finding container 55a3f14d26b548aef5c47b45544060a1639a8ba6adabd2d1732734e1df3eeecd: Status 404 returned error can't find the container with id 55a3f14d26b548aef5c47b45544060a1639a8ba6adabd2d1732734e1df3eeecd Nov 03 21:06:05.821052 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:05.821032 5857 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 03 21:06:06.099717 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:06.099626 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-ksdrs/dw-deployment-zlbk8-7444dc4546-sxwf8" event={"ID":"2787ca9a-53da-4b0f-8128-b03544c143ed","Type":"ContainerStarted","Data":"55a3f14d26b548aef5c47b45544060a1639a8ba6adabd2d1732734e1df3eeecd"} Nov 03 21:06:07.106223 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:07.106134 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-ksdrs/dw-deployment-zlbk8-7444dc4546-sxwf8" event={"ID":"2787ca9a-53da-4b0f-8128-b03544c143ed","Type":"ContainerStarted","Data":"1c9299e917bb925d1833b90ec670b3f15ce54bd9dde420439a44dd07f7bda7b5"} Nov 03 21:06:07.223329 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:07.223269 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-ksdrs/dw-deployment-zlbk8-7444dc4546-sxwf8" podStartSLOduration=2.308910955 podStartE2EDuration="3.22325342s" totalImagesPullingTime="914.342465ms" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 21:06:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:06:07.221724021 +0000 UTC m=+3876.788614168" watchObservedRunningTime="2026-11-03 21:06:07.22325342 +0000 UTC m=+3876.790143568" Nov 03 21:06:07.371478 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:07.371397 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:06:10.372723 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:10.372642 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:06:13.371244 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:13.371214 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:06:16.469105 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:16.469072 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:06:19.469598 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:19.469544 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:06:19.500789 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:06:19.500754 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:06:22.471946 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:22.471915 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:06:25.468972 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:25.468911 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:06:28.440290 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:28.440258 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:06:31.468973 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:31.468944 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:06:34.233638 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:34.233601 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-pfdkm/dw-deployment-26797-645cc7f6b7-5xlhn" Nov 03 21:06:34.240322 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:34.240290 5857 generic.go:356] "Generic (PLEG): container finished" podID="2c26eaaf-33ee-44af-996e-fab02f2bcb29" containerID="22554b871a5619323ca417e3f7a8512feec3510301c48a9e53baec206ef0b18a" exitCode=137 Nov 03 21:06:34.240451 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:34.240332 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-pfdkm/dw-deployment-26797-645cc7f6b7-5xlhn" Nov 03 21:06:34.240451 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:34.240370 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-pfdkm/dw-deployment-26797-645cc7f6b7-5xlhn" event={"ID":"2c26eaaf-33ee-44af-996e-fab02f2bcb29","Type":"ContainerDied","Data":"22554b871a5619323ca417e3f7a8512feec3510301c48a9e53baec206ef0b18a"} Nov 03 21:06:34.240451 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:34.240430 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-pfdkm/dw-deployment-26797-645cc7f6b7-5xlhn" event={"ID":"2c26eaaf-33ee-44af-996e-fab02f2bcb29","Type":"ContainerDied","Data":"f33c7e2c5856bb53dcc4cd6631db10e67262d9be26963cad22993a6daa12a225"} Nov 03 21:06:34.240552 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:34.240452 5857 scope.go:122] "RemoveContainer" containerID="22554b871a5619323ca417e3f7a8512feec3510301c48a9e53baec206ef0b18a" Nov 03 21:06:34.261477 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:34.261461 5857 scope.go:122] "RemoveContainer" containerID="22554b871a5619323ca417e3f7a8512feec3510301c48a9e53baec206ef0b18a" Nov 03 21:06:34.261809 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:06:34.261779 5857 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22554b871a5619323ca417e3f7a8512feec3510301c48a9e53baec206ef0b18a\": container with ID starting with 22554b871a5619323ca417e3f7a8512feec3510301c48a9e53baec206ef0b18a not found: ID does not exist" containerID="22554b871a5619323ca417e3f7a8512feec3510301c48a9e53baec206ef0b18a" Nov 03 21:06:34.261910 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:34.261815 5857 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22554b871a5619323ca417e3f7a8512feec3510301c48a9e53baec206ef0b18a"} err="failed to get container status \"22554b871a5619323ca417e3f7a8512feec3510301c48a9e53baec206ef0b18a\": rpc error: code = NotFound desc = could not find container \"22554b871a5619323ca417e3f7a8512feec3510301c48a9e53baec206ef0b18a\": container with ID starting with 22554b871a5619323ca417e3f7a8512feec3510301c48a9e53baec206ef0b18a not found: ID does not exist" Nov 03 21:06:34.347738 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:34.347643 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2c26eaaf-33ee-44af-996e-fab02f2bcb29-kube-api-access-lbtgr\" (UniqueName: \"kubernetes.io/projected/2c26eaaf-33ee-44af-996e-fab02f2bcb29-kube-api-access-lbtgr\") pod \"2c26eaaf-33ee-44af-996e-fab02f2bcb29\" (UID: \"2c26eaaf-33ee-44af-996e-fab02f2bcb29\") " Nov 03 21:06:34.347910 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:34.347769 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2c26eaaf-33ee-44af-996e-fab02f2bcb29-notebook-config\" (UniqueName: \"kubernetes.io/configmap/2c26eaaf-33ee-44af-996e-fab02f2bcb29-notebook-config\") pod \"2c26eaaf-33ee-44af-996e-fab02f2bcb29\" (UID: \"2c26eaaf-33ee-44af-996e-fab02f2bcb29\") " Nov 03 21:06:34.347910 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:34.347799 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/nfs/2c26eaaf-33ee-44af-996e-fab02f2bcb29-pvc-cdf8e142-4925-4f5c-8a19-0e20e3e4c1ab\" (UniqueName: \"kubernetes.io/nfs/2c26eaaf-33ee-44af-996e-fab02f2bcb29-pvc-cdf8e142-4925-4f5c-8a19-0e20e3e4c1ab\") pod \"2c26eaaf-33ee-44af-996e-fab02f2bcb29\" (UID: \"2c26eaaf-33ee-44af-996e-fab02f2bcb29\") " Nov 03 21:06:34.348128 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:34.348106 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c26eaaf-33ee-44af-996e-fab02f2bcb29-notebook-config" pod "2c26eaaf-33ee-44af-996e-fab02f2bcb29" (UID: "2c26eaaf-33ee-44af-996e-fab02f2bcb29"). InnerVolumeSpecName "notebook-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 21:06:34.350181 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:34.350149 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c26eaaf-33ee-44af-996e-fab02f2bcb29-kube-api-access-lbtgr" pod "2c26eaaf-33ee-44af-996e-fab02f2bcb29" (UID: "2c26eaaf-33ee-44af-996e-fab02f2bcb29"). InnerVolumeSpecName "kube-api-access-lbtgr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 21:06:34.366780 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:34.366752 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/nfs/2c26eaaf-33ee-44af-996e-fab02f2bcb29-pvc-cdf8e142-4925-4f5c-8a19-0e20e3e4c1ab" pod "2c26eaaf-33ee-44af-996e-fab02f2bcb29" (UID: "2c26eaaf-33ee-44af-996e-fab02f2bcb29"). InnerVolumeSpecName "pvc-cdf8e142-4925-4f5c-8a19-0e20e3e4c1ab". PluginName "kubernetes.io/nfs", VolumeGIDValue "" Nov 03 21:06:34.449055 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:34.449015 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbtgr\" (UniqueName: \"kubernetes.io/projected/2c26eaaf-33ee-44af-996e-fab02f2bcb29-kube-api-access-lbtgr\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 21:06:34.449055 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:34.449046 5857 reconciler_common.go:299] "Volume detached for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/2c26eaaf-33ee-44af-996e-fab02f2bcb29-notebook-config\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 21:06:34.449055 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:34.449057 5857 reconciler_common.go:299] "Volume detached for volume \"pvc-cdf8e142-4925-4f5c-8a19-0e20e3e4c1ab\" (UniqueName: \"kubernetes.io/nfs/2c26eaaf-33ee-44af-996e-fab02f2bcb29-pvc-cdf8e142-4925-4f5c-8a19-0e20e3e4c1ab\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 21:06:34.516805 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:34.516774 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:06:34.663468 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:34.663382 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-pfdkm/dw-deployment-26797-645cc7f6b7-5xlhn"] Nov 03 21:06:34.665900 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:34.665879 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-pfdkm/dw-deployment-26797-645cc7f6b7-5xlhn"] Nov 03 21:06:36.576407 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:36.576370 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2c26eaaf-33ee-44af-996e-fab02f2bcb29" path="/var/lib/kubelet/pods/2c26eaaf-33ee-44af-996e-fab02f2bcb29/volumes" Nov 03 21:06:37.470274 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:37.470237 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:06:40.470365 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:40.470325 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:06:43.518368 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:43.518336 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:06:46.519237 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:46.519201 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:06:49.498910 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:06:49.498870 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:06:49.516429 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:49.516407 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:06:52.518319 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:52.518288 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:06:55.518543 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:55.518485 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:06:58.524126 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:06:58.524096 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:07:01.533379 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:07:01.533345 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:07:04.456203 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:07:04.456171 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:07:07.520241 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:07:07.520205 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:07:10.516685 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:07:10.516659 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:07:13.519926 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:07:13.519895 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:07:16.469589 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:07:16.469540 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:07:19.472497 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:07:19.472437 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:07:19.499121 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:07:19.499079 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:07:22.469375 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:07:22.469344 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:07:25.519609 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:07:25.519581 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:07:28.519314 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:07:28.519283 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:07:31.517442 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:07:31.517408 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:07:34.519843 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:07:34.519806 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:07:37.521028 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:07:37.520981 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:07:40.504269 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:07:40.504233 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:07:43.544101 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:07:43.544062 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:07:46.516454 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:07:46.516420 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:07:49.499053 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:07:49.499010 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:07:49.533201 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:07:49.533169 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:07:52.530893 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:07:52.530853 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:07:55.518014 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:07:55.517969 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:07:58.521116 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:07:58.521082 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:08:01.516654 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:08:01.516619 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:08:04.519914 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:08:04.519873 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:08:07.518784 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:08:07.518748 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:08:10.519082 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:08:10.519046 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:08:13.518612 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:08:13.518579 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:08:16.442636 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:08:16.442596 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:08:19.498542 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:08:19.498502 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:08:19.519437 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:08:19.519403 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:08:22.515812 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:08:22.515787 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:08:25.519976 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:08:25.519947 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:08:28.519006 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:08:28.518980 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:08:31.526680 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:08:31.526642 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:08:34.517440 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:08:34.517381 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:08:37.517926 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:08:37.517889 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:08:40.519362 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:08:40.519327 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:08:43.519056 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:08:43.519024 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:08:46.517785 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:08:46.517755 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:08:49.500615 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:08:49.500579 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:08:49.517750 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:08:49.517728 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:08:52.442734 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:08:52.442704 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:08:55.534167 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:08:55.534134 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:08:58.517397 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:08:58.517366 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:09:01.542068 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:09:01.542035 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:09:04.519580 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:09:04.519527 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:09:07.520310 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:09:07.520281 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:09:10.520079 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:09:10.520050 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:09:13.518299 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:09:13.518269 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:09:16.520188 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:09:16.520161 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:09:19.499991 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:09:19.499950 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:09:19.525351 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:09:19.525325 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:09:22.521168 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:09:22.521132 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:09:25.518326 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:09:25.518276 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:09:28.495167 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:09:28.495137 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:09:31.525290 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:09:31.525250 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:09:34.518229 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:09:34.518192 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:09:37.520324 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:09:37.520286 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:09:40.519759 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:09:40.519698 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:09:43.520466 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:09:43.520379 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:09:46.517358 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:09:46.517325 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:09:49.499498 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:09:49.499465 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:09:49.517958 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:09:49.517928 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:09:52.518704 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:09:52.518670 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:09:55.373375 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:09:55.373348 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:09:58.373111 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:09:58.373075 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:10:01.469752 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:10:01.469723 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:10:04.442346 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:10:04.442314 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:10:07.472139 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:10:07.472108 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:10:10.470979 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:10:10.470948 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:10:13.469666 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:10:13.469633 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:10:16.469485 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:10:16.469453 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:10:19.473511 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:10:19.473476 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:10:19.500036 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:10:19.500002 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:10:22.470636 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:10:22.470598 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:10:25.517777 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:10:25.517741 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:10:28.519270 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:10:28.519236 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:10:31.520390 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:10:31.520362 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:10:34.495634 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:10:34.495578 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:10:37.518524 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:10:37.518490 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:10:40.471266 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:10:40.471233 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:10:43.517583 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:10:43.517542 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:10:46.517850 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:10:46.517818 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:10:49.471133 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:10:49.471102 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:10:49.501046 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:10:49.501005 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:10:52.469734 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:10:52.469706 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:10:55.520968 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:10:55.520938 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:10:58.521993 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:10:58.521964 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:11:01.518123 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:11:01.518095 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:11:04.520673 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:11:04.520637 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:11:07.519099 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:11:07.519068 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:11:10.520196 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:11:10.520169 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:11:13.506816 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:11:13.506783 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:11:16.517151 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:11:16.517117 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:11:19.500399 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:11:19.500365 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:11:19.520138 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:11:19.520109 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:11:22.519719 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:11:22.519657 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:11:25.517820 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:11:25.517796 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:11:28.523067 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:11:28.523034 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:11:31.521745 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:11:31.521719 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:11:34.517733 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:11:34.517702 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:11:37.519684 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:11:37.519655 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:11:40.520938 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:11:40.520910 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:11:43.527745 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:11:43.527714 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:11:46.519560 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:11:46.519529 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:11:49.499740 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:11:49.499702 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:11:49.520237 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:11:49.520212 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:11:52.519882 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:11:52.519854 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:11:55.517801 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:11:55.517771 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:11:58.519736 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:11:58.519700 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:12:01.572579 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:12:01.572531 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:12:04.519937 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:12:04.519904 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:12:07.520287 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:12:07.520238 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:12:10.518112 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:12:10.518084 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:12:13.525343 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:12:13.525298 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:12:16.520945 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:12:16.520911 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:12:19.501675 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:12:19.501636 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:12:19.520197 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:12:19.520171 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:12:22.518894 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:12:22.518861 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:12:25.518754 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:12:25.518719 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:12:28.520713 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:12:28.520677 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:12:31.548857 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:12:31.548789 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:12:34.518858 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:12:34.518829 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:12:37.517848 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:12:37.517815 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:12:40.520944 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:12:40.520902 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:12:43.518403 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:12:43.518366 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:12:46.517421 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:12:46.517323 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:12:49.500269 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:12:49.500223 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:12:49.519214 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:12:49.519188 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:12:52.530933 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:12:52.530906 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:12:55.505577 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:12:55.505520 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:12:58.519777 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:12:58.519733 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:13:01.519939 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:13:01.519895 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:13:04.518371 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:13:04.518320 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:13:07.519861 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:13:07.519821 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:13:10.522833 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:13:10.522805 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:13:13.521709 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:13:13.521683 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:13:16.520290 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:13:16.520254 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:13:19.499541 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:13:19.499501 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:13:19.520267 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:13:19.520199 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:13:22.520218 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:13:22.520190 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:13:25.505205 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:13:25.505173 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:13:28.520555 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:13:28.520524 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:13:31.520027 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:13:31.519998 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:13:34.520298 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:13:34.520269 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:13:37.518819 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:13:37.518787 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:13:40.519875 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:13:40.519847 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:13:43.518732 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:13:43.518701 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:13:46.518269 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:13:46.518234 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:13:49.501121 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:13:49.501088 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:13:49.590056 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:13:49.590030 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:13:52.520524 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:13:52.520498 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:13:55.490215 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:13:55.490180 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:13:58.519816 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:13:58.519787 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:14:01.521270 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:14:01.521241 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:14:04.524181 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:14:04.524153 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:14:07.519802 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:14:07.519769 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:14:10.520544 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:14:10.520514 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:14:13.520416 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:14:13.520347 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:14:16.519645 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:14:16.519614 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:14:19.500978 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:14:19.500941 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:14:19.520190 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:14:19.520165 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:14:22.520336 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:14:22.520311 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:14:25.490868 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:14:25.490833 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:14:28.578196 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:14:28.578131 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:14:31.519458 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:14:31.519388 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:14:34.520096 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:14:34.520070 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:14:37.522073 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:14:37.522041 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:14:40.521592 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:14:40.521545 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:14:43.519842 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:14:43.519811 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:14:46.518068 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:14:46.518040 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:14:49.501439 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:14:49.501393 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:14:49.519435 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:14:49.519411 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:14:52.521543 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:14:52.521513 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:14:55.521835 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:14:55.521801 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:14:58.520311 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:14:58.520274 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:15:01.520396 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:01.520360 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:15:04.519887 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:04.519827 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:15:05.773448 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:05.773398 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-ksdrs/dw-deployment-zlbk8-7444dc4546-sxwf8"] Nov 03 21:15:05.773995 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:05.773667 5857 kuberuntime_container.go:898] "Killing container with a grace period" pod="test-ns-ksdrs/dw-deployment-zlbk8-7444dc4546-sxwf8" podUID="2787ca9a-53da-4b0f-8128-b03544c143ed" containerName="notebook" containerID="cri-o://1c9299e917bb925d1833b90ec670b3f15ce54bd9dde420439a44dd07f7bda7b5" gracePeriod=30 Nov 03 21:15:05.907751 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:05.907723 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ksdrs_dw-deployment-zlbk8-7444dc4546-sxwf8_2787ca9a-53da-4b0f-8128-b03544c143ed/notebook/0.log" Nov 03 21:15:06.799315 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:06.799277 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-vh5g7/dw-deployment-82mr4-66bb5dd896-xcwrv"] Nov 03 21:15:06.799745 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:06.799689 5857 cpu_manager.go:414] "containerMap: removing container" podUID="2c26eaaf-33ee-44af-996e-fab02f2bcb29" containerName="notebook" Nov 03 21:15:06.799745 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:06.799702 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2c26eaaf-33ee-44af-996e-fab02f2bcb29" containerName="notebook" Nov 03 21:15:06.799817 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:06.799762 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="2c26eaaf-33ee-44af-996e-fab02f2bcb29" containerName="notebook" Nov 03 21:15:06.802725 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:06.802707 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-vh5g7/dw-deployment-82mr4-66bb5dd896-xcwrv" Nov 03 21:15:06.855130 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:06.855095 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-vh5g7\"/\"kube-root-ca.crt\"" Nov 03 21:15:06.855130 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:06.855100 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-vh5g7\"/\"openshift-service-ca.crt\"" Nov 03 21:15:06.904697 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:06.904664 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-vh5g7\"/\"default-dockercfg-98b5g\"" Nov 03 21:15:06.954327 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:06.954290 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-vh5g7\"/\"config-ltdn8\"" Nov 03 21:15:06.955864 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:06.955844 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-vh5g7/dw-deployment-82mr4-66bb5dd896-xcwrv"] Nov 03 21:15:07.061489 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:07.061400 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-d8676abb-69d3-4baa-bb0b-bfcc4cc4f5cc\" (UniqueName: \"kubernetes.io/nfs/c2978f33-33da-4b73-a4dc-1d440f3b4ba7-pvc-d8676abb-69d3-4baa-bb0b-bfcc4cc4f5cc\") pod \"dw-deployment-82mr4-66bb5dd896-xcwrv\" (UID: \"c2978f33-33da-4b73-a4dc-1d440f3b4ba7\") " pod="test-ns-vh5g7/dw-deployment-82mr4-66bb5dd896-xcwrv" Nov 03 21:15:07.061489 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:07.061479 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/c2978f33-33da-4b73-a4dc-1d440f3b4ba7-notebook-config\") pod \"dw-deployment-82mr4-66bb5dd896-xcwrv\" (UID: \"c2978f33-33da-4b73-a4dc-1d440f3b4ba7\") " pod="test-ns-vh5g7/dw-deployment-82mr4-66bb5dd896-xcwrv" Nov 03 21:15:07.061717 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:07.061504 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qzc7\" (UniqueName: \"kubernetes.io/projected/c2978f33-33da-4b73-a4dc-1d440f3b4ba7-kube-api-access-6qzc7\") pod \"dw-deployment-82mr4-66bb5dd896-xcwrv\" (UID: \"c2978f33-33da-4b73-a4dc-1d440f3b4ba7\") " pod="test-ns-vh5g7/dw-deployment-82mr4-66bb5dd896-xcwrv" Nov 03 21:15:07.162869 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:07.162831 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-d8676abb-69d3-4baa-bb0b-bfcc4cc4f5cc\" (UniqueName: \"kubernetes.io/nfs/c2978f33-33da-4b73-a4dc-1d440f3b4ba7-pvc-d8676abb-69d3-4baa-bb0b-bfcc4cc4f5cc\") pod \"dw-deployment-82mr4-66bb5dd896-xcwrv\" (UID: \"c2978f33-33da-4b73-a4dc-1d440f3b4ba7\") " pod="test-ns-vh5g7/dw-deployment-82mr4-66bb5dd896-xcwrv" Nov 03 21:15:07.163075 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:07.162920 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/c2978f33-33da-4b73-a4dc-1d440f3b4ba7-notebook-config\") pod \"dw-deployment-82mr4-66bb5dd896-xcwrv\" (UID: \"c2978f33-33da-4b73-a4dc-1d440f3b4ba7\") " pod="test-ns-vh5g7/dw-deployment-82mr4-66bb5dd896-xcwrv" Nov 03 21:15:07.163075 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:07.162949 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qzc7\" (UniqueName: \"kubernetes.io/projected/c2978f33-33da-4b73-a4dc-1d440f3b4ba7-kube-api-access-6qzc7\") pod \"dw-deployment-82mr4-66bb5dd896-xcwrv\" (UID: \"c2978f33-33da-4b73-a4dc-1d440f3b4ba7\") " pod="test-ns-vh5g7/dw-deployment-82mr4-66bb5dd896-xcwrv" Nov 03 21:15:07.163779 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:07.163759 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/c2978f33-33da-4b73-a4dc-1d440f3b4ba7-notebook-config\") pod \"dw-deployment-82mr4-66bb5dd896-xcwrv\" (UID: \"c2978f33-33da-4b73-a4dc-1d440f3b4ba7\") " pod="test-ns-vh5g7/dw-deployment-82mr4-66bb5dd896-xcwrv" Nov 03 21:15:07.193715 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:07.193687 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-d8676abb-69d3-4baa-bb0b-bfcc4cc4f5cc\" (UniqueName: \"kubernetes.io/nfs/c2978f33-33da-4b73-a4dc-1d440f3b4ba7-pvc-d8676abb-69d3-4baa-bb0b-bfcc4cc4f5cc\") pod \"dw-deployment-82mr4-66bb5dd896-xcwrv\" (UID: \"c2978f33-33da-4b73-a4dc-1d440f3b4ba7\") " pod="test-ns-vh5g7/dw-deployment-82mr4-66bb5dd896-xcwrv" Nov 03 21:15:07.224092 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:07.224058 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qzc7\" (UniqueName: \"kubernetes.io/projected/c2978f33-33da-4b73-a4dc-1d440f3b4ba7-kube-api-access-6qzc7\") pod \"dw-deployment-82mr4-66bb5dd896-xcwrv\" (UID: \"c2978f33-33da-4b73-a4dc-1d440f3b4ba7\") " pod="test-ns-vh5g7/dw-deployment-82mr4-66bb5dd896-xcwrv" Nov 03 21:15:07.416010 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:07.415916 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-vh5g7/dw-deployment-82mr4-66bb5dd896-xcwrv" Nov 03 21:15:07.792376 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:07.792334 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-vh5g7/dw-deployment-82mr4-66bb5dd896-xcwrv"] Nov 03 21:15:07.827827 ip-10-0-140-181 kubenswrapper[5857]: W1103 21:15:07.827797 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2978f33_33da_4b73_a4dc_1d440f3b4ba7.slice/crio-a8af35199820fb4fa9e2f06aa6b72e86d248d046601f3f3d557c145a93d8fc4f WatchSource:0}: Error finding container a8af35199820fb4fa9e2f06aa6b72e86d248d046601f3f3d557c145a93d8fc4f: Status 404 returned error can't find the container with id a8af35199820fb4fa9e2f06aa6b72e86d248d046601f3f3d557c145a93d8fc4f Nov 03 21:15:07.829511 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:07.829490 5857 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 03 21:15:08.578866 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:08.578832 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-vh5g7/dw-deployment-82mr4-66bb5dd896-xcwrv" event={"ID":"c2978f33-33da-4b73-a4dc-1d440f3b4ba7","Type":"ContainerStarted","Data":"a8af35199820fb4fa9e2f06aa6b72e86d248d046601f3f3d557c145a93d8fc4f"} Nov 03 21:15:09.585537 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:09.585495 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-vh5g7/dw-deployment-82mr4-66bb5dd896-xcwrv" event={"ID":"c2978f33-33da-4b73-a4dc-1d440f3b4ba7","Type":"ContainerStarted","Data":"d853428de3aa08663fa722edaa5039ae81d9dec6a538333e223310f83ffd187a"} Nov 03 21:15:09.703188 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:09.703122 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-vh5g7/dw-deployment-82mr4-66bb5dd896-xcwrv" podStartSLOduration=2.4281460089999998 podStartE2EDuration="3.703102585s" totalImagesPullingTime="1.274956576s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 21:15:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:15:09.702336757 +0000 UTC m=+4419.269226919" watchObservedRunningTime="2026-11-03 21:15:09.703102585 +0000 UTC m=+4419.269992736" Nov 03 21:15:12.360020 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:12.359993 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:15:15.359181 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:15.359151 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:15:18.387046 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:18.387014 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:15:19.498526 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:15:19.498491 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:15:21.387969 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:21.387934 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:15:24.390533 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:24.390500 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:15:27.388939 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:27.388908 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:15:30.361104 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:30.361070 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:15:33.388159 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:33.388125 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:15:35.951488 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:35.951463 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-ksdrs/dw-deployment-zlbk8-7444dc4546-sxwf8" Nov 03 21:15:36.022218 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:36.022183 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2787ca9a-53da-4b0f-8128-b03544c143ed-notebook-config\" (UniqueName: \"kubernetes.io/configmap/2787ca9a-53da-4b0f-8128-b03544c143ed-notebook-config\") pod \"2787ca9a-53da-4b0f-8128-b03544c143ed\" (UID: \"2787ca9a-53da-4b0f-8128-b03544c143ed\") " Nov 03 21:15:36.022398 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:36.022286 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2787ca9a-53da-4b0f-8128-b03544c143ed-kube-api-access-r24rt\" (UniqueName: \"kubernetes.io/projected/2787ca9a-53da-4b0f-8128-b03544c143ed-kube-api-access-r24rt\") pod \"2787ca9a-53da-4b0f-8128-b03544c143ed\" (UID: \"2787ca9a-53da-4b0f-8128-b03544c143ed\") " Nov 03 21:15:36.022398 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:36.022313 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/nfs/2787ca9a-53da-4b0f-8128-b03544c143ed-pvc-74a8e5be-aa6c-41ea-85c4-0fd83bf60a55\" (UniqueName: \"kubernetes.io/nfs/2787ca9a-53da-4b0f-8128-b03544c143ed-pvc-74a8e5be-aa6c-41ea-85c4-0fd83bf60a55\") pod \"2787ca9a-53da-4b0f-8128-b03544c143ed\" (UID: \"2787ca9a-53da-4b0f-8128-b03544c143ed\") " Nov 03 21:15:36.022673 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:36.022645 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2787ca9a-53da-4b0f-8128-b03544c143ed-notebook-config" pod "2787ca9a-53da-4b0f-8128-b03544c143ed" (UID: "2787ca9a-53da-4b0f-8128-b03544c143ed"). InnerVolumeSpecName "notebook-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 21:15:36.024733 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:36.024706 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2787ca9a-53da-4b0f-8128-b03544c143ed-kube-api-access-r24rt" pod "2787ca9a-53da-4b0f-8128-b03544c143ed" (UID: "2787ca9a-53da-4b0f-8128-b03544c143ed"). InnerVolumeSpecName "kube-api-access-r24rt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 21:15:36.044783 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:36.044752 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/nfs/2787ca9a-53da-4b0f-8128-b03544c143ed-pvc-74a8e5be-aa6c-41ea-85c4-0fd83bf60a55" pod "2787ca9a-53da-4b0f-8128-b03544c143ed" (UID: "2787ca9a-53da-4b0f-8128-b03544c143ed"). InnerVolumeSpecName "pvc-74a8e5be-aa6c-41ea-85c4-0fd83bf60a55". PluginName "kubernetes.io/nfs", VolumeGIDValue "" Nov 03 21:15:36.123326 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:36.123292 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r24rt\" (UniqueName: \"kubernetes.io/projected/2787ca9a-53da-4b0f-8128-b03544c143ed-kube-api-access-r24rt\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 21:15:36.123326 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:36.123321 5857 reconciler_common.go:299] "Volume detached for volume \"pvc-74a8e5be-aa6c-41ea-85c4-0fd83bf60a55\" (UniqueName: \"kubernetes.io/nfs/2787ca9a-53da-4b0f-8128-b03544c143ed-pvc-74a8e5be-aa6c-41ea-85c4-0fd83bf60a55\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 21:15:36.123326 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:36.123333 5857 reconciler_common.go:299] "Volume detached for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/2787ca9a-53da-4b0f-8128-b03544c143ed-notebook-config\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 21:15:36.386992 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:36.386872 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:15:36.718438 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:36.718399 5857 generic.go:356] "Generic (PLEG): container finished" podID="2787ca9a-53da-4b0f-8128-b03544c143ed" containerID="1c9299e917bb925d1833b90ec670b3f15ce54bd9dde420439a44dd07f7bda7b5" exitCode=137 Nov 03 21:15:36.718654 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:36.718447 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-ksdrs/dw-deployment-zlbk8-7444dc4546-sxwf8" Nov 03 21:15:36.718654 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:36.718449 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-ksdrs/dw-deployment-zlbk8-7444dc4546-sxwf8" event={"ID":"2787ca9a-53da-4b0f-8128-b03544c143ed","Type":"ContainerDied","Data":"1c9299e917bb925d1833b90ec670b3f15ce54bd9dde420439a44dd07f7bda7b5"} Nov 03 21:15:36.718654 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:36.718598 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-ksdrs/dw-deployment-zlbk8-7444dc4546-sxwf8" event={"ID":"2787ca9a-53da-4b0f-8128-b03544c143ed","Type":"ContainerDied","Data":"55a3f14d26b548aef5c47b45544060a1639a8ba6adabd2d1732734e1df3eeecd"} Nov 03 21:15:36.718654 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:36.718628 5857 scope.go:122] "RemoveContainer" containerID="1c9299e917bb925d1833b90ec670b3f15ce54bd9dde420439a44dd07f7bda7b5" Nov 03 21:15:36.738658 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:36.738636 5857 scope.go:122] "RemoveContainer" containerID="1c9299e917bb925d1833b90ec670b3f15ce54bd9dde420439a44dd07f7bda7b5" Nov 03 21:15:36.738975 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:15:36.738955 5857 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c9299e917bb925d1833b90ec670b3f15ce54bd9dde420439a44dd07f7bda7b5\": container with ID starting with 1c9299e917bb925d1833b90ec670b3f15ce54bd9dde420439a44dd07f7bda7b5 not found: ID does not exist" containerID="1c9299e917bb925d1833b90ec670b3f15ce54bd9dde420439a44dd07f7bda7b5" Nov 03 21:15:36.739030 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:36.738995 5857 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c9299e917bb925d1833b90ec670b3f15ce54bd9dde420439a44dd07f7bda7b5"} err="failed to get container status \"1c9299e917bb925d1833b90ec670b3f15ce54bd9dde420439a44dd07f7bda7b5\": rpc error: code = NotFound desc = could not find container \"1c9299e917bb925d1833b90ec670b3f15ce54bd9dde420439a44dd07f7bda7b5\": container with ID starting with 1c9299e917bb925d1833b90ec670b3f15ce54bd9dde420439a44dd07f7bda7b5 not found: ID does not exist" Nov 03 21:15:36.882786 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:36.882746 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-ksdrs/dw-deployment-zlbk8-7444dc4546-sxwf8"] Nov 03 21:15:36.932131 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:36.932091 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-ksdrs/dw-deployment-zlbk8-7444dc4546-sxwf8"] Nov 03 21:15:38.572713 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:38.572676 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2787ca9a-53da-4b0f-8128-b03544c143ed" path="/var/lib/kubelet/pods/2787ca9a-53da-4b0f-8128-b03544c143ed/volumes" Nov 03 21:15:39.389373 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:39.389338 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:15:42.387151 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:42.387123 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:15:45.387716 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:45.387670 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:15:48.387881 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:48.387847 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:15:49.498359 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:15:49.498324 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:15:51.387384 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:51.387354 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:15:54.388222 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:54.388194 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:15:57.387781 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:15:57.387750 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:16:00.388217 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:16:00.388171 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:16:03.387448 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:16:03.387416 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:16:06.360170 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:16:06.360126 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:16:09.387628 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:16:09.387597 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:16:12.387771 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:16:12.387724 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:16:15.386411 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:16:15.386379 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:16:18.387502 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:16:18.387469 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:16:19.498749 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:16:19.498701 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:16:21.390487 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:16:21.390457 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:16:24.388989 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:16:24.388961 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:16:27.385995 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:16:27.385965 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:16:30.389171 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:16:30.389131 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:16:33.387216 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:16:33.387185 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:16:36.388329 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:16:36.388299 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:16:39.387661 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:16:39.387581 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:16:42.359272 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:16:42.359239 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:16:45.388301 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:16:45.388272 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:16:48.386539 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:16:48.386511 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:16:49.499356 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:16:49.499316 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:16:51.388941 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:16:51.388904 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:16:54.387649 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:16:54.387615 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:16:57.388866 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:16:57.388831 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:17:00.389143 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:17:00.389110 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:17:03.373799 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:17:03.373772 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:17:06.388112 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:17:06.388072 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:17:09.387515 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:17:09.387482 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:17:12.390952 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:17:12.390919 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:17:15.387531 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:17:15.387497 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:17:18.372061 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:17:18.372025 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:17:19.498640 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:17:19.498593 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:17:21.388988 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:17:21.388953 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:17:24.388154 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:17:24.388122 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:17:27.388066 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:17:27.388036 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:17:30.388134 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:17:30.388095 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:17:33.388480 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:17:33.388450 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:17:36.388676 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:17:36.388646 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:17:39.373096 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:17:39.373061 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:17:42.388098 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:17:42.388061 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:17:45.386296 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:17:45.386257 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:17:48.387804 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:17:48.387771 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:17:49.499184 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:17:49.499147 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:17:51.388641 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:17:51.388611 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:17:54.402188 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:17:54.402158 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:17:57.414211 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:17:57.414180 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:18:00.387068 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:18:00.387032 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:18:03.387907 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:18:03.387874 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:18:06.388433 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:18:06.388395 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:18:09.389177 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:18:09.389100 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:18:12.388109 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:18:12.388080 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:18:15.360488 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:18:15.360454 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:18:18.388275 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:18:18.388248 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:18:19.498485 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:18:19.498445 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:18:21.386774 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:18:21.386743 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:18:24.388879 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:18:24.388848 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:18:27.388132 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:18:27.388096 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:18:30.388363 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:18:30.388327 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:18:33.387811 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:18:33.387774 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:18:36.388653 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:18:36.388617 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:18:39.395581 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:18:39.395538 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:18:42.387464 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:18:42.387434 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:18:45.386321 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:18:45.386293 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:18:48.387632 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:18:48.387599 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:18:49.499238 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:18:49.499197 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:18:51.388524 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:18:51.388494 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:18:54.358715 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:18:54.358688 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:18:57.359693 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:18:57.359662 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:19:00.388582 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:19:00.388536 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:19:03.388319 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:19:03.388282 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:19:06.389332 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:19:06.389304 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:19:09.387687 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:19:09.387650 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:19:12.373317 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:19:12.373290 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:19:15.388019 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:19:15.387924 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:19:18.388535 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:19:18.388498 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:19:19.499850 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:19:19.499812 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:19:21.387022 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:19:21.386989 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:19:24.386790 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:19:24.386751 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:19:27.388202 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:19:27.388171 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:19:30.439299 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:19:30.439261 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:19:33.386667 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:19:33.386637 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:19:36.387956 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:19:36.387928 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:19:39.387605 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:19:39.387510 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:19:42.372760 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:19:42.372724 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:19:45.388775 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:19:45.388742 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:19:48.388046 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:19:48.388014 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:19:49.499477 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:19:49.499441 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:19:51.389206 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:19:51.389165 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:19:54.388236 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:19:54.388205 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:19:57.386702 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:19:57.386669 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:20:00.388930 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:20:00.388900 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:20:03.388307 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:20:03.388272 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:20:06.388080 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:20:06.388047 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:20:09.388877 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:20:09.388841 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:20:12.359555 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:20:12.359524 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:20:15.386758 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:20:15.386722 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:20:18.394301 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:20:18.394272 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:20:19.499359 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:20:19.499325 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:20:21.388167 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:20:21.388131 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:20:24.388104 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:20:24.388070 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:20:27.388400 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:20:27.388373 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:20:30.388069 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:20:30.388034 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:20:33.386273 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:20:33.386240 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:20:36.404633 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:20:36.404606 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:20:39.388312 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:20:39.388278 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:20:42.360428 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:20:42.360399 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:20:45.388439 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:20:45.388400 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:20:48.388874 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:20:48.388833 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:20:49.499597 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:20:49.499544 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:20:51.388341 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:20:51.388311 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:20:54.395646 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:20:54.395616 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:20:57.391655 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:20:57.391627 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:21:00.388415 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:21:00.388301 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:21:03.386451 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:21:03.386421 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:21:06.388326 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:21:06.388300 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:21:09.388466 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:21:09.388384 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:21:12.388155 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:21:12.388128 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:21:15.389288 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:21:15.389255 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:21:18.388005 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:21:18.387975 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:21:19.498086 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:21:19.498051 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:21:21.388933 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:21:21.388902 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:21:24.387311 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:21:24.387269 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:21:27.387945 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:21:27.387911 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:21:30.388855 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:21:30.388821 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:21:33.386612 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:21:33.386556 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:21:36.395237 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:21:36.395207 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:21:39.388270 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:21:39.388237 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:21:42.387797 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:21:42.387766 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:21:45.387526 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:21:45.387493 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:21:48.388896 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:21:48.388858 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:21:49.501978 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:21:49.501937 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:21:51.388555 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:21:51.388523 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:21:54.387603 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:21:54.387549 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:21:57.388433 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:21:57.388403 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:22:00.389243 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:22:00.389208 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:22:03.386349 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:22:03.386318 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:22:06.388070 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:22:06.388035 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:22:09.388451 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:22:09.388406 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:22:12.389291 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:22:12.389259 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:22:15.388617 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:22:15.388588 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:22:18.387244 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:22:18.387209 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:22:19.500020 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:22:19.499982 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:22:21.389210 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:22:21.389174 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:22:24.388953 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:22:24.388924 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:22:27.389394 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:22:27.389367 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:22:30.390395 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:22:30.390364 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:22:33.388015 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:22:33.387983 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:22:36.388966 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:22:36.388933 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:22:39.388176 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:22:39.388096 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:22:42.388199 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:22:42.388166 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:22:45.388452 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:22:45.388422 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:22:48.388156 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:22:48.388118 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:22:49.500409 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:22:49.500366 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:22:51.390775 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:22:51.390745 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:22:54.386514 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:22:54.386484 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:22:57.388225 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:22:57.388196 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:23:00.388190 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:23:00.388156 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:23:03.386894 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:23:03.386864 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:23:06.388436 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:23:06.388403 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:23:09.388476 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:23:09.388438 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:23:12.389222 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:23:12.389185 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:23:15.388209 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:23:15.388175 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:23:18.388325 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:23:18.388296 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:23:19.500820 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:23:19.500780 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:23:21.388473 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:23:21.388437 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:23:24.386844 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:23:24.386809 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:23:27.399198 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:23:27.399167 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:23:30.386702 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:23:30.386663 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:23:33.373325 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:23:33.373279 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:23:36.387985 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:23:36.387956 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:23:39.389114 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:23:39.389081 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:23:42.388293 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:23:42.388259 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:23:45.388134 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:23:45.388099 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:23:48.388378 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:23:48.388347 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:23:49.501203 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:23:49.499173 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:23:51.387867 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:23:51.387824 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:23:54.387305 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:23:54.387269 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:23:57.389051 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:23:57.389016 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:24:00.388235 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:00.388204 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:24:03.372700 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:03.372663 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:24:06.388418 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:06.388382 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:24:09.392887 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:09.392814 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:24:12.393075 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:12.393042 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:24:13.408741 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:13.408708 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-vh5g7/dw-deployment-82mr4-66bb5dd896-xcwrv"] Nov 03 21:24:13.409147 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:13.408924 5857 kuberuntime_container.go:898] "Killing container with a grace period" pod="test-ns-vh5g7/dw-deployment-82mr4-66bb5dd896-xcwrv" podUID="c2978f33-33da-4b73-a4dc-1d440f3b4ba7" containerName="notebook" containerID="cri-o://d853428de3aa08663fa722edaa5039ae81d9dec6a538333e223310f83ffd187a" gracePeriod=30 Nov 03 21:24:15.391409 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:15.391378 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:24:17.325474 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:17.325444 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-vh5g7_dw-deployment-82mr4-66bb5dd896-xcwrv_c2978f33-33da-4b73-a4dc-1d440f3b4ba7/notebook/0.log" Nov 03 21:24:19.499737 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:24:19.499696 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:24:43.592263 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:43.592233 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-vh5g7/dw-deployment-82mr4-66bb5dd896-xcwrv" Nov 03 21:24:43.673659 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:43.673557 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c2978f33-33da-4b73-a4dc-1d440f3b4ba7-notebook-config\" (UniqueName: \"kubernetes.io/configmap/c2978f33-33da-4b73-a4dc-1d440f3b4ba7-notebook-config\") pod \"c2978f33-33da-4b73-a4dc-1d440f3b4ba7\" (UID: \"c2978f33-33da-4b73-a4dc-1d440f3b4ba7\") " Nov 03 21:24:43.673659 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:43.673620 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c2978f33-33da-4b73-a4dc-1d440f3b4ba7-kube-api-access-6qzc7\" (UniqueName: \"kubernetes.io/projected/c2978f33-33da-4b73-a4dc-1d440f3b4ba7-kube-api-access-6qzc7\") pod \"c2978f33-33da-4b73-a4dc-1d440f3b4ba7\" (UID: \"c2978f33-33da-4b73-a4dc-1d440f3b4ba7\") " Nov 03 21:24:43.673874 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:43.673670 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/nfs/c2978f33-33da-4b73-a4dc-1d440f3b4ba7-pvc-d8676abb-69d3-4baa-bb0b-bfcc4cc4f5cc\" (UniqueName: \"kubernetes.io/nfs/c2978f33-33da-4b73-a4dc-1d440f3b4ba7-pvc-d8676abb-69d3-4baa-bb0b-bfcc4cc4f5cc\") pod \"c2978f33-33da-4b73-a4dc-1d440f3b4ba7\" (UID: \"c2978f33-33da-4b73-a4dc-1d440f3b4ba7\") " Nov 03 21:24:43.673960 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:43.673931 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2978f33-33da-4b73-a4dc-1d440f3b4ba7-notebook-config" pod "c2978f33-33da-4b73-a4dc-1d440f3b4ba7" (UID: "c2978f33-33da-4b73-a4dc-1d440f3b4ba7"). InnerVolumeSpecName "notebook-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 21:24:43.674024 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:43.673985 5857 reconciler_common.go:299] "Volume detached for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/c2978f33-33da-4b73-a4dc-1d440f3b4ba7-notebook-config\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 21:24:43.676313 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:43.676251 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2978f33-33da-4b73-a4dc-1d440f3b4ba7-kube-api-access-6qzc7" pod "c2978f33-33da-4b73-a4dc-1d440f3b4ba7" (UID: "c2978f33-33da-4b73-a4dc-1d440f3b4ba7"). InnerVolumeSpecName "kube-api-access-6qzc7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 21:24:43.707356 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:43.707324 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/nfs/c2978f33-33da-4b73-a4dc-1d440f3b4ba7-pvc-d8676abb-69d3-4baa-bb0b-bfcc4cc4f5cc" pod "c2978f33-33da-4b73-a4dc-1d440f3b4ba7" (UID: "c2978f33-33da-4b73-a4dc-1d440f3b4ba7"). InnerVolumeSpecName "pvc-d8676abb-69d3-4baa-bb0b-bfcc4cc4f5cc". PluginName "kubernetes.io/nfs", VolumeGIDValue "" Nov 03 21:24:43.775269 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:43.775230 5857 reconciler_common.go:299] "Volume detached for volume \"pvc-d8676abb-69d3-4baa-bb0b-bfcc4cc4f5cc\" (UniqueName: \"kubernetes.io/nfs/c2978f33-33da-4b73-a4dc-1d440f3b4ba7-pvc-d8676abb-69d3-4baa-bb0b-bfcc4cc4f5cc\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 21:24:43.775269 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:43.775263 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qzc7\" (UniqueName: \"kubernetes.io/projected/c2978f33-33da-4b73-a4dc-1d440f3b4ba7-kube-api-access-6qzc7\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 21:24:44.200548 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:44.200511 5857 generic.go:356] "Generic (PLEG): container finished" podID="c2978f33-33da-4b73-a4dc-1d440f3b4ba7" containerID="d853428de3aa08663fa722edaa5039ae81d9dec6a538333e223310f83ffd187a" exitCode=137 Nov 03 21:24:44.200754 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:44.200583 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-vh5g7/dw-deployment-82mr4-66bb5dd896-xcwrv" Nov 03 21:24:44.200754 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:44.200599 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-vh5g7/dw-deployment-82mr4-66bb5dd896-xcwrv" event={"ID":"c2978f33-33da-4b73-a4dc-1d440f3b4ba7","Type":"ContainerDied","Data":"d853428de3aa08663fa722edaa5039ae81d9dec6a538333e223310f83ffd187a"} Nov 03 21:24:44.200754 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:44.200661 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-vh5g7/dw-deployment-82mr4-66bb5dd896-xcwrv" event={"ID":"c2978f33-33da-4b73-a4dc-1d440f3b4ba7","Type":"ContainerDied","Data":"a8af35199820fb4fa9e2f06aa6b72e86d248d046601f3f3d557c145a93d8fc4f"} Nov 03 21:24:44.200754 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:44.200693 5857 scope.go:122] "RemoveContainer" containerID="d853428de3aa08663fa722edaa5039ae81d9dec6a538333e223310f83ffd187a" Nov 03 21:24:44.220523 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:44.220500 5857 scope.go:122] "RemoveContainer" containerID="d853428de3aa08663fa722edaa5039ae81d9dec6a538333e223310f83ffd187a" Nov 03 21:24:44.220830 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:24:44.220805 5857 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d853428de3aa08663fa722edaa5039ae81d9dec6a538333e223310f83ffd187a\": container with ID starting with d853428de3aa08663fa722edaa5039ae81d9dec6a538333e223310f83ffd187a not found: ID does not exist" containerID="d853428de3aa08663fa722edaa5039ae81d9dec6a538333e223310f83ffd187a" Nov 03 21:24:44.220927 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:44.220839 5857 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d853428de3aa08663fa722edaa5039ae81d9dec6a538333e223310f83ffd187a"} err="failed to get container status \"d853428de3aa08663fa722edaa5039ae81d9dec6a538333e223310f83ffd187a\": rpc error: code = NotFound desc = could not find container \"d853428de3aa08663fa722edaa5039ae81d9dec6a538333e223310f83ffd187a\": container with ID starting with d853428de3aa08663fa722edaa5039ae81d9dec6a538333e223310f83ffd187a not found: ID does not exist" Nov 03 21:24:44.363670 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:44.363558 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-vh5g7/dw-deployment-82mr4-66bb5dd896-xcwrv"] Nov 03 21:24:44.365171 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:44.365150 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-vh5g7/dw-deployment-82mr4-66bb5dd896-xcwrv"] Nov 03 21:24:44.572774 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:44.572738 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c2978f33-33da-4b73-a4dc-1d440f3b4ba7" path="/var/lib/kubelet/pods/c2978f33-33da-4b73-a4dc-1d440f3b4ba7/volumes" Nov 03 21:24:49.499553 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:24:49.499516 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:24:51.000162 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:51.000126 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-bgp8v/test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx"] Nov 03 21:24:51.000559 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:51.000466 5857 cpu_manager.go:414] "containerMap: removing container" podUID="c2978f33-33da-4b73-a4dc-1d440f3b4ba7" containerName="notebook" Nov 03 21:24:51.000559 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:51.000477 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c2978f33-33da-4b73-a4dc-1d440f3b4ba7" containerName="notebook" Nov 03 21:24:51.000559 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:51.000504 5857 cpu_manager.go:414] "containerMap: removing container" podUID="2787ca9a-53da-4b0f-8128-b03544c143ed" containerName="notebook" Nov 03 21:24:51.000559 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:51.000509 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2787ca9a-53da-4b0f-8128-b03544c143ed" containerName="notebook" Nov 03 21:24:51.000559 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:51.000586 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="2787ca9a-53da-4b0f-8128-b03544c143ed" containerName="notebook" Nov 03 21:24:51.000781 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:51.000597 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="c2978f33-33da-4b73-a4dc-1d440f3b4ba7" containerName="notebook" Nov 03 21:24:51.005838 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:51.005818 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-bgp8v/test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx" Nov 03 21:24:51.058090 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:51.058052 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-bgp8v\"/\"kube-root-ca.crt\"" Nov 03 21:24:51.107582 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:51.107526 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-bgp8v\"/\"default-dockercfg-dbb42\"" Nov 03 21:24:51.107582 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:51.107528 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-bgp8v\"/\"openshift-service-ca.crt\"" Nov 03 21:24:51.107805 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:51.107592 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-bgp8v\"/\"config-g42sg\"" Nov 03 21:24:51.109171 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:51.109148 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-bgp8v/test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx"] Nov 03 21:24:51.243488 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:51.243451 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fe6b7fb-dcaa-4141-ab75-98185c1876e9-dshm\") pod \"test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx\" (UID: \"2fe6b7fb-dcaa-4141-ab75-98185c1876e9\") " pod="test-ns-bgp8v/test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx" Nov 03 21:24:51.243703 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:51.243496 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-12dc9248-d7c4-4b2e-83ba-62508c328978\" (UniqueName: \"kubernetes.io/nfs/2fe6b7fb-dcaa-4141-ab75-98185c1876e9-pvc-12dc9248-d7c4-4b2e-83ba-62508c328978\") pod \"test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx\" (UID: \"2fe6b7fb-dcaa-4141-ab75-98185c1876e9\") " pod="test-ns-bgp8v/test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx" Nov 03 21:24:51.243703 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:51.243634 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjmxn\" (UniqueName: \"kubernetes.io/projected/2fe6b7fb-dcaa-4141-ab75-98185c1876e9-kube-api-access-rjmxn\") pod \"test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx\" (UID: \"2fe6b7fb-dcaa-4141-ab75-98185c1876e9\") " pod="test-ns-bgp8v/test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx" Nov 03 21:24:51.243703 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:51.243668 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"training-scripts\" (UniqueName: \"kubernetes.io/configmap/2fe6b7fb-dcaa-4141-ab75-98185c1876e9-training-scripts\") pod \"test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx\" (UID: \"2fe6b7fb-dcaa-4141-ab75-98185c1876e9\") " pod="test-ns-bgp8v/test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx" Nov 03 21:24:51.344439 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:51.344342 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fe6b7fb-dcaa-4141-ab75-98185c1876e9-dshm\") pod \"test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx\" (UID: \"2fe6b7fb-dcaa-4141-ab75-98185c1876e9\") " pod="test-ns-bgp8v/test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx" Nov 03 21:24:51.344439 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:51.344389 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-12dc9248-d7c4-4b2e-83ba-62508c328978\" (UniqueName: \"kubernetes.io/nfs/2fe6b7fb-dcaa-4141-ab75-98185c1876e9-pvc-12dc9248-d7c4-4b2e-83ba-62508c328978\") pod \"test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx\" (UID: \"2fe6b7fb-dcaa-4141-ab75-98185c1876e9\") " pod="test-ns-bgp8v/test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx" Nov 03 21:24:51.344439 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:51.344423 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjmxn\" (UniqueName: \"kubernetes.io/projected/2fe6b7fb-dcaa-4141-ab75-98185c1876e9-kube-api-access-rjmxn\") pod \"test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx\" (UID: \"2fe6b7fb-dcaa-4141-ab75-98185c1876e9\") " pod="test-ns-bgp8v/test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx" Nov 03 21:24:51.344439 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:51.344442 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"training-scripts\" (UniqueName: \"kubernetes.io/configmap/2fe6b7fb-dcaa-4141-ab75-98185c1876e9-training-scripts\") pod \"test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx\" (UID: \"2fe6b7fb-dcaa-4141-ab75-98185c1876e9\") " pod="test-ns-bgp8v/test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx" Nov 03 21:24:51.345390 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:51.345365 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"training-scripts\" (UniqueName: \"kubernetes.io/configmap/2fe6b7fb-dcaa-4141-ab75-98185c1876e9-training-scripts\") pod \"test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx\" (UID: \"2fe6b7fb-dcaa-4141-ab75-98185c1876e9\") " pod="test-ns-bgp8v/test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx" Nov 03 21:24:51.346974 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:51.346874 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fe6b7fb-dcaa-4141-ab75-98185c1876e9-dshm\") pod \"test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx\" (UID: \"2fe6b7fb-dcaa-4141-ab75-98185c1876e9\") " pod="test-ns-bgp8v/test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx" Nov 03 21:24:51.370526 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:51.370488 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-12dc9248-d7c4-4b2e-83ba-62508c328978\" (UniqueName: \"kubernetes.io/nfs/2fe6b7fb-dcaa-4141-ab75-98185c1876e9-pvc-12dc9248-d7c4-4b2e-83ba-62508c328978\") pod \"test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx\" (UID: \"2fe6b7fb-dcaa-4141-ab75-98185c1876e9\") " pod="test-ns-bgp8v/test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx" Nov 03 21:24:51.405664 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:51.405631 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjmxn\" (UniqueName: \"kubernetes.io/projected/2fe6b7fb-dcaa-4141-ab75-98185c1876e9-kube-api-access-rjmxn\") pod \"test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx\" (UID: \"2fe6b7fb-dcaa-4141-ab75-98185c1876e9\") " pod="test-ns-bgp8v/test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx" Nov 03 21:24:51.619271 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:51.619200 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-bgp8v/test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx" Nov 03 21:24:52.041291 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:52.041260 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-bgp8v/test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx"] Nov 03 21:24:52.044292 ip-10-0-140-181 kubenswrapper[5857]: W1103 21:24:52.044261 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fe6b7fb_dcaa_4141_ab75_98185c1876e9.slice/crio-048b88b1b389041c621ef38d60a04bcf03c138fa0e38fec9e5e3a9c856039e1a WatchSource:0}: Error finding container 048b88b1b389041c621ef38d60a04bcf03c138fa0e38fec9e5e3a9c856039e1a: Status 404 returned error can't find the container with id 048b88b1b389041c621ef38d60a04bcf03c138fa0e38fec9e5e3a9c856039e1a Nov 03 21:24:52.240535 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:52.240496 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-bgp8v/test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx" event={"ID":"2fe6b7fb-dcaa-4141-ab75-98185c1876e9","Type":"ContainerStarted","Data":"e0d023a42c1750777f50dcef506dfcce672aabbbcb08067e94e18ffc7f3c4010"} Nov 03 21:24:52.240778 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:52.240579 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-bgp8v/test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx" event={"ID":"2fe6b7fb-dcaa-4141-ab75-98185c1876e9","Type":"ContainerStarted","Data":"048b88b1b389041c621ef38d60a04bcf03c138fa0e38fec9e5e3a9c856039e1a"} Nov 03 21:24:52.362390 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:52.362270 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-bgp8v/test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx" podStartSLOduration=2.362254096 podStartE2EDuration="2.362254096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 21:24:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:24:52.361273934 +0000 UTC m=+5001.928164082" watchObservedRunningTime="2026-11-03 21:24:52.362254096 +0000 UTC m=+5001.929144244" Nov 03 21:24:53.946354 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:53.946271 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-bgp8v_test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx_2fe6b7fb-dcaa-4141-ab75-98185c1876e9/node/0.log" Nov 03 21:24:56.894073 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:56.894036 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-bgp8v_test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx_2fe6b7fb-dcaa-4141-ab75-98185c1876e9/node/0.log" Nov 03 21:24:59.892827 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:24:59.892792 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-bgp8v_test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx_2fe6b7fb-dcaa-4141-ab75-98185c1876e9/node/0.log" Nov 03 21:25:02.893702 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:02.893660 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-bgp8v_test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx_2fe6b7fb-dcaa-4141-ab75-98185c1876e9/node/0.log" Nov 03 21:25:05.893295 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:05.893262 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-bgp8v_test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx_2fe6b7fb-dcaa-4141-ab75-98185c1876e9/node/0.log" Nov 03 21:25:08.894458 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:08.894424 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-bgp8v_test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx_2fe6b7fb-dcaa-4141-ab75-98185c1876e9/node/0.log" Nov 03 21:25:11.894867 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:11.894825 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-bgp8v_test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx_2fe6b7fb-dcaa-4141-ab75-98185c1876e9/node/0.log" Nov 03 21:25:14.895555 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:14.895514 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-bgp8v_test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx_2fe6b7fb-dcaa-4141-ab75-98185c1876e9/node/0.log" Nov 03 21:25:17.893919 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:17.893884 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-bgp8v_test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx_2fe6b7fb-dcaa-4141-ab75-98185c1876e9/node/0.log" Nov 03 21:25:19.503589 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:25:19.503528 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:25:20.894434 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:20.894400 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-bgp8v_test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx_2fe6b7fb-dcaa-4141-ab75-98185c1876e9/node/0.log" Nov 03 21:25:23.895927 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:23.895895 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-bgp8v_test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx_2fe6b7fb-dcaa-4141-ab75-98185c1876e9/node/0.log" Nov 03 21:25:26.894811 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:26.894770 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-bgp8v_test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx_2fe6b7fb-dcaa-4141-ab75-98185c1876e9/node/0.log" Nov 03 21:25:29.894578 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:29.894534 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-bgp8v_test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx_2fe6b7fb-dcaa-4141-ab75-98185c1876e9/node/0.log" Nov 03 21:25:32.893861 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:32.893819 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-bgp8v_test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx_2fe6b7fb-dcaa-4141-ab75-98185c1876e9/node/0.log" Nov 03 21:25:35.494505 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:35.494473 5857 generic.go:356] "Generic (PLEG): container finished" podID="2fe6b7fb-dcaa-4141-ab75-98185c1876e9" containerID="e0d023a42c1750777f50dcef506dfcce672aabbbcb08067e94e18ffc7f3c4010" exitCode=0 Nov 03 21:25:35.494928 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:35.494554 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-bgp8v/test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx" event={"ID":"2fe6b7fb-dcaa-4141-ab75-98185c1876e9","Type":"ContainerDied","Data":"e0d023a42c1750777f50dcef506dfcce672aabbbcb08067e94e18ffc7f3c4010"} Nov 03 21:25:35.892529 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:35.892453 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-bgp8v_test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx_2fe6b7fb-dcaa-4141-ab75-98185c1876e9/node/0.log" Nov 03 21:25:36.629630 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:36.629605 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-bgp8v/test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx" Nov 03 21:25:36.698756 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:36.698728 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2fe6b7fb-dcaa-4141-ab75-98185c1876e9-dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fe6b7fb-dcaa-4141-ab75-98185c1876e9-dshm\") pod \"2fe6b7fb-dcaa-4141-ab75-98185c1876e9\" (UID: \"2fe6b7fb-dcaa-4141-ab75-98185c1876e9\") " Nov 03 21:25:36.698893 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:36.698770 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2fe6b7fb-dcaa-4141-ab75-98185c1876e9-kube-api-access-rjmxn\" (UniqueName: \"kubernetes.io/projected/2fe6b7fb-dcaa-4141-ab75-98185c1876e9-kube-api-access-rjmxn\") pod \"2fe6b7fb-dcaa-4141-ab75-98185c1876e9\" (UID: \"2fe6b7fb-dcaa-4141-ab75-98185c1876e9\") " Nov 03 21:25:36.698893 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:36.698821 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2fe6b7fb-dcaa-4141-ab75-98185c1876e9-training-scripts\" (UniqueName: \"kubernetes.io/configmap/2fe6b7fb-dcaa-4141-ab75-98185c1876e9-training-scripts\") pod \"2fe6b7fb-dcaa-4141-ab75-98185c1876e9\" (UID: \"2fe6b7fb-dcaa-4141-ab75-98185c1876e9\") " Nov 03 21:25:36.698893 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:36.698859 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/nfs/2fe6b7fb-dcaa-4141-ab75-98185c1876e9-pvc-12dc9248-d7c4-4b2e-83ba-62508c328978\" (UniqueName: \"kubernetes.io/nfs/2fe6b7fb-dcaa-4141-ab75-98185c1876e9-pvc-12dc9248-d7c4-4b2e-83ba-62508c328978\") pod \"2fe6b7fb-dcaa-4141-ab75-98185c1876e9\" (UID: \"2fe6b7fb-dcaa-4141-ab75-98185c1876e9\") " Nov 03 21:25:36.699453 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:36.699253 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fe6b7fb-dcaa-4141-ab75-98185c1876e9-training-scripts" pod "2fe6b7fb-dcaa-4141-ab75-98185c1876e9" (UID: "2fe6b7fb-dcaa-4141-ab75-98185c1876e9"). InnerVolumeSpecName "training-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 21:25:36.701298 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:36.701277 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fe6b7fb-dcaa-4141-ab75-98185c1876e9-dshm" pod "2fe6b7fb-dcaa-4141-ab75-98185c1876e9" (UID: "2fe6b7fb-dcaa-4141-ab75-98185c1876e9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 21:25:36.701644 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:36.701622 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fe6b7fb-dcaa-4141-ab75-98185c1876e9-kube-api-access-rjmxn" pod "2fe6b7fb-dcaa-4141-ab75-98185c1876e9" (UID: "2fe6b7fb-dcaa-4141-ab75-98185c1876e9"). InnerVolumeSpecName "kube-api-access-rjmxn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 21:25:36.722311 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:36.722280 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/nfs/2fe6b7fb-dcaa-4141-ab75-98185c1876e9-pvc-12dc9248-d7c4-4b2e-83ba-62508c328978" pod "2fe6b7fb-dcaa-4141-ab75-98185c1876e9" (UID: "2fe6b7fb-dcaa-4141-ab75-98185c1876e9"). InnerVolumeSpecName "pvc-12dc9248-d7c4-4b2e-83ba-62508c328978". PluginName "kubernetes.io/nfs", VolumeGIDValue "" Nov 03 21:25:36.800464 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:36.800387 5857 reconciler_common.go:299] "Volume detached for volume \"training-scripts\" (UniqueName: \"kubernetes.io/configmap/2fe6b7fb-dcaa-4141-ab75-98185c1876e9-training-scripts\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 21:25:36.800464 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:36.800417 5857 reconciler_common.go:299] "Volume detached for volume \"pvc-12dc9248-d7c4-4b2e-83ba-62508c328978\" (UniqueName: \"kubernetes.io/nfs/2fe6b7fb-dcaa-4141-ab75-98185c1876e9-pvc-12dc9248-d7c4-4b2e-83ba-62508c328978\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 21:25:36.800464 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:36.800431 5857 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fe6b7fb-dcaa-4141-ab75-98185c1876e9-dshm\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 21:25:36.800464 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:36.800443 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjmxn\" (UniqueName: \"kubernetes.io/projected/2fe6b7fb-dcaa-4141-ab75-98185c1876e9-kube-api-access-rjmxn\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 21:25:37.504332 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:37.504301 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-bgp8v/test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx" Nov 03 21:25:37.504510 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:37.504305 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-bgp8v/test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx" event={"ID":"2fe6b7fb-dcaa-4141-ab75-98185c1876e9","Type":"ContainerDied","Data":"048b88b1b389041c621ef38d60a04bcf03c138fa0e38fec9e5e3a9c856039e1a"} Nov 03 21:25:37.504510 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:37.504427 5857 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="048b88b1b389041c621ef38d60a04bcf03c138fa0e38fec9e5e3a9c856039e1a" Nov 03 21:25:38.712637 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:38.712604 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-bgp8v_test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx_2fe6b7fb-dcaa-4141-ab75-98185c1876e9/node/0.log" Nov 03 21:25:41.730516 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:25:41.730477 5857 upgradeaware.go:441] Error proxying data from backend to client: writeto tcp 127.0.0.1:44024->127.0.0.1:42131: read tcp 127.0.0.1:44024->127.0.0.1:42131: read: connection reset by peer Nov 03 21:25:42.946769 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:42.946733 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-hdfvw/trainer-netpol-curl-gv4bv"] Nov 03 21:25:42.947145 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:42.947101 5857 cpu_manager.go:414] "containerMap: removing container" podUID="2fe6b7fb-dcaa-4141-ab75-98185c1876e9" containerName="node" Nov 03 21:25:42.947145 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:42.947112 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2fe6b7fb-dcaa-4141-ab75-98185c1876e9" containerName="node" Nov 03 21:25:42.947217 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:42.947176 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="2fe6b7fb-dcaa-4141-ab75-98185c1876e9" containerName="node" Nov 03 21:25:42.950127 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:42.950109 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-hdfvw/trainer-netpol-curl-gv4bv" Nov 03 21:25:43.002290 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:43.002226 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-hdfvw\"/\"openshift-service-ca.crt\"" Nov 03 21:25:43.051547 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:43.051518 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-hdfvw\"/\"default-dockercfg-prnv9\"" Nov 03 21:25:43.052840 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:43.052815 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-hdfvw/trainer-netpol-curl-gv4bv"] Nov 03 21:25:43.053135 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:43.053116 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn9cv\" (UniqueName: \"kubernetes.io/projected/d336a48a-7a78-4d92-b0f7-b937e3abb46f-kube-api-access-qn9cv\") pod \"trainer-netpol-curl-gv4bv\" (UID: \"d336a48a-7a78-4d92-b0f7-b937e3abb46f\") " pod="test-ns-hdfvw/trainer-netpol-curl-gv4bv" Nov 03 21:25:43.103107 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:43.103082 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-hdfvw\"/\"kube-root-ca.crt\"" Nov 03 21:25:43.154396 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:43.154364 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn9cv\" (UniqueName: \"kubernetes.io/projected/d336a48a-7a78-4d92-b0f7-b937e3abb46f-kube-api-access-qn9cv\") pod \"trainer-netpol-curl-gv4bv\" (UID: \"d336a48a-7a78-4d92-b0f7-b937e3abb46f\") " pod="test-ns-hdfvw/trainer-netpol-curl-gv4bv" Nov 03 21:25:43.215345 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:43.215307 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn9cv\" (UniqueName: \"kubernetes.io/projected/d336a48a-7a78-4d92-b0f7-b937e3abb46f-kube-api-access-qn9cv\") pod \"trainer-netpol-curl-gv4bv\" (UID: \"d336a48a-7a78-4d92-b0f7-b937e3abb46f\") " pod="test-ns-hdfvw/trainer-netpol-curl-gv4bv" Nov 03 21:25:43.262287 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:43.262216 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-hdfvw/trainer-netpol-curl-gv4bv" Nov 03 21:25:43.630763 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:43.630676 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-hdfvw/trainer-netpol-curl-gv4bv"] Nov 03 21:25:43.634085 ip-10-0-140-181 kubenswrapper[5857]: W1103 21:25:43.634059 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd336a48a_7a78_4d92_b0f7_b937e3abb46f.slice/crio-57f2f63e5e7e6082d1b74184766d17c15a215af5f63b0f74051df7427d959919 WatchSource:0}: Error finding container 57f2f63e5e7e6082d1b74184766d17c15a215af5f63b0f74051df7427d959919: Status 404 returned error can't find the container with id 57f2f63e5e7e6082d1b74184766d17c15a215af5f63b0f74051df7427d959919 Nov 03 21:25:43.636017 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:43.635997 5857 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 03 21:25:43.935768 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:43.935681 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-bgp8v/test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx"] Nov 03 21:25:43.985181 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:43.985139 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-bgp8v/test-fashion-mnist-trainjob-shpn9-node-0-0-tnlmx"] Nov 03 21:25:44.536068 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:44.536032 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-hdfvw/trainer-netpol-curl-gv4bv" event={"ID":"d336a48a-7a78-4d92-b0f7-b937e3abb46f","Type":"ContainerStarted","Data":"57f2f63e5e7e6082d1b74184766d17c15a215af5f63b0f74051df7427d959919"} Nov 03 21:25:44.573095 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:25:44.573056 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2fe6b7fb-dcaa-4141-ab75-98185c1876e9" path="/var/lib/kubelet/pods/2fe6b7fb-dcaa-4141-ab75-98185c1876e9/volumes" Nov 03 21:25:49.502955 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:25:49.502919 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:26:04.626959 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:04.626862 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-hdfvw/trainer-netpol-curl-gv4bv" event={"ID":"d336a48a-7a78-4d92-b0f7-b937e3abb46f","Type":"ContainerStarted","Data":"7b1ca2fcad4b27a699d006b93ba16e605b6a324b63b097a724867abe2b14d85a"} Nov 03 21:26:04.740778 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:04.740717 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-hdfvw/trainer-netpol-curl-gv4bv" podStartSLOduration=2.042220976 podStartE2EDuration="22.740697189s" totalImagesPullingTime="20.698476213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:25:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:26:04.739123885 +0000 UTC m=+5074.306014032" watchObservedRunningTime="2026-11-03 21:26:04.740697189 +0000 UTC m=+5074.307587338" Nov 03 21:26:06.861740 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:06.861705 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hdfvw_trainer-netpol-curl-gv4bv_d336a48a-7a78-4d92-b0f7-b937e3abb46f/curl/0.log" Nov 03 21:26:09.650675 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:09.650636 5857 generic.go:356] "Generic (PLEG): container finished" podID="d336a48a-7a78-4d92-b0f7-b937e3abb46f" containerID="7b1ca2fcad4b27a699d006b93ba16e605b6a324b63b097a724867abe2b14d85a" exitCode=28 Nov 03 21:26:09.651059 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:09.650707 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-hdfvw/trainer-netpol-curl-gv4bv" event={"ID":"d336a48a-7a78-4d92-b0f7-b937e3abb46f","Type":"ContainerDied","Data":"7b1ca2fcad4b27a699d006b93ba16e605b6a324b63b097a724867abe2b14d85a"} Nov 03 21:26:09.861941 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:09.861909 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hdfvw_trainer-netpol-curl-gv4bv_d336a48a-7a78-4d92-b0f7-b937e3abb46f/curl/0.log" Nov 03 21:26:10.788476 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:10.788450 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-hdfvw/trainer-netpol-curl-gv4bv" Nov 03 21:26:10.900946 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:10.900912 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d336a48a-7a78-4d92-b0f7-b937e3abb46f-kube-api-access-qn9cv\" (UniqueName: \"kubernetes.io/projected/d336a48a-7a78-4d92-b0f7-b937e3abb46f-kube-api-access-qn9cv\") pod \"d336a48a-7a78-4d92-b0f7-b937e3abb46f\" (UID: \"d336a48a-7a78-4d92-b0f7-b937e3abb46f\") " Nov 03 21:26:10.904020 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:10.903987 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d336a48a-7a78-4d92-b0f7-b937e3abb46f-kube-api-access-qn9cv" pod "d336a48a-7a78-4d92-b0f7-b937e3abb46f" (UID: "d336a48a-7a78-4d92-b0f7-b937e3abb46f"). InnerVolumeSpecName "kube-api-access-qn9cv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 21:26:11.002039 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:11.001988 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qn9cv\" (UniqueName: \"kubernetes.io/projected/d336a48a-7a78-4d92-b0f7-b937e3abb46f-kube-api-access-qn9cv\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 21:26:11.207528 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:11.207494 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hdfvw_trainer-netpol-curl-gv4bv_d336a48a-7a78-4d92-b0f7-b937e3abb46f/curl/0.log" Nov 03 21:26:11.291780 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:11.291753 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hdfvw_trainer-netpol-curl-gv4bv_d336a48a-7a78-4d92-b0f7-b937e3abb46f/curl/0.log" Nov 03 21:26:11.548024 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:11.547936 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-5sqs9/trainer-netpol-curl-285rl"] Nov 03 21:26:11.548381 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:11.548360 5857 cpu_manager.go:414] "containerMap: removing container" podUID="d336a48a-7a78-4d92-b0f7-b937e3abb46f" containerName="curl" Nov 03 21:26:11.548465 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:11.548385 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d336a48a-7a78-4d92-b0f7-b937e3abb46f" containerName="curl" Nov 03 21:26:11.548522 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:11.548512 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="d336a48a-7a78-4d92-b0f7-b937e3abb46f" containerName="curl" Nov 03 21:26:11.551445 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:11.551424 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-5sqs9/trainer-netpol-curl-285rl" Nov 03 21:26:11.603934 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:11.603868 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-5sqs9\"/\"kube-root-ca.crt\"" Nov 03 21:26:11.604115 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:11.603987 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-5sqs9\"/\"openshift-service-ca.crt\"" Nov 03 21:26:11.605534 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:11.605506 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-5sqs9/trainer-netpol-curl-285rl"] Nov 03 21:26:11.606154 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:11.606129 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsw4n\" (UniqueName: \"kubernetes.io/projected/102a573b-48b1-4cc1-9860-a48c4432db68-kube-api-access-fsw4n\") pod \"trainer-netpol-curl-285rl\" (UID: \"102a573b-48b1-4cc1-9860-a48c4432db68\") " pod="test-ns-5sqs9/trainer-netpol-curl-285rl" Nov 03 21:26:11.653221 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:11.653183 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-5sqs9\"/\"default-dockercfg-f78gz\"" Nov 03 21:26:11.660721 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:11.660691 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-hdfvw/trainer-netpol-curl-gv4bv" event={"ID":"d336a48a-7a78-4d92-b0f7-b937e3abb46f","Type":"ContainerDied","Data":"57f2f63e5e7e6082d1b74184766d17c15a215af5f63b0f74051df7427d959919"} Nov 03 21:26:11.660857 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:11.660731 5857 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="57f2f63e5e7e6082d1b74184766d17c15a215af5f63b0f74051df7427d959919" Nov 03 21:26:11.660857 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:11.660706 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-hdfvw/trainer-netpol-curl-gv4bv" Nov 03 21:26:11.707666 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:11.707625 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsw4n\" (UniqueName: \"kubernetes.io/projected/102a573b-48b1-4cc1-9860-a48c4432db68-kube-api-access-fsw4n\") pod \"trainer-netpol-curl-285rl\" (UID: \"102a573b-48b1-4cc1-9860-a48c4432db68\") " pod="test-ns-5sqs9/trainer-netpol-curl-285rl" Nov 03 21:26:11.769018 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:11.768981 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsw4n\" (UniqueName: \"kubernetes.io/projected/102a573b-48b1-4cc1-9860-a48c4432db68-kube-api-access-fsw4n\") pod \"trainer-netpol-curl-285rl\" (UID: \"102a573b-48b1-4cc1-9860-a48c4432db68\") " pod="test-ns-5sqs9/trainer-netpol-curl-285rl" Nov 03 21:26:11.863472 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:11.863377 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-5sqs9/trainer-netpol-curl-285rl" Nov 03 21:26:12.233265 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:12.233227 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-5sqs9/trainer-netpol-curl-285rl"] Nov 03 21:26:12.236508 ip-10-0-140-181 kubenswrapper[5857]: W1103 21:26:12.236481 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod102a573b_48b1_4cc1_9860_a48c4432db68.slice/crio-c18bc1f102dad2f080442bec9188cc5893c2cf6f5e6eca6d4aa0a88a6fda909b WatchSource:0}: Error finding container c18bc1f102dad2f080442bec9188cc5893c2cf6f5e6eca6d4aa0a88a6fda909b: Status 404 returned error can't find the container with id c18bc1f102dad2f080442bec9188cc5893c2cf6f5e6eca6d4aa0a88a6fda909b Nov 03 21:26:12.667410 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:12.667314 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-5sqs9/trainer-netpol-curl-285rl" event={"ID":"102a573b-48b1-4cc1-9860-a48c4432db68","Type":"ContainerStarted","Data":"1a71b99f5e94de54f521c2e61b938da5c63ec934d27e35afdc768e467f446d18"} Nov 03 21:26:12.667410 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:12.667360 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-5sqs9/trainer-netpol-curl-285rl" event={"ID":"102a573b-48b1-4cc1-9860-a48c4432db68","Type":"ContainerStarted","Data":"c18bc1f102dad2f080442bec9188cc5893c2cf6f5e6eca6d4aa0a88a6fda909b"} Nov 03 21:26:12.780544 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:12.780484 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-5sqs9/trainer-netpol-curl-285rl" podStartSLOduration=1.7804651310000001 podStartE2EDuration="1.780465131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:26:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:26:12.779844194 +0000 UTC m=+5082.346734342" watchObservedRunningTime="2026-11-03 21:26:12.780465131 +0000 UTC m=+5082.347355283" Nov 03 21:26:14.461706 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:14.461671 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5sqs9_trainer-netpol-curl-285rl_102a573b-48b1-4cc1-9860-a48c4432db68/curl/0.log" Nov 03 21:26:16.396157 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:16.396119 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-hdfvw/trainer-netpol-curl-gv4bv"] Nov 03 21:26:16.400187 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:16.400161 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-hdfvw/trainer-netpol-curl-gv4bv"] Nov 03 21:26:16.572552 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:16.572519 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d336a48a-7a78-4d92-b0f7-b937e3abb46f" path="/var/lib/kubelet/pods/d336a48a-7a78-4d92-b0f7-b937e3abb46f/volumes" Nov 03 21:26:17.461738 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:17.461709 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5sqs9_trainer-netpol-curl-285rl_102a573b-48b1-4cc1-9860-a48c4432db68/curl/0.log" Nov 03 21:26:17.693683 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:17.693587 5857 generic.go:356] "Generic (PLEG): container finished" podID="102a573b-48b1-4cc1-9860-a48c4432db68" containerID="1a71b99f5e94de54f521c2e61b938da5c63ec934d27e35afdc768e467f446d18" exitCode=28 Nov 03 21:26:17.693683 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:17.693662 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-5sqs9/trainer-netpol-curl-285rl" event={"ID":"102a573b-48b1-4cc1-9860-a48c4432db68","Type":"ContainerDied","Data":"1a71b99f5e94de54f521c2e61b938da5c63ec934d27e35afdc768e467f446d18"} Nov 03 21:26:18.835848 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:18.835815 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-5sqs9/trainer-netpol-curl-285rl" Nov 03 21:26:18.970829 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:18.970794 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/102a573b-48b1-4cc1-9860-a48c4432db68-kube-api-access-fsw4n\" (UniqueName: \"kubernetes.io/projected/102a573b-48b1-4cc1-9860-a48c4432db68-kube-api-access-fsw4n\") pod \"102a573b-48b1-4cc1-9860-a48c4432db68\" (UID: \"102a573b-48b1-4cc1-9860-a48c4432db68\") " Nov 03 21:26:18.973268 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:18.973235 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/102a573b-48b1-4cc1-9860-a48c4432db68-kube-api-access-fsw4n" pod "102a573b-48b1-4cc1-9860-a48c4432db68" (UID: "102a573b-48b1-4cc1-9860-a48c4432db68"). InnerVolumeSpecName "kube-api-access-fsw4n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 21:26:19.072229 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:19.072188 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fsw4n\" (UniqueName: \"kubernetes.io/projected/102a573b-48b1-4cc1-9860-a48c4432db68-kube-api-access-fsw4n\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 21:26:19.499376 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:26:19.499338 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:26:19.645266 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:19.645227 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5sqs9_trainer-netpol-curl-285rl_102a573b-48b1-4cc1-9860-a48c4432db68/curl/0.log" Nov 03 21:26:19.704100 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:19.704065 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-5sqs9/trainer-netpol-curl-285rl" event={"ID":"102a573b-48b1-4cc1-9860-a48c4432db68","Type":"ContainerDied","Data":"c18bc1f102dad2f080442bec9188cc5893c2cf6f5e6eca6d4aa0a88a6fda909b"} Nov 03 21:26:19.704284 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:19.704110 5857 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c18bc1f102dad2f080442bec9188cc5893c2cf6f5e6eca6d4aa0a88a6fda909b" Nov 03 21:26:19.704284 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:19.704073 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-5sqs9/trainer-netpol-curl-285rl" Nov 03 21:26:19.729593 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:19.729549 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5sqs9_trainer-netpol-curl-285rl_102a573b-48b1-4cc1-9860-a48c4432db68/curl/0.log" Nov 03 21:26:19.987618 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:19.987582 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-58dhg/trainer-netpol-curl-6rkfm"] Nov 03 21:26:19.988005 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:19.987937 5857 cpu_manager.go:414] "containerMap: removing container" podUID="102a573b-48b1-4cc1-9860-a48c4432db68" containerName="curl" Nov 03 21:26:19.988005 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:19.987947 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="102a573b-48b1-4cc1-9860-a48c4432db68" containerName="curl" Nov 03 21:26:19.988005 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:19.988004 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="102a573b-48b1-4cc1-9860-a48c4432db68" containerName="curl" Nov 03 21:26:19.990916 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:19.990898 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-58dhg/trainer-netpol-curl-6rkfm" Nov 03 21:26:20.045746 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:20.045687 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-58dhg\"/\"openshift-service-ca.crt\"" Nov 03 21:26:20.045746 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:20.045689 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-58dhg\"/\"kube-root-ca.crt\"" Nov 03 21:26:20.046833 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:20.046799 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-58dhg/trainer-netpol-curl-6rkfm"] Nov 03 21:26:20.082004 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:20.081966 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gngz\" (UniqueName: \"kubernetes.io/projected/9e565502-40cd-424c-9f7e-774fa751c141-kube-api-access-4gngz\") pod \"trainer-netpol-curl-6rkfm\" (UID: \"9e565502-40cd-424c-9f7e-774fa751c141\") " pod="test-ns-58dhg/trainer-netpol-curl-6rkfm" Nov 03 21:26:20.094742 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:20.094717 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-58dhg\"/\"default-dockercfg-7gb9c\"" Nov 03 21:26:20.182985 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:20.182942 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gngz\" (UniqueName: \"kubernetes.io/projected/9e565502-40cd-424c-9f7e-774fa751c141-kube-api-access-4gngz\") pod \"trainer-netpol-curl-6rkfm\" (UID: \"9e565502-40cd-424c-9f7e-774fa751c141\") " pod="test-ns-58dhg/trainer-netpol-curl-6rkfm" Nov 03 21:26:20.244249 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:20.244171 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gngz\" (UniqueName: \"kubernetes.io/projected/9e565502-40cd-424c-9f7e-774fa751c141-kube-api-access-4gngz\") pod \"trainer-netpol-curl-6rkfm\" (UID: \"9e565502-40cd-424c-9f7e-774fa751c141\") " pod="test-ns-58dhg/trainer-netpol-curl-6rkfm" Nov 03 21:26:20.302785 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:20.302743 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-58dhg/trainer-netpol-curl-6rkfm" Nov 03 21:26:20.673973 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:20.673902 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-58dhg/trainer-netpol-curl-6rkfm"] Nov 03 21:26:20.676854 ip-10-0-140-181 kubenswrapper[5857]: W1103 21:26:20.676821 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9e565502_40cd_424c_9f7e_774fa751c141.slice/crio-e9d816b711d252ec5c8607f0e0478a500425f38d8f5fd832bbcb593b85be5688 WatchSource:0}: Error finding container e9d816b711d252ec5c8607f0e0478a500425f38d8f5fd832bbcb593b85be5688: Status 404 returned error can't find the container with id e9d816b711d252ec5c8607f0e0478a500425f38d8f5fd832bbcb593b85be5688 Nov 03 21:26:20.709345 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:20.709310 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-58dhg/trainer-netpol-curl-6rkfm" event={"ID":"9e565502-40cd-424c-9f7e-774fa751c141","Type":"ContainerStarted","Data":"e9d816b711d252ec5c8607f0e0478a500425f38d8f5fd832bbcb593b85be5688"} Nov 03 21:26:21.715632 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:21.715588 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-58dhg/trainer-netpol-curl-6rkfm" event={"ID":"9e565502-40cd-424c-9f7e-774fa751c141","Type":"ContainerStarted","Data":"da3609c973cc98699b8ddcfd6f8773f93b097b172cafcf1b2580858c9f6d447c"} Nov 03 21:26:22.899893 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:22.899863 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-58dhg_trainer-netpol-curl-6rkfm_9e565502-40cd-424c-9f7e-774fa751c141/curl/0.log" Nov 03 21:26:24.833947 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:24.833886 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-58dhg/trainer-netpol-curl-6rkfm" podStartSLOduration=5.833868718 podStartE2EDuration="5.833868718s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:26:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:26:21.829248848 +0000 UTC m=+5091.396139001" watchObservedRunningTime="2026-11-03 21:26:24.833868718 +0000 UTC m=+5094.400758865" Nov 03 21:26:24.834471 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:24.834274 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-5sqs9/trainer-netpol-curl-285rl"] Nov 03 21:26:24.836232 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:24.836201 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-5sqs9/trainer-netpol-curl-285rl"] Nov 03 21:26:25.900287 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:25.900254 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-58dhg_trainer-netpol-curl-6rkfm_9e565502-40cd-424c-9f7e-774fa751c141/curl/0.log" Nov 03 21:26:26.573718 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:26.573685 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="102a573b-48b1-4cc1-9860-a48c4432db68" path="/var/lib/kubelet/pods/102a573b-48b1-4cc1-9860-a48c4432db68/volumes" Nov 03 21:26:26.747470 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:26.747438 5857 generic.go:356] "Generic (PLEG): container finished" podID="9e565502-40cd-424c-9f7e-774fa751c141" containerID="da3609c973cc98699b8ddcfd6f8773f93b097b172cafcf1b2580858c9f6d447c" exitCode=28 Nov 03 21:26:26.747677 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:26.747515 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-58dhg/trainer-netpol-curl-6rkfm" event={"ID":"9e565502-40cd-424c-9f7e-774fa751c141","Type":"ContainerDied","Data":"da3609c973cc98699b8ddcfd6f8773f93b097b172cafcf1b2580858c9f6d447c"} Nov 03 21:26:27.891365 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:27.891337 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-58dhg/trainer-netpol-curl-6rkfm" Nov 03 21:26:27.952670 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:27.952618 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9e565502-40cd-424c-9f7e-774fa751c141-kube-api-access-4gngz\" (UniqueName: \"kubernetes.io/projected/9e565502-40cd-424c-9f7e-774fa751c141-kube-api-access-4gngz\") pod \"9e565502-40cd-424c-9f7e-774fa751c141\" (UID: \"9e565502-40cd-424c-9f7e-774fa751c141\") " Nov 03 21:26:27.955020 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:27.954991 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e565502-40cd-424c-9f7e-774fa751c141-kube-api-access-4gngz" pod "9e565502-40cd-424c-9f7e-774fa751c141" (UID: "9e565502-40cd-424c-9f7e-774fa751c141"). InnerVolumeSpecName "kube-api-access-4gngz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 21:26:28.053746 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:28.053639 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gngz\" (UniqueName: \"kubernetes.io/projected/9e565502-40cd-424c-9f7e-774fa751c141-kube-api-access-4gngz\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 21:26:28.080704 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:28.080679 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-58dhg_trainer-netpol-curl-6rkfm_9e565502-40cd-424c-9f7e-774fa751c141/curl/0.log" Nov 03 21:26:28.163804 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:28.163766 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-58dhg_trainer-netpol-curl-6rkfm_9e565502-40cd-424c-9f7e-774fa751c141/curl/0.log" Nov 03 21:26:28.346778 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:28.346693 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-9nz8n/trainer-netpol-curl-4hnqs"] Nov 03 21:26:28.347036 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:28.347023 5857 cpu_manager.go:414] "containerMap: removing container" podUID="9e565502-40cd-424c-9f7e-774fa751c141" containerName="curl" Nov 03 21:26:28.347080 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:28.347037 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9e565502-40cd-424c-9f7e-774fa751c141" containerName="curl" Nov 03 21:26:28.347124 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:28.347115 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="9e565502-40cd-424c-9f7e-774fa751c141" containerName="curl" Nov 03 21:26:28.349906 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:28.349891 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-9nz8n/trainer-netpol-curl-4hnqs" Nov 03 21:26:28.404638 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:28.404605 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-9nz8n\"/\"openshift-service-ca.crt\"" Nov 03 21:26:28.404875 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:28.404629 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-9nz8n\"/\"kube-root-ca.crt\"" Nov 03 21:26:28.406075 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:28.406054 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-9nz8n/trainer-netpol-curl-4hnqs"] Nov 03 21:26:28.454217 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:28.454183 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-9nz8n\"/\"default-dockercfg-hcrbx\"" Nov 03 21:26:28.457126 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:28.457103 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz52t\" (UniqueName: \"kubernetes.io/projected/398bace7-92e8-4a0c-8bc0-19350f54d012-kube-api-access-qz52t\") pod \"trainer-netpol-curl-4hnqs\" (UID: \"398bace7-92e8-4a0c-8bc0-19350f54d012\") " pod="test-ns-9nz8n/trainer-netpol-curl-4hnqs" Nov 03 21:26:28.558679 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:28.558637 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz52t\" (UniqueName: \"kubernetes.io/projected/398bace7-92e8-4a0c-8bc0-19350f54d012-kube-api-access-qz52t\") pod \"trainer-netpol-curl-4hnqs\" (UID: \"398bace7-92e8-4a0c-8bc0-19350f54d012\") " pod="test-ns-9nz8n/trainer-netpol-curl-4hnqs" Nov 03 21:26:28.619911 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:28.619848 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz52t\" (UniqueName: \"kubernetes.io/projected/398bace7-92e8-4a0c-8bc0-19350f54d012-kube-api-access-qz52t\") pod \"trainer-netpol-curl-4hnqs\" (UID: \"398bace7-92e8-4a0c-8bc0-19350f54d012\") " pod="test-ns-9nz8n/trainer-netpol-curl-4hnqs" Nov 03 21:26:28.661756 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:28.661728 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-9nz8n/trainer-netpol-curl-4hnqs" Nov 03 21:26:28.758910 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:28.758881 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-58dhg/trainer-netpol-curl-6rkfm" Nov 03 21:26:28.759075 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:28.758879 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-58dhg/trainer-netpol-curl-6rkfm" event={"ID":"9e565502-40cd-424c-9f7e-774fa751c141","Type":"ContainerDied","Data":"e9d816b711d252ec5c8607f0e0478a500425f38d8f5fd832bbcb593b85be5688"} Nov 03 21:26:28.759075 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:28.758995 5857 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e9d816b711d252ec5c8607f0e0478a500425f38d8f5fd832bbcb593b85be5688" Nov 03 21:26:29.034522 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:29.034491 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-9nz8n/trainer-netpol-curl-4hnqs"] Nov 03 21:26:29.037482 ip-10-0-140-181 kubenswrapper[5857]: W1103 21:26:29.037445 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod398bace7_92e8_4a0c_8bc0_19350f54d012.slice/crio-80d864279dcbc09be2155e49d6fbc76e6b5af36c81599aea3b72705477c4940e WatchSource:0}: Error finding container 80d864279dcbc09be2155e49d6fbc76e6b5af36c81599aea3b72705477c4940e: Status 404 returned error can't find the container with id 80d864279dcbc09be2155e49d6fbc76e6b5af36c81599aea3b72705477c4940e Nov 03 21:26:29.764429 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:29.764392 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-9nz8n/trainer-netpol-curl-4hnqs" event={"ID":"398bace7-92e8-4a0c-8bc0-19350f54d012","Type":"ContainerStarted","Data":"d54589f522062606ed0de7af616cc47b63e55abfac1d9021b88f64e808a6dea0"} Nov 03 21:26:29.764616 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:29.764440 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-9nz8n/trainer-netpol-curl-4hnqs" event={"ID":"398bace7-92e8-4a0c-8bc0-19350f54d012","Type":"ContainerStarted","Data":"80d864279dcbc09be2155e49d6fbc76e6b5af36c81599aea3b72705477c4940e"} Nov 03 21:26:29.878472 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:29.878422 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-9nz8n/trainer-netpol-curl-4hnqs" podStartSLOduration=1.878408126 podStartE2EDuration="1.878408126s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:26:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:26:29.877273273 +0000 UTC m=+5099.444163422" watchObservedRunningTime="2026-11-03 21:26:29.878408126 +0000 UTC m=+5099.445298273" Nov 03 21:26:31.302843 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:31.302817 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-9nz8n_trainer-netpol-curl-4hnqs_398bace7-92e8-4a0c-8bc0-19350f54d012/curl/0.log" Nov 03 21:26:33.268407 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:33.268372 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-58dhg/trainer-netpol-curl-6rkfm"] Nov 03 21:26:33.272462 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:33.272437 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-58dhg/trainer-netpol-curl-6rkfm"] Nov 03 21:26:34.304096 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:34.304065 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-9nz8n_trainer-netpol-curl-4hnqs_398bace7-92e8-4a0c-8bc0-19350f54d012/curl/0.log" Nov 03 21:26:34.572282 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:34.572251 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9e565502-40cd-424c-9f7e-774fa751c141" path="/var/lib/kubelet/pods/9e565502-40cd-424c-9f7e-774fa751c141/volumes" Nov 03 21:26:34.789536 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:34.789505 5857 generic.go:356] "Generic (PLEG): container finished" podID="398bace7-92e8-4a0c-8bc0-19350f54d012" containerID="d54589f522062606ed0de7af616cc47b63e55abfac1d9021b88f64e808a6dea0" exitCode=28 Nov 03 21:26:34.789716 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:34.789599 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-9nz8n/trainer-netpol-curl-4hnqs" event={"ID":"398bace7-92e8-4a0c-8bc0-19350f54d012","Type":"ContainerDied","Data":"d54589f522062606ed0de7af616cc47b63e55abfac1d9021b88f64e808a6dea0"} Nov 03 21:26:35.930303 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:35.930278 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-9nz8n/trainer-netpol-curl-4hnqs" Nov 03 21:26:36.018891 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:36.018857 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/398bace7-92e8-4a0c-8bc0-19350f54d012-kube-api-access-qz52t\" (UniqueName: \"kubernetes.io/projected/398bace7-92e8-4a0c-8bc0-19350f54d012-kube-api-access-qz52t\") pod \"398bace7-92e8-4a0c-8bc0-19350f54d012\" (UID: \"398bace7-92e8-4a0c-8bc0-19350f54d012\") " Nov 03 21:26:36.021177 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:36.021152 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/398bace7-92e8-4a0c-8bc0-19350f54d012-kube-api-access-qz52t" pod "398bace7-92e8-4a0c-8bc0-19350f54d012" (UID: "398bace7-92e8-4a0c-8bc0-19350f54d012"). InnerVolumeSpecName "kube-api-access-qz52t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 21:26:36.120292 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:36.120225 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qz52t\" (UniqueName: \"kubernetes.io/projected/398bace7-92e8-4a0c-8bc0-19350f54d012-kube-api-access-qz52t\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 21:26:36.443169 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:36.443080 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-9nz8n_trainer-netpol-curl-4hnqs_398bace7-92e8-4a0c-8bc0-19350f54d012/curl/0.log" Nov 03 21:26:36.529015 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:36.528987 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-9nz8n_trainer-netpol-curl-4hnqs_398bace7-92e8-4a0c-8bc0-19350f54d012/curl/0.log" Nov 03 21:26:36.806105 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:36.806073 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-9nz8n/trainer-netpol-curl-4hnqs" Nov 03 21:26:36.806271 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:36.806117 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-9nz8n/trainer-netpol-curl-4hnqs" event={"ID":"398bace7-92e8-4a0c-8bc0-19350f54d012","Type":"ContainerDied","Data":"80d864279dcbc09be2155e49d6fbc76e6b5af36c81599aea3b72705477c4940e"} Nov 03 21:26:36.806271 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:36.806157 5857 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="80d864279dcbc09be2155e49d6fbc76e6b5af36c81599aea3b72705477c4940e" Nov 03 21:26:37.513645 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:37.513598 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-556mv/trainer-netpol-workload-clkxr-node-0-0-vg96p"] Nov 03 21:26:37.514031 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:37.513941 5857 cpu_manager.go:414] "containerMap: removing container" podUID="398bace7-92e8-4a0c-8bc0-19350f54d012" containerName="curl" Nov 03 21:26:37.514031 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:37.513952 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="398bace7-92e8-4a0c-8bc0-19350f54d012" containerName="curl" Nov 03 21:26:37.514031 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:37.514016 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="398bace7-92e8-4a0c-8bc0-19350f54d012" containerName="curl" Nov 03 21:26:37.516991 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:37.516971 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-556mv/trainer-netpol-workload-clkxr-node-0-0-vg96p" Nov 03 21:26:37.618753 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:37.618719 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-556mv\"/\"default-dockercfg-h2dlx\"" Nov 03 21:26:37.618753 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:37.618736 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-556mv\"/\"openshift-service-ca.crt\"" Nov 03 21:26:37.618969 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:37.618829 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-556mv\"/\"kube-root-ca.crt\"" Nov 03 21:26:37.620174 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:37.620154 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-556mv/trainer-netpol-workload-clkxr-node-0-0-vg96p"] Nov 03 21:26:37.635758 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:37.635729 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xms4m\" (UniqueName: \"kubernetes.io/projected/ee902851-754c-4537-8e64-cfc1c31308de-kube-api-access-xms4m\") pod \"trainer-netpol-workload-clkxr-node-0-0-vg96p\" (UID: \"ee902851-754c-4537-8e64-cfc1c31308de\") " pod="test-ns-556mv/trainer-netpol-workload-clkxr-node-0-0-vg96p" Nov 03 21:26:37.736209 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:37.736179 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xms4m\" (UniqueName: \"kubernetes.io/projected/ee902851-754c-4537-8e64-cfc1c31308de-kube-api-access-xms4m\") pod \"trainer-netpol-workload-clkxr-node-0-0-vg96p\" (UID: \"ee902851-754c-4537-8e64-cfc1c31308de\") " pod="test-ns-556mv/trainer-netpol-workload-clkxr-node-0-0-vg96p" Nov 03 21:26:37.797467 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:37.797399 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xms4m\" (UniqueName: \"kubernetes.io/projected/ee902851-754c-4537-8e64-cfc1c31308de-kube-api-access-xms4m\") pod \"trainer-netpol-workload-clkxr-node-0-0-vg96p\" (UID: \"ee902851-754c-4537-8e64-cfc1c31308de\") " pod="test-ns-556mv/trainer-netpol-workload-clkxr-node-0-0-vg96p" Nov 03 21:26:37.827917 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:37.827892 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-556mv/trainer-netpol-workload-clkxr-node-0-0-vg96p" Nov 03 21:26:38.197490 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:38.197415 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-556mv/trainer-netpol-workload-clkxr-node-0-0-vg96p"] Nov 03 21:26:38.200551 ip-10-0-140-181 kubenswrapper[5857]: W1103 21:26:38.200525 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee902851_754c_4537_8e64_cfc1c31308de.slice/crio-026f11ad28120f3000e8390b47814b4c5a1091d4025b1027eea675881b01c164 WatchSource:0}: Error finding container 026f11ad28120f3000e8390b47814b4c5a1091d4025b1027eea675881b01c164: Status 404 returned error can't find the container with id 026f11ad28120f3000e8390b47814b4c5a1091d4025b1027eea675881b01c164 Nov 03 21:26:38.816643 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:38.816605 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-556mv/trainer-netpol-workload-clkxr-node-0-0-vg96p" event={"ID":"ee902851-754c-4537-8e64-cfc1c31308de","Type":"ContainerStarted","Data":"3174153a2ace4903ffeedfd144eadbc069939ea9607037da22e641402c4b8d34"} Nov 03 21:26:38.817043 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:38.816657 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-556mv/trainer-netpol-workload-clkxr-node-0-0-vg96p" event={"ID":"ee902851-754c-4537-8e64-cfc1c31308de","Type":"ContainerStarted","Data":"026f11ad28120f3000e8390b47814b4c5a1091d4025b1027eea675881b01c164"} Nov 03 21:26:38.932880 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:38.932826 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-556mv/trainer-netpol-workload-clkxr-node-0-0-vg96p" podStartSLOduration=1.9328119030000002 podStartE2EDuration="1.932811903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:26:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:26:38.93168805 +0000 UTC m=+5108.498578197" watchObservedRunningTime="2026-11-03 21:26:38.932811903 +0000 UTC m=+5108.499702050" Nov 03 21:26:39.670649 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:39.670588 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-556mv_trainer-netpol-workload-clkxr-node-0-0-vg96p_ee902851-754c-4537-8e64-cfc1c31308de/node/0.log" Nov 03 21:26:39.858424 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:39.858398 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-556mv_trainer-netpol-workload-clkxr-node-0-0-vg96p_ee902851-754c-4537-8e64-cfc1c31308de/node/0.log" Nov 03 21:26:39.950619 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:39.950523 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-fhmwj/trainer-netpol-curl-4ch2n"] Nov 03 21:26:39.954002 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:39.953983 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-fhmwj/trainer-netpol-curl-4ch2n" Nov 03 21:26:40.017510 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:40.017481 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-fhmwj\"/\"kube-root-ca.crt\"" Nov 03 21:26:40.020494 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:40.020469 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-fhmwj\"/\"openshift-service-ca.crt\"" Nov 03 21:26:40.033047 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:40.033019 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-fhmwj/trainer-netpol-curl-4ch2n"] Nov 03 21:26:40.054103 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:40.054077 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tstn6\" (UniqueName: \"kubernetes.io/projected/d5c97920-bd1f-446e-9fa5-f9943f720745-kube-api-access-tstn6\") pod \"trainer-netpol-curl-4ch2n\" (UID: \"d5c97920-bd1f-446e-9fa5-f9943f720745\") " pod="test-ns-fhmwj/trainer-netpol-curl-4ch2n" Nov 03 21:26:40.067122 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:40.067097 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-fhmwj\"/\"default-dockercfg-6qct7\"" Nov 03 21:26:40.154911 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:40.154883 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tstn6\" (UniqueName: \"kubernetes.io/projected/d5c97920-bd1f-446e-9fa5-f9943f720745-kube-api-access-tstn6\") pod \"trainer-netpol-curl-4ch2n\" (UID: \"d5c97920-bd1f-446e-9fa5-f9943f720745\") " pod="test-ns-fhmwj/trainer-netpol-curl-4ch2n" Nov 03 21:26:40.216065 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:40.216024 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tstn6\" (UniqueName: \"kubernetes.io/projected/d5c97920-bd1f-446e-9fa5-f9943f720745-kube-api-access-tstn6\") pod \"trainer-netpol-curl-4ch2n\" (UID: \"d5c97920-bd1f-446e-9fa5-f9943f720745\") " pod="test-ns-fhmwj/trainer-netpol-curl-4ch2n" Nov 03 21:26:40.265770 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:40.265741 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-fhmwj/trainer-netpol-curl-4ch2n" Nov 03 21:26:40.634257 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:40.634043 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-fhmwj/trainer-netpol-curl-4ch2n"] Nov 03 21:26:40.636987 ip-10-0-140-181 kubenswrapper[5857]: W1103 21:26:40.636962 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd5c97920_bd1f_446e_9fa5_f9943f720745.slice/crio-b7c4c09a49690e565ab3e5e8844bfcd682e5821e9b6b5178d74b907822e791d4 WatchSource:0}: Error finding container b7c4c09a49690e565ab3e5e8844bfcd682e5821e9b6b5178d74b907822e791d4: Status 404 returned error can't find the container with id b7c4c09a49690e565ab3e5e8844bfcd682e5821e9b6b5178d74b907822e791d4 Nov 03 21:26:40.831108 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:40.831069 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-fhmwj/trainer-netpol-curl-4ch2n" event={"ID":"d5c97920-bd1f-446e-9fa5-f9943f720745","Type":"ContainerStarted","Data":"5a58ae3bcb451f22e74059264f5ed2fbe33ad83a39edab55e8ae8db73a2d6a36"} Nov 03 21:26:40.831303 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:40.831116 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-fhmwj/trainer-netpol-curl-4ch2n" event={"ID":"d5c97920-bd1f-446e-9fa5-f9943f720745","Type":"ContainerStarted","Data":"b7c4c09a49690e565ab3e5e8844bfcd682e5821e9b6b5178d74b907822e791d4"} Nov 03 21:26:40.944887 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:40.944764 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-fhmwj/trainer-netpol-curl-4ch2n" podStartSLOduration=1.944745595 podStartE2EDuration="1.944745595s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:26:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:26:40.944306131 +0000 UTC m=+5110.511196280" watchObservedRunningTime="2026-11-03 21:26:40.944745595 +0000 UTC m=+5110.511635744" Nov 03 21:26:41.635554 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:41.635520 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-9nz8n/trainer-netpol-curl-4hnqs"] Nov 03 21:26:41.641499 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:41.641471 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-9nz8n/trainer-netpol-curl-4hnqs"] Nov 03 21:26:42.572610 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:42.572556 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="398bace7-92e8-4a0c-8bc0-19350f54d012" path="/var/lib/kubelet/pods/398bace7-92e8-4a0c-8bc0-19350f54d012/volumes" Nov 03 21:26:42.668732 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:42.668704 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-556mv_trainer-netpol-workload-clkxr-node-0-0-vg96p_ee902851-754c-4537-8e64-cfc1c31308de/node/0.log" Nov 03 21:26:42.686120 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:42.686095 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fhmwj_trainer-netpol-curl-4ch2n_d5c97920-bd1f-446e-9fa5-f9943f720745/curl/0.log" Nov 03 21:26:45.669672 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:45.669640 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-556mv_trainer-netpol-workload-clkxr-node-0-0-vg96p_ee902851-754c-4537-8e64-cfc1c31308de/node/0.log" Nov 03 21:26:45.687159 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:45.687136 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fhmwj_trainer-netpol-curl-4ch2n_d5c97920-bd1f-446e-9fa5-f9943f720745/curl/0.log" Nov 03 21:26:45.858124 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:45.858092 5857 generic.go:356] "Generic (PLEG): container finished" podID="d5c97920-bd1f-446e-9fa5-f9943f720745" containerID="5a58ae3bcb451f22e74059264f5ed2fbe33ad83a39edab55e8ae8db73a2d6a36" exitCode=28 Nov 03 21:26:45.858292 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:45.858166 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-fhmwj/trainer-netpol-curl-4ch2n" event={"ID":"d5c97920-bd1f-446e-9fa5-f9943f720745","Type":"ContainerDied","Data":"5a58ae3bcb451f22e74059264f5ed2fbe33ad83a39edab55e8ae8db73a2d6a36"} Nov 03 21:26:46.051187 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:46.051157 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fhmwj_trainer-netpol-curl-4ch2n_d5c97920-bd1f-446e-9fa5-f9943f720745/curl/0.log" Nov 03 21:26:46.135141 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:46.135113 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fhmwj_trainer-netpol-curl-4ch2n_d5c97920-bd1f-446e-9fa5-f9943f720745/curl/0.log" Nov 03 21:26:46.252641 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:46.252610 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-556mv_trainer-netpol-workload-clkxr-node-0-0-vg96p_ee902851-754c-4537-8e64-cfc1c31308de/node/0.log" Nov 03 21:26:47.001040 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:47.001018 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-fhmwj/trainer-netpol-curl-4ch2n" Nov 03 21:26:47.119166 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:47.119075 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d5c97920-bd1f-446e-9fa5-f9943f720745-kube-api-access-tstn6\" (UniqueName: \"kubernetes.io/projected/d5c97920-bd1f-446e-9fa5-f9943f720745-kube-api-access-tstn6\") pod \"d5c97920-bd1f-446e-9fa5-f9943f720745\" (UID: \"d5c97920-bd1f-446e-9fa5-f9943f720745\") " Nov 03 21:26:47.121609 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:47.121550 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5c97920-bd1f-446e-9fa5-f9943f720745-kube-api-access-tstn6" pod "d5c97920-bd1f-446e-9fa5-f9943f720745" (UID: "d5c97920-bd1f-446e-9fa5-f9943f720745"). InnerVolumeSpecName "kube-api-access-tstn6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 21:26:47.220308 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:47.220274 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tstn6\" (UniqueName: \"kubernetes.io/projected/d5c97920-bd1f-446e-9fa5-f9943f720745-kube-api-access-tstn6\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 21:26:47.870389 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:47.870355 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-fhmwj/trainer-netpol-curl-4ch2n" event={"ID":"d5c97920-bd1f-446e-9fa5-f9943f720745","Type":"ContainerDied","Data":"b7c4c09a49690e565ab3e5e8844bfcd682e5821e9b6b5178d74b907822e791d4"} Nov 03 21:26:47.870627 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:47.870399 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-fhmwj/trainer-netpol-curl-4ch2n" Nov 03 21:26:47.870627 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:47.870400 5857 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b7c4c09a49690e565ab3e5e8844bfcd682e5821e9b6b5178d74b907822e791d4" Nov 03 21:26:49.498914 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:26:49.498877 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:26:49.634670 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:49.634639 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-6fh56/trainer-netpol-curl-ngkst"] Nov 03 21:26:49.634973 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:49.634961 5857 cpu_manager.go:414] "containerMap: removing container" podUID="d5c97920-bd1f-446e-9fa5-f9943f720745" containerName="curl" Nov 03 21:26:49.635017 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:49.634974 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d5c97920-bd1f-446e-9fa5-f9943f720745" containerName="curl" Nov 03 21:26:49.635103 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:49.635055 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="d5c97920-bd1f-446e-9fa5-f9943f720745" containerName="curl" Nov 03 21:26:49.638005 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:49.637989 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-6fh56/trainer-netpol-curl-ngkst" Nov 03 21:26:49.639765 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:49.639741 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9jc6\" (UniqueName: \"kubernetes.io/projected/ac65d320-43fb-409c-92dd-f39f313f29df-kube-api-access-z9jc6\") pod \"trainer-netpol-curl-ngkst\" (UID: \"ac65d320-43fb-409c-92dd-f39f313f29df\") " pod="test-ns-6fh56/trainer-netpol-curl-ngkst" Nov 03 21:26:49.694227 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:49.694200 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-6fh56/trainer-netpol-curl-ngkst"] Nov 03 21:26:49.740838 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:49.740805 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9jc6\" (UniqueName: \"kubernetes.io/projected/ac65d320-43fb-409c-92dd-f39f313f29df-kube-api-access-z9jc6\") pod \"trainer-netpol-curl-ngkst\" (UID: \"ac65d320-43fb-409c-92dd-f39f313f29df\") " pod="test-ns-6fh56/trainer-netpol-curl-ngkst" Nov 03 21:26:49.741832 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:49.741815 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-6fh56\"/\"kube-root-ca.crt\"" Nov 03 21:26:49.741907 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:49.741826 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-6fh56\"/\"default-dockercfg-cr4h2\"" Nov 03 21:26:49.741907 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:49.741821 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-6fh56\"/\"openshift-service-ca.crt\"" Nov 03 21:26:49.801964 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:49.801888 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9jc6\" (UniqueName: \"kubernetes.io/projected/ac65d320-43fb-409c-92dd-f39f313f29df-kube-api-access-z9jc6\") pod \"trainer-netpol-curl-ngkst\" (UID: \"ac65d320-43fb-409c-92dd-f39f313f29df\") " pod="test-ns-6fh56/trainer-netpol-curl-ngkst" Nov 03 21:26:49.949218 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:49.949180 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-6fh56/trainer-netpol-curl-ngkst" Nov 03 21:26:50.318187 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:50.318163 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-6fh56/trainer-netpol-curl-ngkst"] Nov 03 21:26:50.320996 ip-10-0-140-181 kubenswrapper[5857]: W1103 21:26:50.320969 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac65d320_43fb_409c_92dd_f39f313f29df.slice/crio-ab404696d816b5c11705bb4967f7a4ed743ae6d8d9a63b31fa062f233acb361e WatchSource:0}: Error finding container ab404696d816b5c11705bb4967f7a4ed743ae6d8d9a63b31fa062f233acb361e: Status 404 returned error can't find the container with id ab404696d816b5c11705bb4967f7a4ed743ae6d8d9a63b31fa062f233acb361e Nov 03 21:26:50.886140 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:50.886102 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-6fh56/trainer-netpol-curl-ngkst" event={"ID":"ac65d320-43fb-409c-92dd-f39f313f29df","Type":"ContainerStarted","Data":"89d7a61ea92332f9a4c3436967ae467a2db2bc594266a4935001308f4a8e26fb"} Nov 03 21:26:50.886558 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:50.886149 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-6fh56/trainer-netpol-curl-ngkst" event={"ID":"ac65d320-43fb-409c-92dd-f39f313f29df","Type":"ContainerStarted","Data":"ab404696d816b5c11705bb4967f7a4ed743ae6d8d9a63b31fa062f233acb361e"} Nov 03 21:26:50.999342 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:50.999290 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-6fh56/trainer-netpol-curl-ngkst" podStartSLOduration=1.999275755 podStartE2EDuration="1.999275755s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:26:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:26:50.998635542 +0000 UTC m=+5120.565525670" watchObservedRunningTime="2026-11-03 21:26:50.999275755 +0000 UTC m=+5120.566165903" Nov 03 21:26:51.240394 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:51.240358 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-fhmwj/trainer-netpol-curl-4ch2n"] Nov 03 21:26:51.246521 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:51.246491 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-fhmwj/trainer-netpol-curl-4ch2n"] Nov 03 21:26:51.357677 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:51.357640 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-556mv/trainer-netpol-workload-clkxr-node-0-0-vg96p"] Nov 03 21:26:51.357879 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:51.357855 5857 kuberuntime_container.go:898] "Killing container with a grace period" pod="test-ns-556mv/trainer-netpol-workload-clkxr-node-0-0-vg96p" podUID="ee902851-754c-4537-8e64-cfc1c31308de" containerName="node" containerID="cri-o://3174153a2ace4903ffeedfd144eadbc069939ea9607037da22e641402c4b8d34" gracePeriod=30 Nov 03 21:26:52.404221 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:52.404189 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-6fh56_trainer-netpol-curl-ngkst_ac65d320-43fb-409c-92dd-f39f313f29df/curl/0.log" Nov 03 21:26:52.572199 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:52.572165 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d5c97920-bd1f-446e-9fa5-f9943f720745" path="/var/lib/kubelet/pods/d5c97920-bd1f-446e-9fa5-f9943f720745/volumes" Nov 03 21:26:55.404912 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:55.404890 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-6fh56_trainer-netpol-curl-ngkst_ac65d320-43fb-409c-92dd-f39f313f29df/curl/0.log" Nov 03 21:26:55.911534 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:55.911500 5857 generic.go:356] "Generic (PLEG): container finished" podID="ac65d320-43fb-409c-92dd-f39f313f29df" containerID="89d7a61ea92332f9a4c3436967ae467a2db2bc594266a4935001308f4a8e26fb" exitCode=28 Nov 03 21:26:55.911763 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:55.911597 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-6fh56/trainer-netpol-curl-ngkst" event={"ID":"ac65d320-43fb-409c-92dd-f39f313f29df","Type":"ContainerDied","Data":"89d7a61ea92332f9a4c3436967ae467a2db2bc594266a4935001308f4a8e26fb"} Nov 03 21:26:57.046934 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:57.046911 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-6fh56/trainer-netpol-curl-ngkst" Nov 03 21:26:57.097125 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:57.097098 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ac65d320-43fb-409c-92dd-f39f313f29df-kube-api-access-z9jc6\" (UniqueName: \"kubernetes.io/projected/ac65d320-43fb-409c-92dd-f39f313f29df-kube-api-access-z9jc6\") pod \"ac65d320-43fb-409c-92dd-f39f313f29df\" (UID: \"ac65d320-43fb-409c-92dd-f39f313f29df\") " Nov 03 21:26:57.099399 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:57.099365 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac65d320-43fb-409c-92dd-f39f313f29df-kube-api-access-z9jc6" pod "ac65d320-43fb-409c-92dd-f39f313f29df" (UID: "ac65d320-43fb-409c-92dd-f39f313f29df"). InnerVolumeSpecName "kube-api-access-z9jc6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 21:26:57.197716 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:57.197642 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9jc6\" (UniqueName: \"kubernetes.io/projected/ac65d320-43fb-409c-92dd-f39f313f29df-kube-api-access-z9jc6\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 21:26:57.731351 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:57.731313 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-6fh56_trainer-netpol-curl-ngkst_ac65d320-43fb-409c-92dd-f39f313f29df/curl/0.log" Nov 03 21:26:57.815646 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:57.815618 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-6fh56_trainer-netpol-curl-ngkst_ac65d320-43fb-409c-92dd-f39f313f29df/curl/0.log" Nov 03 21:26:57.922984 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:57.922954 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-6fh56/trainer-netpol-curl-ngkst" Nov 03 21:26:57.922984 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:57.922970 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-6fh56/trainer-netpol-curl-ngkst" event={"ID":"ac65d320-43fb-409c-92dd-f39f313f29df","Type":"ContainerDied","Data":"ab404696d816b5c11705bb4967f7a4ed743ae6d8d9a63b31fa062f233acb361e"} Nov 03 21:26:57.923175 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:26:57.923004 5857 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab404696d816b5c11705bb4967f7a4ed743ae6d8d9a63b31fa062f233acb361e" Nov 03 21:27:01.597705 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:01.597670 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-522xp/must-gather-9kjjx"] Nov 03 21:27:01.598109 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:01.598044 5857 cpu_manager.go:414] "containerMap: removing container" podUID="ac65d320-43fb-409c-92dd-f39f313f29df" containerName="curl" Nov 03 21:27:01.598109 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:01.598055 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ac65d320-43fb-409c-92dd-f39f313f29df" containerName="curl" Nov 03 21:27:01.598178 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:01.598121 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="ac65d320-43fb-409c-92dd-f39f313f29df" containerName="curl" Nov 03 21:27:01.601556 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:01.601537 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-522xp/must-gather-9kjjx" Nov 03 21:27:01.634147 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:01.634115 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948-must-gather-output\") pod \"must-gather-9kjjx\" (UID: \"ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948\") " pod="openshift-must-gather-522xp/must-gather-9kjjx" Nov 03 21:27:01.634280 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:01.634256 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp7g2\" (UniqueName: \"kubernetes.io/projected/ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948-kube-api-access-gp7g2\") pod \"must-gather-9kjjx\" (UID: \"ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948\") " pod="openshift-must-gather-522xp/must-gather-9kjjx" Nov 03 21:27:01.658264 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:01.658234 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-522xp/must-gather-9kjjx"] Nov 03 21:27:01.705913 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:01.705874 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-522xp\"/\"kube-root-ca.crt\"" Nov 03 21:27:01.706096 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:01.705944 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-522xp\"/\"default-dockercfg-mxxmm\"" Nov 03 21:27:01.706096 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:01.705964 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-522xp\"/\"openshift-service-ca.crt\"" Nov 03 21:27:01.735381 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:01.735348 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp7g2\" (UniqueName: \"kubernetes.io/projected/ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948-kube-api-access-gp7g2\") pod \"must-gather-9kjjx\" (UID: \"ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948\") " pod="openshift-must-gather-522xp/must-gather-9kjjx" Nov 03 21:27:01.735583 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:01.735399 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948-must-gather-output\") pod \"must-gather-9kjjx\" (UID: \"ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948\") " pod="openshift-must-gather-522xp/must-gather-9kjjx" Nov 03 21:27:01.735752 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:01.735735 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948-must-gather-output\") pod \"must-gather-9kjjx\" (UID: \"ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948\") " pod="openshift-must-gather-522xp/must-gather-9kjjx" Nov 03 21:27:01.796872 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:01.796837 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp7g2\" (UniqueName: \"kubernetes.io/projected/ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948-kube-api-access-gp7g2\") pod \"must-gather-9kjjx\" (UID: \"ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948\") " pod="openshift-must-gather-522xp/must-gather-9kjjx" Nov 03 21:27:01.915415 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:01.915334 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-522xp/must-gather-9kjjx" Nov 03 21:27:02.287514 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:02.287483 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-522xp/must-gather-9kjjx"] Nov 03 21:27:02.290077 ip-10-0-140-181 kubenswrapper[5857]: W1103 21:27:02.290051 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podba0922df_aa7c_47f7_8dd3_5fe9fa7ce948.slice/crio-ee3dfa2e42ecf2637c9a75da4295804bf920a16e4e48aec0dcce3b41988f7d15 WatchSource:0}: Error finding container ee3dfa2e42ecf2637c9a75da4295804bf920a16e4e48aec0dcce3b41988f7d15: Status 404 returned error can't find the container with id ee3dfa2e42ecf2637c9a75da4295804bf920a16e4e48aec0dcce3b41988f7d15 Nov 03 21:27:02.949371 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:02.949338 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-522xp/must-gather-9kjjx" event={"ID":"ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948","Type":"ContainerStarted","Data":"ee3dfa2e42ecf2637c9a75da4295804bf920a16e4e48aec0dcce3b41988f7d15"} Nov 03 21:27:02.993074 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:02.993046 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-6fh56/trainer-netpol-curl-ngkst"] Nov 03 21:27:02.998309 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:02.998283 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-6fh56/trainer-netpol-curl-ngkst"] Nov 03 21:27:04.575873 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:04.575837 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ac65d320-43fb-409c-92dd-f39f313f29df" path="/var/lib/kubelet/pods/ac65d320-43fb-409c-92dd-f39f313f29df/volumes" Nov 03 21:27:09.999487 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:09.999450 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-522xp/must-gather-9kjjx" event={"ID":"ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948","Type":"ContainerStarted","Data":"4619f55332d7663757c58eb2b84a6fa7cb4de53d2324082c1902c31128638241"} Nov 03 21:27:09.999487 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:09.999499 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-522xp/must-gather-9kjjx" event={"ID":"ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948","Type":"ContainerStarted","Data":"0629ea817ad41cc5db16a72f65b1cf9b9843848e8b89f22d2b050726c05ce267"} Nov 03 21:27:10.115069 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:10.115012 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-522xp/must-gather-9kjjx" podStartSLOduration=2.269254518 podStartE2EDuration="9.114997516s" totalImagesPullingTime="6.845742998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:27:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:27:10.11379345 +0000 UTC m=+5139.680683619" watchObservedRunningTime="2026-11-03 21:27:10.114997516 +0000 UTC m=+5139.681887663" Nov 03 21:27:14.020528 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:14.020491 5857 generic.go:356] "Generic (PLEG): container finished" podID="ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948" containerID="0629ea817ad41cc5db16a72f65b1cf9b9843848e8b89f22d2b050726c05ce267" exitCode=0 Nov 03 21:27:14.020927 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:14.020587 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-522xp/must-gather-9kjjx" event={"ID":"ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948","Type":"ContainerDied","Data":"0629ea817ad41cc5db16a72f65b1cf9b9843848e8b89f22d2b050726c05ce267"} Nov 03 21:27:14.020976 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:14.020927 5857 scope.go:122] "RemoveContainer" containerID="0629ea817ad41cc5db16a72f65b1cf9b9843848e8b89f22d2b050726c05ce267" Nov 03 21:27:14.467857 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:14.467823 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-522xp_must-gather-9kjjx_ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948/gather/0.log" Nov 03 21:27:19.500035 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:27:19.499997 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:27:20.690030 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:20.689998 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-522xp/must-gather-9kjjx"] Nov 03 21:27:20.690477 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:20.690166 5857 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-must-gather-522xp/must-gather-9kjjx" podUID="ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948" containerName="copy" containerID="cri-o://4619f55332d7663757c58eb2b84a6fa7cb4de53d2324082c1902c31128638241" gracePeriod=2 Nov 03 21:27:20.739288 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:20.739253 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-522xp/must-gather-9kjjx"] Nov 03 21:27:20.741173 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:27:20.741139 5857 status_manager.go:1045] "Failed to get status for pod" err="pods \"must-gather-9kjjx\" is forbidden: User \"system:node:ip-10-0-140-181.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-522xp\": no relationship found between node 'ip-10-0-140-181.us-west-1.compute.internal' and this object" podUID="ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948" pod="openshift-must-gather-522xp/must-gather-9kjjx" Nov 03 21:27:20.968625 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:20.968600 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-522xp_must-gather-9kjjx_ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948/copy/0.log" Nov 03 21:27:20.970215 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:20.970198 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-522xp/must-gather-9kjjx" Nov 03 21:27:21.021170 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:27:21.021139 5857 status_manager.go:1045] "Failed to get status for pod" err="pods \"must-gather-9kjjx\" is forbidden: User \"system:node:ip-10-0-140-181.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-522xp\": no relationship found between node 'ip-10-0-140-181.us-west-1.compute.internal' and this object" podUID="ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948" pod="openshift-must-gather-522xp/must-gather-9kjjx" Nov 03 21:27:21.053714 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:21.053688 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-522xp_must-gather-9kjjx_ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948/copy/0.log" Nov 03 21:27:21.054040 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:21.054017 5857 generic.go:356] "Generic (PLEG): container finished" podID="ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948" containerID="4619f55332d7663757c58eb2b84a6fa7cb4de53d2324082c1902c31128638241" exitCode=143 Nov 03 21:27:21.054130 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:21.054073 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-522xp/must-gather-9kjjx" Nov 03 21:27:21.054130 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:21.054117 5857 scope.go:122] "RemoveContainer" containerID="4619f55332d7663757c58eb2b84a6fa7cb4de53d2324082c1902c31128638241" Nov 03 21:27:21.062677 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:21.062660 5857 scope.go:122] "RemoveContainer" containerID="0629ea817ad41cc5db16a72f65b1cf9b9843848e8b89f22d2b050726c05ce267" Nov 03 21:27:21.070304 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:21.070287 5857 scope.go:122] "RemoveContainer" containerID="4619f55332d7663757c58eb2b84a6fa7cb4de53d2324082c1902c31128638241" Nov 03 21:27:21.070590 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:27:21.070543 5857 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4619f55332d7663757c58eb2b84a6fa7cb4de53d2324082c1902c31128638241\": container with ID starting with 4619f55332d7663757c58eb2b84a6fa7cb4de53d2324082c1902c31128638241 not found: ID does not exist" containerID="4619f55332d7663757c58eb2b84a6fa7cb4de53d2324082c1902c31128638241" Nov 03 21:27:21.070651 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:21.070598 5857 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4619f55332d7663757c58eb2b84a6fa7cb4de53d2324082c1902c31128638241"} err="failed to get container status \"4619f55332d7663757c58eb2b84a6fa7cb4de53d2324082c1902c31128638241\": rpc error: code = NotFound desc = could not find container \"4619f55332d7663757c58eb2b84a6fa7cb4de53d2324082c1902c31128638241\": container with ID starting with 4619f55332d7663757c58eb2b84a6fa7cb4de53d2324082c1902c31128638241 not found: ID does not exist" Nov 03 21:27:21.070651 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:21.070626 5857 scope.go:122] "RemoveContainer" containerID="0629ea817ad41cc5db16a72f65b1cf9b9843848e8b89f22d2b050726c05ce267" Nov 03 21:27:21.070899 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:27:21.070877 5857 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0629ea817ad41cc5db16a72f65b1cf9b9843848e8b89f22d2b050726c05ce267\": container with ID starting with 0629ea817ad41cc5db16a72f65b1cf9b9843848e8b89f22d2b050726c05ce267 not found: ID does not exist" containerID="0629ea817ad41cc5db16a72f65b1cf9b9843848e8b89f22d2b050726c05ce267" Nov 03 21:27:21.070936 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:21.070908 5857 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0629ea817ad41cc5db16a72f65b1cf9b9843848e8b89f22d2b050726c05ce267"} err="failed to get container status \"0629ea817ad41cc5db16a72f65b1cf9b9843848e8b89f22d2b050726c05ce267\": rpc error: code = NotFound desc = could not find container \"0629ea817ad41cc5db16a72f65b1cf9b9843848e8b89f22d2b050726c05ce267\": container with ID starting with 0629ea817ad41cc5db16a72f65b1cf9b9843848e8b89f22d2b050726c05ce267 not found: ID does not exist" Nov 03 21:27:21.105047 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:27:21.105021 5857 status_manager.go:1045] "Failed to get status for pod" err="pods \"must-gather-9kjjx\" is forbidden: User \"system:node:ip-10-0-140-181.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-522xp\": no relationship found between node 'ip-10-0-140-181.us-west-1.compute.internal' and this object" podUID="ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948" pod="openshift-must-gather-522xp/must-gather-9kjjx" Nov 03 21:27:21.107322 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:21.107309 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948-must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948-must-gather-output\") pod \"ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948\" (UID: \"ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948\") " Nov 03 21:27:21.107375 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:21.107362 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948-kube-api-access-gp7g2\" (UniqueName: \"kubernetes.io/projected/ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948-kube-api-access-gp7g2\") pod \"ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948\" (UID: \"ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948\") " Nov 03 21:27:21.107652 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:21.107630 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948-must-gather-output" pod "ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948" (UID: "ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 21:27:21.109637 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:21.109609 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948-kube-api-access-gp7g2" pod "ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948" (UID: "ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948"). InnerVolumeSpecName "kube-api-access-gp7g2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 21:27:21.208761 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:21.208733 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gp7g2\" (UniqueName: \"kubernetes.io/projected/ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948-kube-api-access-gp7g2\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 21:27:21.208761 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:21.208759 5857 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948-must-gather-output\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 21:27:21.413174 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:27:21.413130 5857 status_manager.go:1045] "Failed to get status for pod" err="pods \"must-gather-9kjjx\" is forbidden: User \"system:node:ip-10-0-140-181.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-522xp\": no relationship found between node 'ip-10-0-140-181.us-west-1.compute.internal' and this object" podUID="ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948" pod="openshift-must-gather-522xp/must-gather-9kjjx" Nov 03 21:27:21.514312 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:21.514286 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-556mv/trainer-netpol-workload-clkxr-node-0-0-vg96p" Nov 03 21:27:21.611813 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:21.611776 5857 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ee902851-754c-4537-8e64-cfc1c31308de-kube-api-access-xms4m\" (UniqueName: \"kubernetes.io/projected/ee902851-754c-4537-8e64-cfc1c31308de-kube-api-access-xms4m\") pod \"ee902851-754c-4537-8e64-cfc1c31308de\" (UID: \"ee902851-754c-4537-8e64-cfc1c31308de\") " Nov 03 21:27:21.615049 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:21.615013 5857 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee902851-754c-4537-8e64-cfc1c31308de-kube-api-access-xms4m" pod "ee902851-754c-4537-8e64-cfc1c31308de" (UID: "ee902851-754c-4537-8e64-cfc1c31308de"). InnerVolumeSpecName "kube-api-access-xms4m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 21:27:21.680605 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:27:21.680538 5857 status_manager.go:1045] "Failed to get status for pod" err="pods \"must-gather-9kjjx\" is forbidden: User \"system:node:ip-10-0-140-181.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-522xp\": no relationship found between node 'ip-10-0-140-181.us-west-1.compute.internal' and this object" podUID="ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948" pod="openshift-must-gather-522xp/must-gather-9kjjx" Nov 03 21:27:21.712960 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:21.712929 5857 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xms4m\" (UniqueName: \"kubernetes.io/projected/ee902851-754c-4537-8e64-cfc1c31308de-kube-api-access-xms4m\") on node \"ip-10-0-140-181.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 21:27:22.060760 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:22.060724 5857 generic.go:356] "Generic (PLEG): container finished" podID="ee902851-754c-4537-8e64-cfc1c31308de" containerID="3174153a2ace4903ffeedfd144eadbc069939ea9607037da22e641402c4b8d34" exitCode=137 Nov 03 21:27:22.060928 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:22.060782 5857 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-556mv/trainer-netpol-workload-clkxr-node-0-0-vg96p" Nov 03 21:27:22.060928 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:22.060775 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-556mv/trainer-netpol-workload-clkxr-node-0-0-vg96p" event={"ID":"ee902851-754c-4537-8e64-cfc1c31308de","Type":"ContainerDied","Data":"3174153a2ace4903ffeedfd144eadbc069939ea9607037da22e641402c4b8d34"} Nov 03 21:27:22.061023 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:22.060932 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-556mv/trainer-netpol-workload-clkxr-node-0-0-vg96p" event={"ID":"ee902851-754c-4537-8e64-cfc1c31308de","Type":"ContainerDied","Data":"026f11ad28120f3000e8390b47814b4c5a1091d4025b1027eea675881b01c164"} Nov 03 21:27:22.061023 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:22.060953 5857 scope.go:122] "RemoveContainer" containerID="3174153a2ace4903ffeedfd144eadbc069939ea9607037da22e641402c4b8d34" Nov 03 21:27:22.069794 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:22.069777 5857 scope.go:122] "RemoveContainer" containerID="3174153a2ace4903ffeedfd144eadbc069939ea9607037da22e641402c4b8d34" Nov 03 21:27:22.070036 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:27:22.070019 5857 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3174153a2ace4903ffeedfd144eadbc069939ea9607037da22e641402c4b8d34\": container with ID starting with 3174153a2ace4903ffeedfd144eadbc069939ea9607037da22e641402c4b8d34 not found: ID does not exist" containerID="3174153a2ace4903ffeedfd144eadbc069939ea9607037da22e641402c4b8d34" Nov 03 21:27:22.070081 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:22.070046 5857 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3174153a2ace4903ffeedfd144eadbc069939ea9607037da22e641402c4b8d34"} err="failed to get container status \"3174153a2ace4903ffeedfd144eadbc069939ea9607037da22e641402c4b8d34\": rpc error: code = NotFound desc = could not find container \"3174153a2ace4903ffeedfd144eadbc069939ea9607037da22e641402c4b8d34\": container with ID starting with 3174153a2ace4903ffeedfd144eadbc069939ea9607037da22e641402c4b8d34 not found: ID does not exist" Nov 03 21:27:22.163784 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:27:22.163751 5857 status_manager.go:1045] "Failed to get status for pod" err="pods \"must-gather-9kjjx\" is forbidden: User \"system:node:ip-10-0-140-181.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-522xp\": no relationship found between node 'ip-10-0-140-181.us-west-1.compute.internal' and this object" podUID="ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948" pod="openshift-must-gather-522xp/must-gather-9kjjx" Nov 03 21:27:22.214687 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:27:22.214650 5857 status_manager.go:1045] "Failed to get status for pod" err="pods \"must-gather-9kjjx\" is forbidden: User \"system:node:ip-10-0-140-181.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-522xp\": no relationship found between node 'ip-10-0-140-181.us-west-1.compute.internal' and this object" podUID="ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948" pod="openshift-must-gather-522xp/must-gather-9kjjx" Nov 03 21:27:22.324978 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:22.324886 5857 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-556mv/trainer-netpol-workload-clkxr-node-0-0-vg96p"] Nov 03 21:27:22.328731 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:22.328710 5857 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-556mv/trainer-netpol-workload-clkxr-node-0-0-vg96p"] Nov 03 21:27:22.572211 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:22.572176 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948" path="/var/lib/kubelet/pods/ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948/volumes" Nov 03 21:27:22.572558 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:22.572544 5857 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ee902851-754c-4537-8e64-cfc1c31308de" path="/var/lib/kubelet/pods/ee902851-754c-4537-8e64-cfc1c31308de/volumes" Nov 03 21:27:26.377989 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:26.377949 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wz99q_30329c02-c760-48d5-86f7-dd265325adb0/global-pull-secret-syncer/0.log" Nov 03 21:27:29.376581 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:29.376537 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xgdct_98448491-e429-4d6f-a50a-7cb104997edf/konnectivity-agent/0.log" Nov 03 21:27:29.764108 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:29.764079 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-181.us-west-1.compute.internal_7433a56a703a69a62fac958fa017ce29/haproxy/0.log" Nov 03 21:27:33.215133 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:33.215103 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_53fe6e0a-d024-4b39-acfb-027b7f48922e/alertmanager/0.log" Nov 03 21:27:33.665270 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:33.665195 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_53fe6e0a-d024-4b39-acfb-027b7f48922e/config-reloader/0.log" Nov 03 21:27:34.085382 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:34.085350 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_53fe6e0a-d024-4b39-acfb-027b7f48922e/kube-rbac-proxy-web/0.log" Nov 03 21:27:34.506936 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:34.506905 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_53fe6e0a-d024-4b39-acfb-027b7f48922e/kube-rbac-proxy/0.log" Nov 03 21:27:34.534904 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:34.534872 5857 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5r6jx/perf-node-gather-daemonset-t9czh"] Nov 03 21:27:34.535198 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:34.535186 5857 cpu_manager.go:414] "containerMap: removing container" podUID="ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948" containerName="copy" Nov 03 21:27:34.535239 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:34.535199 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948" containerName="copy" Nov 03 21:27:34.535239 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:34.535225 5857 cpu_manager.go:414] "containerMap: removing container" podUID="ee902851-754c-4537-8e64-cfc1c31308de" containerName="node" Nov 03 21:27:34.535239 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:34.535230 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ee902851-754c-4537-8e64-cfc1c31308de" containerName="node" Nov 03 21:27:34.535338 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:34.535246 5857 cpu_manager.go:414] "containerMap: removing container" podUID="ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948" containerName="gather" Nov 03 21:27:34.535338 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:34.535251 5857 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948" containerName="gather" Nov 03 21:27:34.535338 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:34.535303 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="ee902851-754c-4537-8e64-cfc1c31308de" containerName="node" Nov 03 21:27:34.535338 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:34.535312 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948" containerName="gather" Nov 03 21:27:34.535338 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:34.535319 5857 memory_manager.go:365] "RemoveStaleState removing state" podUID="ba0922df-aa7c-47f7-8dd3-5fe9fa7ce948" containerName="copy" Nov 03 21:27:34.537860 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:34.537839 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5r6jx/perf-node-gather-daemonset-t9czh" Nov 03 21:27:34.590015 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:34.589980 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5r6jx\"/\"kube-root-ca.crt\"" Nov 03 21:27:34.590178 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:34.590035 5857 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5r6jx\"/\"openshift-service-ca.crt\"" Nov 03 21:27:34.619546 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:34.619507 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hdj7\" (UniqueName: \"kubernetes.io/projected/7b4d4d65-a8d0-4c38-8c6d-d1ec9793d008-kube-api-access-9hdj7\") pod \"perf-node-gather-daemonset-t9czh\" (UID: \"7b4d4d65-a8d0-4c38-8c6d-d1ec9793d008\") " pod="openshift-must-gather-5r6jx/perf-node-gather-daemonset-t9czh" Nov 03 21:27:34.619737 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:34.619553 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b4d4d65-a8d0-4c38-8c6d-d1ec9793d008-lib-modules\") pod \"perf-node-gather-daemonset-t9czh\" (UID: \"7b4d4d65-a8d0-4c38-8c6d-d1ec9793d008\") " pod="openshift-must-gather-5r6jx/perf-node-gather-daemonset-t9czh" Nov 03 21:27:34.619737 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:34.619689 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7b4d4d65-a8d0-4c38-8c6d-d1ec9793d008-podres\") pod \"perf-node-gather-daemonset-t9czh\" (UID: \"7b4d4d65-a8d0-4c38-8c6d-d1ec9793d008\") " pod="openshift-must-gather-5r6jx/perf-node-gather-daemonset-t9czh" Nov 03 21:27:34.619855 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:34.619732 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7b4d4d65-a8d0-4c38-8c6d-d1ec9793d008-proc\") pod \"perf-node-gather-daemonset-t9czh\" (UID: \"7b4d4d65-a8d0-4c38-8c6d-d1ec9793d008\") " pod="openshift-must-gather-5r6jx/perf-node-gather-daemonset-t9czh" Nov 03 21:27:34.619855 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:34.619849 5857 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b4d4d65-a8d0-4c38-8c6d-d1ec9793d008-sys\") pod \"perf-node-gather-daemonset-t9czh\" (UID: \"7b4d4d65-a8d0-4c38-8c6d-d1ec9793d008\") " pod="openshift-must-gather-5r6jx/perf-node-gather-daemonset-t9czh" Nov 03 21:27:34.639584 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:34.639545 5857 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5r6jx\"/\"default-dockercfg-k7zj7\"" Nov 03 21:27:34.640721 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:34.640703 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5r6jx/perf-node-gather-daemonset-t9czh"] Nov 03 21:27:34.720914 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:34.720883 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b4d4d65-a8d0-4c38-8c6d-d1ec9793d008-lib-modules\") pod \"perf-node-gather-daemonset-t9czh\" (UID: \"7b4d4d65-a8d0-4c38-8c6d-d1ec9793d008\") " pod="openshift-must-gather-5r6jx/perf-node-gather-daemonset-t9czh" Nov 03 21:27:34.720914 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:34.720918 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7b4d4d65-a8d0-4c38-8c6d-d1ec9793d008-podres\") pod \"perf-node-gather-daemonset-t9czh\" (UID: \"7b4d4d65-a8d0-4c38-8c6d-d1ec9793d008\") " pod="openshift-must-gather-5r6jx/perf-node-gather-daemonset-t9czh" Nov 03 21:27:34.721093 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:34.720938 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7b4d4d65-a8d0-4c38-8c6d-d1ec9793d008-proc\") pod \"perf-node-gather-daemonset-t9czh\" (UID: \"7b4d4d65-a8d0-4c38-8c6d-d1ec9793d008\") " pod="openshift-must-gather-5r6jx/perf-node-gather-daemonset-t9czh" Nov 03 21:27:34.721093 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:34.720988 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b4d4d65-a8d0-4c38-8c6d-d1ec9793d008-sys\") pod \"perf-node-gather-daemonset-t9czh\" (UID: \"7b4d4d65-a8d0-4c38-8c6d-d1ec9793d008\") " pod="openshift-must-gather-5r6jx/perf-node-gather-daemonset-t9czh" Nov 03 21:27:34.721093 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:34.721017 5857 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hdj7\" (UniqueName: \"kubernetes.io/projected/7b4d4d65-a8d0-4c38-8c6d-d1ec9793d008-kube-api-access-9hdj7\") pod \"perf-node-gather-daemonset-t9czh\" (UID: \"7b4d4d65-a8d0-4c38-8c6d-d1ec9793d008\") " pod="openshift-must-gather-5r6jx/perf-node-gather-daemonset-t9czh" Nov 03 21:27:34.721093 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:34.721018 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7b4d4d65-a8d0-4c38-8c6d-d1ec9793d008-podres\") pod \"perf-node-gather-daemonset-t9czh\" (UID: \"7b4d4d65-a8d0-4c38-8c6d-d1ec9793d008\") " pod="openshift-must-gather-5r6jx/perf-node-gather-daemonset-t9czh" Nov 03 21:27:34.721093 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:34.721018 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b4d4d65-a8d0-4c38-8c6d-d1ec9793d008-lib-modules\") pod \"perf-node-gather-daemonset-t9czh\" (UID: \"7b4d4d65-a8d0-4c38-8c6d-d1ec9793d008\") " pod="openshift-must-gather-5r6jx/perf-node-gather-daemonset-t9czh" Nov 03 21:27:34.721093 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:34.721058 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7b4d4d65-a8d0-4c38-8c6d-d1ec9793d008-proc\") pod \"perf-node-gather-daemonset-t9czh\" (UID: \"7b4d4d65-a8d0-4c38-8c6d-d1ec9793d008\") " pod="openshift-must-gather-5r6jx/perf-node-gather-daemonset-t9czh" Nov 03 21:27:34.721294 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:34.721227 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b4d4d65-a8d0-4c38-8c6d-d1ec9793d008-sys\") pod \"perf-node-gather-daemonset-t9czh\" (UID: \"7b4d4d65-a8d0-4c38-8c6d-d1ec9793d008\") " pod="openshift-must-gather-5r6jx/perf-node-gather-daemonset-t9czh" Nov 03 21:27:34.782117 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:34.782046 5857 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hdj7\" (UniqueName: \"kubernetes.io/projected/7b4d4d65-a8d0-4c38-8c6d-d1ec9793d008-kube-api-access-9hdj7\") pod \"perf-node-gather-daemonset-t9czh\" (UID: \"7b4d4d65-a8d0-4c38-8c6d-d1ec9793d008\") " pod="openshift-must-gather-5r6jx/perf-node-gather-daemonset-t9czh" Nov 03 21:27:34.848992 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:34.848962 5857 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5r6jx/perf-node-gather-daemonset-t9czh" Nov 03 21:27:34.931961 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:34.931529 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_53fe6e0a-d024-4b39-acfb-027b7f48922e/kube-rbac-proxy-metric/0.log" Nov 03 21:27:35.217622 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:35.217468 5857 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5r6jx/perf-node-gather-daemonset-t9czh"] Nov 03 21:27:35.220371 ip-10-0-140-181 kubenswrapper[5857]: W1103 21:27:35.220340 5857 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7b4d4d65_a8d0_4c38_8c6d_d1ec9793d008.slice/crio-fa7dd0f8288b00ac066043774e0ff2ac2e358de86d0972c2da89f13bc4647dc0 WatchSource:0}: Error finding container fa7dd0f8288b00ac066043774e0ff2ac2e358de86d0972c2da89f13bc4647dc0: Status 404 returned error can't find the container with id fa7dd0f8288b00ac066043774e0ff2ac2e358de86d0972c2da89f13bc4647dc0 Nov 03 21:27:35.369638 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:35.369601 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_53fe6e0a-d024-4b39-acfb-027b7f48922e/prom-label-proxy/0.log" Nov 03 21:27:35.789454 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:35.789394 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_53fe6e0a-d024-4b39-acfb-027b7f48922e/init-config-reloader/0.log" Nov 03 21:27:36.129083 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:36.129002 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5r6jx/perf-node-gather-daemonset-t9czh" event={"ID":"7b4d4d65-a8d0-4c38-8c6d-d1ec9793d008","Type":"ContainerStarted","Data":"8e8ef6032b0fc35d58127c6097b4d13dc6b152b9427ae6785db8e807ccfc35d6"} Nov 03 21:27:36.129083 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:36.129050 5857 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5r6jx/perf-node-gather-daemonset-t9czh" event={"ID":"7b4d4d65-a8d0-4c38-8c6d-d1ec9793d008","Type":"ContainerStarted","Data":"fa7dd0f8288b00ac066043774e0ff2ac2e358de86d0972c2da89f13bc4647dc0"} Nov 03 21:27:36.129278 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:36.129105 5857 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5r6jx/perf-node-gather-daemonset-t9czh" Nov 03 21:27:36.244934 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:36.244882 5857 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-5r6jx/perf-node-gather-daemonset-t9czh" podStartSLOduration=2.244867688 podStartE2EDuration="2.244867688s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 21:27:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:27:36.243793151 +0000 UTC m=+5165.810683309" watchObservedRunningTime="2026-11-03 21:27:36.244867688 +0000 UTC m=+5165.811757836" Nov 03 21:27:36.646377 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:36.646343 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-lwkdp_bd8a2436-4362-4c11-9e4b-9e20b73094e6/kube-state-metrics/0.log" Nov 03 21:27:37.063919 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:37.063882 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-lwkdp_bd8a2436-4362-4c11-9e4b-9e20b73094e6/kube-rbac-proxy-main/0.log" Nov 03 21:27:37.483218 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:37.483194 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-lwkdp_bd8a2436-4362-4c11-9e4b-9e20b73094e6/kube-rbac-proxy-self/0.log" Nov 03 21:27:37.910778 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:37.910700 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-748b9d444f-gwfk2_4dbfce43-ac06-4413-92eb-f123614df91d/metrics-server/0.log" Nov 03 21:27:40.020351 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:40.020322 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pxws5_eb01d4b7-2af5-4493-af2c-8d90a120851f/node-exporter/0.log" Nov 03 21:27:40.438482 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:40.438407 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pxws5_eb01d4b7-2af5-4493-af2c-8d90a120851f/kube-rbac-proxy/0.log" Nov 03 21:27:40.858010 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:40.857983 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pxws5_eb01d4b7-2af5-4493-af2c-8d90a120851f/init-textfile/0.log" Nov 03 21:27:42.144576 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:42.144543 5857 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5r6jx/perf-node-gather-daemonset-t9czh" Nov 03 21:27:42.544614 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:42.544585 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-w78q9_960e81d3-4bff-4a35-b6a8-edcd186c6c44/kube-rbac-proxy-main/0.log" Nov 03 21:27:42.964717 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:42.964674 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-w78q9_960e81d3-4bff-4a35-b6a8-edcd186c6c44/kube-rbac-proxy-self/0.log" Nov 03 21:27:43.390528 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:43.390449 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-w78q9_960e81d3-4bff-4a35-b6a8-edcd186c6c44/openshift-state-metrics/0.log" Nov 03 21:27:46.776091 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:46.776058 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-v5lh8_62a2d16f-a781-4b20-ae3e-323c123f9ac0/prometheus-operator/0.log" Nov 03 21:27:47.193755 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:47.193679 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-v5lh8_62a2d16f-a781-4b20-ae3e-323c123f9ac0/kube-rbac-proxy/0.log" Nov 03 21:27:47.616256 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:47.616228 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6489d8bf89-kl7g8_0c479f18-0308-403a-adf1-42575f8adfa2/prometheus-operator-admission-webhook/0.log" Nov 03 21:27:48.045716 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:48.045689 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c75c8599-kcxp6_f1241d10-9647-4075-9091-19183e105d50/telemeter-client/0.log" Nov 03 21:27:48.466029 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:48.466001 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c75c8599-kcxp6_f1241d10-9647-4075-9091-19183e105d50/reload/0.log" Nov 03 21:27:48.886518 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:48.886428 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c75c8599-kcxp6_f1241d10-9647-4075-9091-19183e105d50/kube-rbac-proxy/0.log" Nov 03 21:27:49.312091 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:49.312059 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75c5c6c675-9tqxn_f5da7c0e-2db7-48fd-ac10-bccc095ef79e/thanos-query/0.log" Nov 03 21:27:49.502098 ip-10-0-140-181 kubenswrapper[5857]: E1103 21:27:49.502064 5857 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-gt9b8" containerName="extractor" Nov 03 21:27:49.732221 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:49.732196 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75c5c6c675-9tqxn_f5da7c0e-2db7-48fd-ac10-bccc095ef79e/kube-rbac-proxy-web/0.log" Nov 03 21:27:50.152220 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:50.152109 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75c5c6c675-9tqxn_f5da7c0e-2db7-48fd-ac10-bccc095ef79e/kube-rbac-proxy/0.log" Nov 03 21:27:50.570998 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:50.570968 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75c5c6c675-9tqxn_f5da7c0e-2db7-48fd-ac10-bccc095ef79e/prom-label-proxy/0.log" Nov 03 21:27:50.990136 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:50.990105 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75c5c6c675-9tqxn_f5da7c0e-2db7-48fd-ac10-bccc095ef79e/kube-rbac-proxy-rules/0.log" Nov 03 21:27:51.425941 ip-10-0-140-181 kubenswrapper[5857]: I1103 21:27:51.425854 5857 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75c5c6c675-9tqxn_f5da7c0e-2db7-48fd-ac10-bccc095ef79e/kube-rbac-proxy-metrics/0.log"