Nov 02 21:50:27.246907 ip-10-0-139-99 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Nov 02 21:50:27.246919 ip-10-0-139-99 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Nov 02 21:50:27.246926 ip-10-0-139-99 systemd[1]: kubelet.service: Failed with result 'resources'. Nov 02 21:50:27.247177 ip-10-0-139-99 systemd[1]: Failed to start Kubernetes Kubelet. Nov 02 21:50:37.496235 ip-10-0-139-99 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Nov 02 21:50:37.496253 ip-10-0-139-99 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot ad8067dda37249ed8db4b49a7dbe7817 -- Nov 02 21:52:34.569221 ip-10-0-139-99 systemd[1]: Starting Kubernetes Kubelet... Nov 02 21:52:34.991585 ip-10-0-139-99 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 02 21:52:34.991585 ip-10-0-139-99 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Nov 02 21:52:34.991585 ip-10-0-139-99 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 02 21:52:34.991585 ip-10-0-139-99 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 02 21:52:34.995896 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.995813 2569 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 02 21:52:34.995896 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.995892 2569 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 02 21:52:34.995896 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.995896 2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 02 21:52:34.995896 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.995899 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 02 21:52:34.995896 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.995902 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 02 21:52:34.995896 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.995904 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 02 21:52:34.995896 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.995907 2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 02 21:52:34.996128 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.995910 2569 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 02 21:52:34.996128 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.995913 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 02 21:52:34.996128 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.995917 2569 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 02 21:52:34.996128 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.995919 2569 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 02 21:52:34.996128 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.995922 2569 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 02 21:52:34.996128 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.995925 2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 02 21:52:34.996128 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.995928 2569 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 02 21:52:34.996128 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.995930 2569 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 02 21:52:34.996128 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.995933 2569 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 02 21:52:34.996128 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.995935 2569 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 02 21:52:34.996128 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.995939 2569 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 02 21:52:34.996128 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.995943 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 02 21:52:34.996128 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.995946 2569 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 02 21:52:34.996128 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.995949 2569 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 02 21:52:34.996128 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.995951 2569 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 02 21:52:34.996128 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.995954 2569 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 02 21:52:34.996128 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.995957 2569 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 02 21:52:34.996128 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.995959 2569 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 02 21:52:34.996128 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.995962 2569 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 02 21:52:34.996578 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.995965 2569 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 02 21:52:34.996578 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.995970 2569 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 02 21:52:34.996578 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.995973 2569 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 02 21:52:34.996578 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.995975 2569 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 02 21:52:34.996578 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.995978 2569 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 02 21:52:34.996578 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.995981 2569 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 02 21:52:34.996578 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.995983 2569 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 02 21:52:34.996578 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.995986 2569 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 02 21:52:34.996578 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.995988 2569 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 02 21:52:34.996578 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.995991 2569 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 02 21:52:34.996578 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.995994 2569 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 02 21:52:34.996578 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.995996 2569 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 02 21:52:34.996578 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.995999 2569 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 02 21:52:34.996578 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996002 2569 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 02 21:52:34.996578 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996004 2569 feature_gate.go:386] unrecognized feature gate: Example2 Nov 02 21:52:34.996578 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996007 2569 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 02 21:52:34.996578 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996012 2569 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 02 21:52:34.996578 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996016 2569 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 02 21:52:34.996578 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996018 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 02 21:52:34.997073 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996021 2569 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 02 21:52:34.997073 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996023 2569 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 02 21:52:34.997073 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996026 2569 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 02 21:52:34.997073 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996028 2569 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 02 21:52:34.997073 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996031 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 02 21:52:34.997073 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996033 2569 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 02 21:52:34.997073 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996036 2569 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 02 21:52:34.997073 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996039 2569 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 02 21:52:34.997073 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996041 2569 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 02 21:52:34.997073 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996044 2569 feature_gate.go:386] unrecognized feature gate: EVPN Nov 02 21:52:34.997073 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996047 2569 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 02 21:52:34.997073 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996049 2569 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 02 21:52:34.997073 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996052 2569 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 02 21:52:34.997073 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996055 2569 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 02 21:52:34.997073 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996058 2569 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 02 21:52:34.997073 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996060 2569 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 02 21:52:34.997073 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996062 2569 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 02 21:52:34.997073 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996065 2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 02 21:52:34.997073 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996067 2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 02 21:52:34.997073 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996070 2569 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 02 21:52:34.997524 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996073 2569 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 02 21:52:34.997524 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996075 2569 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 02 21:52:34.997524 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996078 2569 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 02 21:52:34.997524 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996081 2569 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 02 21:52:34.997524 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996084 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 02 21:52:34.997524 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996086 2569 feature_gate.go:386] unrecognized feature gate: Example Nov 02 21:52:34.997524 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996089 2569 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 02 21:52:34.997524 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996091 2569 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 02 21:52:34.997524 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996094 2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 02 21:52:34.997524 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996096 2569 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 02 21:52:34.997524 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996099 2569 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 02 21:52:34.997524 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996101 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 02 21:52:34.997524 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996104 2569 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 02 21:52:34.997524 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996106 2569 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 02 21:52:34.997524 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996109 2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 02 21:52:34.997524 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996111 2569 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 02 21:52:34.997524 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996114 2569 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 02 21:52:34.997524 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996116 2569 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 02 21:52:34.997524 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996119 2569 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 02 21:52:34.997524 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996122 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 02 21:52:34.997996 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996124 2569 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 02 21:52:34.997996 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996126 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 02 21:52:34.997996 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996129 2569 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 02 21:52:34.997996 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996133 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 02 21:52:34.997996 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996136 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 02 21:52:34.997996 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996138 2569 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 02 21:52:34.997996 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996141 2569 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 02 21:52:34.997996 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996143 2569 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 02 21:52:34.997996 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996146 2569 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 02 21:52:34.997996 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996148 2569 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 02 21:52:34.997996 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996151 2569 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 02 21:52:34.997996 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996153 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 02 21:52:34.997996 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996156 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 02 21:52:34.997996 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996159 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 02 21:52:34.997996 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996161 2569 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 02 21:52:34.997996 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996164 2569 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 02 21:52:34.997996 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996167 2569 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 02 21:52:34.997996 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996170 2569 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 02 21:52:34.997996 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996172 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 02 21:52:34.998420 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996174 2569 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 02 21:52:34.998420 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996177 2569 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 02 21:52:34.998420 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996970 2569 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 02 21:52:34.998420 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996977 2569 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 02 21:52:34.998420 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996981 2569 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 02 21:52:34.998420 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996984 2569 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 02 21:52:34.998420 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996986 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 02 21:52:34.998420 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996990 2569 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 02 21:52:34.998420 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996994 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 02 21:52:34.998420 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996996 2569 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 02 21:52:34.998420 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.996998 2569 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 02 21:52:34.998420 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997002 2569 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 02 21:52:34.998420 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997005 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 02 21:52:34.998420 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997007 2569 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 02 21:52:34.998420 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997010 2569 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 02 21:52:34.998420 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997012 2569 feature_gate.go:386] unrecognized feature gate: Example Nov 02 21:52:34.998420 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997015 2569 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 02 21:52:34.998420 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997017 2569 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 02 21:52:34.998420 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997020 2569 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 02 21:52:34.998420 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997023 2569 feature_gate.go:386] unrecognized feature gate: Example2 Nov 02 21:52:34.998902 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997025 2569 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 02 21:52:34.998902 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997028 2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 02 21:52:34.998902 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997030 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 02 21:52:34.998902 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997032 2569 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 02 21:52:34.998902 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997035 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 02 21:52:34.998902 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997037 2569 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 02 21:52:34.998902 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997040 2569 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 02 21:52:34.998902 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997043 2569 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 02 21:52:34.998902 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997045 2569 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 02 21:52:34.998902 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997048 2569 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 02 21:52:34.998902 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997050 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 02 21:52:34.998902 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997052 2569 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 02 21:52:34.998902 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997055 2569 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 02 21:52:34.998902 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997057 2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 02 21:52:34.998902 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997060 2569 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 02 21:52:34.998902 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997062 2569 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 02 21:52:34.998902 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997064 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 02 21:52:34.998902 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997067 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 02 21:52:34.998902 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997069 2569 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 02 21:52:34.999385 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997072 2569 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 02 21:52:34.999385 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997075 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 02 21:52:34.999385 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997077 2569 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 02 21:52:34.999385 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997080 2569 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 02 21:52:34.999385 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997083 2569 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 02 21:52:34.999385 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997085 2569 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 02 21:52:34.999385 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997089 2569 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 02 21:52:34.999385 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997092 2569 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 02 21:52:34.999385 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997094 2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 02 21:52:34.999385 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997097 2569 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 02 21:52:34.999385 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997099 2569 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 02 21:52:34.999385 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997102 2569 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 02 21:52:34.999385 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997104 2569 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 02 21:52:34.999385 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997106 2569 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 02 21:52:34.999385 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997109 2569 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 02 21:52:34.999385 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997111 2569 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 02 21:52:34.999385 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997113 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 02 21:52:34.999385 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997116 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 02 21:52:34.999385 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997119 2569 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 02 21:52:34.999893 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997121 2569 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 02 21:52:34.999893 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997123 2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 02 21:52:34.999893 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997126 2569 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 02 21:52:34.999893 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997128 2569 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 02 21:52:34.999893 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997131 2569 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 02 21:52:34.999893 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997133 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 02 21:52:34.999893 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997135 2569 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 02 21:52:34.999893 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997138 2569 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 02 21:52:34.999893 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997140 2569 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 02 21:52:34.999893 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997142 2569 feature_gate.go:386] unrecognized feature gate: EVPN Nov 02 21:52:34.999893 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997145 2569 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 02 21:52:34.999893 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997147 2569 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 02 21:52:34.999893 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997149 2569 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 02 21:52:34.999893 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997153 2569 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 02 21:52:34.999893 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997157 2569 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 02 21:52:34.999893 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997159 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 02 21:52:34.999893 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997162 2569 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 02 21:52:34.999893 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997165 2569 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 02 21:52:34.999893 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997170 2569 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 02 21:52:35.000354 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997174 2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 02 21:52:35.000354 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997186 2569 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 02 21:52:35.000354 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997189 2569 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 02 21:52:35.000354 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997192 2569 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 02 21:52:35.000354 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997194 2569 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 02 21:52:35.000354 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997197 2569 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 02 21:52:35.000354 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997199 2569 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 02 21:52:35.000354 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997202 2569 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 02 21:52:35.000354 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997204 2569 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 02 21:52:35.000354 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997207 2569 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 02 21:52:35.000354 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997209 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 02 21:52:35.000354 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997212 2569 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 02 21:52:35.000354 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997214 2569 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 02 21:52:35.000354 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997216 2569 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 02 21:52:35.000354 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997219 2569 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 02 21:52:35.000354 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997221 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 02 21:52:35.000354 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997223 2569 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 02 21:52:35.000354 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997226 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 02 21:52:35.000354 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997228 2569 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 02 21:52:35.000354 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997230 2569 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 02 21:52:35.000832 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997233 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 02 21:52:35.000832 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997236 2569 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 02 21:52:35.000832 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997239 2569 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 02 21:52:35.000832 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997242 2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 02 21:52:35.000832 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997244 2569 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 02 21:52:35.000832 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997246 2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 02 21:52:35.000832 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997249 2569 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 02 21:52:35.000832 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997251 2569 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 02 21:52:35.000832 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997254 2569 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 02 21:52:35.000832 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997256 2569 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 02 21:52:35.000832 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997259 2569 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 02 21:52:35.000832 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997761 2569 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 02 21:52:35.000832 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997768 2569 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 02 21:52:35.000832 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997772 2569 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 02 21:52:35.000832 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997775 2569 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 02 21:52:35.000832 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997778 2569 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 02 21:52:35.000832 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997780 2569 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 02 21:52:35.000832 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997784 2569 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 02 21:52:35.001246 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997788 2569 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 02 21:52:35.001246 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997791 2569 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 02 21:52:35.001246 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997793 2569 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 02 21:52:35.001246 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997796 2569 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 02 21:52:35.001246 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997799 2569 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 02 21:52:35.001246 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997801 2569 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 02 21:52:35.001246 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997804 2569 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 02 21:52:35.001246 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997806 2569 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 02 21:52:35.001246 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997808 2569 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 02 21:52:35.001246 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997811 2569 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 02 21:52:35.001246 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997813 2569 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 02 21:52:35.001246 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997815 2569 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 02 21:52:35.001246 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997818 2569 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 02 21:52:35.001246 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997820 2569 feature_gate.go:386] unrecognized feature gate: Example Nov 02 21:52:35.001246 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997823 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 02 21:52:35.001246 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997825 2569 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 02 21:52:35.001246 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997828 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 02 21:52:35.001246 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997830 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 02 21:52:35.001246 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997833 2569 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 02 21:52:35.001246 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997835 2569 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 02 21:52:35.001769 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997838 2569 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 02 21:52:35.001769 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997841 2569 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 02 21:52:35.001769 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997844 2569 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 02 21:52:35.001769 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997846 2569 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 02 21:52:35.001769 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997848 2569 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 02 21:52:35.001769 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997851 2569 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 02 21:52:35.001769 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997853 2569 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 02 21:52:35.001769 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997855 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 02 21:52:35.001769 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997858 2569 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 02 21:52:35.001769 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997861 2569 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 02 21:52:35.001769 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997863 2569 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 02 21:52:35.001769 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997866 2569 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 02 21:52:35.001769 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997868 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 02 21:52:35.001769 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997871 2569 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 02 21:52:35.001769 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997873 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 02 21:52:35.001769 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997875 2569 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 02 21:52:35.001769 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997878 2569 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 02 21:52:35.001769 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997880 2569 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 02 21:52:35.001769 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997882 2569 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 02 21:52:35.001769 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997885 2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 02 21:52:35.002251 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997887 2569 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 02 21:52:35.002251 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997889 2569 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 02 21:52:35.002251 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997892 2569 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 02 21:52:35.002251 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997894 2569 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 02 21:52:35.002251 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997897 2569 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 02 21:52:35.002251 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997899 2569 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 02 21:52:35.002251 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997901 2569 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 02 21:52:35.002251 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997904 2569 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 02 21:52:35.002251 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997906 2569 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 02 21:52:35.002251 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997909 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 02 21:52:35.002251 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997911 2569 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 02 21:52:35.002251 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997913 2569 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 02 21:52:35.002251 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997916 2569 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 02 21:52:35.002251 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997919 2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 02 21:52:35.002251 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997923 2569 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 02 21:52:35.002251 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997926 2569 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 02 21:52:35.002251 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997929 2569 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 02 21:52:35.002251 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997932 2569 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 02 21:52:35.002251 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997935 2569 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 02 21:52:35.002709 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997938 2569 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 02 21:52:35.002709 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997940 2569 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 02 21:52:35.002709 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997943 2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 02 21:52:35.002709 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997945 2569 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 02 21:52:35.002709 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997948 2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 02 21:52:35.002709 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997950 2569 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 02 21:52:35.002709 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997952 2569 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 02 21:52:35.002709 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997955 2569 feature_gate.go:386] unrecognized feature gate: EVPN Nov 02 21:52:35.002709 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997957 2569 feature_gate.go:386] unrecognized feature gate: Example2 Nov 02 21:52:35.002709 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997959 2569 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 02 21:52:35.002709 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997962 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 02 21:52:35.002709 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997964 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 02 21:52:35.002709 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997966 2569 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 02 21:52:35.002709 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997968 2569 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 02 21:52:35.002709 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997971 2569 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 02 21:52:35.002709 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997973 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 02 21:52:35.002709 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997975 2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 02 21:52:35.002709 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997978 2569 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 02 21:52:35.002709 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997980 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 02 21:52:35.003148 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997982 2569 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 02 21:52:35.003148 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997985 2569 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 02 21:52:35.003148 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997988 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 02 21:52:35.003148 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997990 2569 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 02 21:52:35.003148 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997993 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 02 21:52:35.003148 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997995 2569 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 02 21:52:35.003148 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.997998 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 02 21:52:35.003148 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.998000 2569 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 02 21:52:35.003148 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.998003 2569 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 02 21:52:35.003148 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.998005 2569 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 02 21:52:35.003148 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.998008 2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 02 21:52:35.003148 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.998010 2569 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 02 21:52:35.003148 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.998013 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 02 21:52:35.003148 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.998015 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 02 21:52:35.003148 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.998017 2569 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 02 21:52:35.003148 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.998020 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 02 21:52:35.003148 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.998023 2569 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 02 21:52:35.003148 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.998026 2569 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 02 21:52:35.003148 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.998028 2569 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 02 21:52:35.003148 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.998031 2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 02 21:52:35.003630 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.998033 2569 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 02 21:52:35.003630 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999114 2569 flags.go:64] FLAG: --address="0.0.0.0" Nov 02 21:52:35.003630 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999123 2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Nov 02 21:52:35.003630 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999129 2569 flags.go:64] FLAG: --anonymous-auth="true" Nov 02 21:52:35.003630 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999133 2569 flags.go:64] FLAG: --application-metrics-count-limit="100" Nov 02 21:52:35.003630 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999137 2569 flags.go:64] FLAG: --authentication-token-webhook="false" Nov 02 21:52:35.003630 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999140 2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Nov 02 21:52:35.003630 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999144 2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Nov 02 21:52:35.003630 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999148 2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Nov 02 21:52:35.003630 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999151 2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Nov 02 21:52:35.003630 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999154 2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Nov 02 21:52:35.003630 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999157 2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Nov 02 21:52:35.003630 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999160 2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Nov 02 21:52:35.003630 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999173 2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Nov 02 21:52:35.003630 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999179 2569 flags.go:64] FLAG: --cgroup-root="" Nov 02 21:52:35.003630 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999182 2569 flags.go:64] FLAG: --cgroups-per-qos="true" Nov 02 21:52:35.003630 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999185 2569 flags.go:64] FLAG: --client-ca-file="" Nov 02 21:52:35.003630 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999188 2569 flags.go:64] FLAG: --cloud-provider="external" Nov 02 21:52:35.003630 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999191 2569 flags.go:64] FLAG: --cluster-dns="[]" Nov 02 21:52:35.003630 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999196 2569 flags.go:64] FLAG: --cluster-domain="" Nov 02 21:52:35.003630 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999199 2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Nov 02 21:52:35.003630 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999202 2569 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Nov 02 21:52:35.003630 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999204 2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Nov 02 21:52:35.003630 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999227 2569 flags.go:64] FLAG: --container-log-max-files="5" Nov 02 21:52:35.004208 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999231 2569 flags.go:64] FLAG: --container-log-max-size="10Mi" Nov 02 21:52:35.004208 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999234 2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Nov 02 21:52:35.004208 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999237 2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Nov 02 21:52:35.004208 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999240 2569 flags.go:64] FLAG: --containerd-namespace="k8s.io" Nov 02 21:52:35.004208 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999243 2569 flags.go:64] FLAG: --contention-profiling="false" Nov 02 21:52:35.004208 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999246 2569 flags.go:64] FLAG: --cpu-cfs-quota="true" Nov 02 21:52:35.004208 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999249 2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Nov 02 21:52:35.004208 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999252 2569 flags.go:64] FLAG: --cpu-manager-policy="none" Nov 02 21:52:35.004208 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999255 2569 flags.go:64] FLAG: --cpu-manager-policy-options="" Nov 02 21:52:35.004208 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999259 2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Nov 02 21:52:35.004208 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999262 2569 flags.go:64] FLAG: --enable-controller-attach-detach="true" Nov 02 21:52:35.004208 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999265 2569 flags.go:64] FLAG: --enable-debugging-handlers="true" Nov 02 21:52:35.004208 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999268 2569 flags.go:64] FLAG: --enable-load-reader="false" Nov 02 21:52:35.004208 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999271 2569 flags.go:64] FLAG: --enable-server="true" Nov 02 21:52:35.004208 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999274 2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Nov 02 21:52:35.004208 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999277 2569 flags.go:64] FLAG: --event-burst="100" Nov 02 21:52:35.004208 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999280 2569 flags.go:64] FLAG: --event-qps="50" Nov 02 21:52:35.004208 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999283 2569 flags.go:64] FLAG: --event-storage-age-limit="default=0" Nov 02 21:52:35.004208 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999286 2569 flags.go:64] FLAG: --event-storage-event-limit="default=0" Nov 02 21:52:35.004208 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999289 2569 flags.go:64] FLAG: --eviction-hard="" Nov 02 21:52:35.004208 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999293 2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Nov 02 21:52:35.004208 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999296 2569 flags.go:64] FLAG: --eviction-minimum-reclaim="" Nov 02 21:52:35.004208 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999301 2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Nov 02 21:52:35.004208 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999304 2569 flags.go:64] FLAG: --eviction-soft="" Nov 02 21:52:35.004208 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999307 2569 flags.go:64] FLAG: --eviction-soft-grace-period="" Nov 02 21:52:35.004880 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999310 2569 flags.go:64] FLAG: --exit-on-lock-contention="false" Nov 02 21:52:35.004880 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999314 2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Nov 02 21:52:35.004880 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999317 2569 flags.go:64] FLAG: --experimental-mounter-path="" Nov 02 21:52:35.004880 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999320 2569 flags.go:64] FLAG: --fail-cgroupv1="true" Nov 02 21:52:35.004880 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999322 2569 flags.go:64] FLAG: --fail-swap-on="true" Nov 02 21:52:35.004880 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999325 2569 flags.go:64] FLAG: --feature-gates="" Nov 02 21:52:35.004880 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999329 2569 flags.go:64] FLAG: --file-check-frequency="20s" Nov 02 21:52:35.004880 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999332 2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Nov 02 21:52:35.004880 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999335 2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Nov 02 21:52:35.004880 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999337 2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Nov 02 21:52:35.004880 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999340 2569 flags.go:64] FLAG: --healthz-port="10248" Nov 02 21:52:35.004880 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999343 2569 flags.go:64] FLAG: --help="false" Nov 02 21:52:35.004880 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999346 2569 flags.go:64] FLAG: --hostname-override="ip-10-0-139-99.us-east-2.compute.internal" Nov 02 21:52:35.004880 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999349 2569 flags.go:64] FLAG: --housekeeping-interval="10s" Nov 02 21:52:35.004880 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999352 2569 flags.go:64] FLAG: --http-check-frequency="20s" Nov 02 21:52:35.004880 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999356 2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Nov 02 21:52:35.004880 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999359 2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Nov 02 21:52:35.004880 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999363 2569 flags.go:64] FLAG: --image-gc-high-threshold="85" Nov 02 21:52:35.004880 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999365 2569 flags.go:64] FLAG: --image-gc-low-threshold="80" Nov 02 21:52:35.004880 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999368 2569 flags.go:64] FLAG: --image-service-endpoint="" Nov 02 21:52:35.004880 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999371 2569 flags.go:64] FLAG: --kernel-memcg-notification="false" Nov 02 21:52:35.004880 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999373 2569 flags.go:64] FLAG: --kube-api-burst="100" Nov 02 21:52:35.004880 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999376 2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Nov 02 21:52:35.005528 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999379 2569 flags.go:64] FLAG: --kube-api-qps="50" Nov 02 21:52:35.005528 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999382 2569 flags.go:64] FLAG: --kube-reserved="" Nov 02 21:52:35.005528 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999385 2569 flags.go:64] FLAG: --kube-reserved-cgroup="" Nov 02 21:52:35.005528 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999388 2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Nov 02 21:52:35.005528 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999391 2569 flags.go:64] FLAG: --kubelet-cgroups="" Nov 02 21:52:35.005528 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999394 2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Nov 02 21:52:35.005528 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999398 2569 flags.go:64] FLAG: --lock-file="" Nov 02 21:52:35.005528 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999401 2569 flags.go:64] FLAG: --log-cadvisor-usage="false" Nov 02 21:52:35.005528 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999403 2569 flags.go:64] FLAG: --log-flush-frequency="5s" Nov 02 21:52:35.005528 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999406 2569 flags.go:64] FLAG: --log-json-info-buffer-size="0" Nov 02 21:52:35.005528 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999413 2569 flags.go:64] FLAG: --log-json-split-stream="false" Nov 02 21:52:35.005528 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999416 2569 flags.go:64] FLAG: --log-text-info-buffer-size="0" Nov 02 21:52:35.005528 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999418 2569 flags.go:64] FLAG: --log-text-split-stream="false" Nov 02 21:52:35.005528 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999421 2569 flags.go:64] FLAG: --logging-format="text" Nov 02 21:52:35.005528 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999425 2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Nov 02 21:52:35.005528 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999428 2569 flags.go:64] FLAG: --make-iptables-util-chains="true" Nov 02 21:52:35.005528 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999430 2569 flags.go:64] FLAG: --manifest-url="" Nov 02 21:52:35.005528 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999433 2569 flags.go:64] FLAG: --manifest-url-header="" Nov 02 21:52:35.005528 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999437 2569 flags.go:64] FLAG: --max-housekeeping-interval="15s" Nov 02 21:52:35.005528 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999441 2569 flags.go:64] FLAG: --max-open-files="1000000" Nov 02 21:52:35.005528 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999444 2569 flags.go:64] FLAG: --max-pods="110" Nov 02 21:52:35.005528 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999447 2569 flags.go:64] FLAG: --maximum-dead-containers="-1" Nov 02 21:52:35.005528 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999450 2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Nov 02 21:52:35.005528 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999453 2569 flags.go:64] FLAG: --memory-manager-policy="None" Nov 02 21:52:35.005528 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999456 2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Nov 02 21:52:35.006127 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999459 2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Nov 02 21:52:35.006127 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999461 2569 flags.go:64] FLAG: --node-ip="0.0.0.0" Nov 02 21:52:35.006127 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999464 2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Nov 02 21:52:35.006127 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999471 2569 flags.go:64] FLAG: --node-status-max-images="50" Nov 02 21:52:35.006127 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999474 2569 flags.go:64] FLAG: --node-status-update-frequency="10s" Nov 02 21:52:35.006127 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999477 2569 flags.go:64] FLAG: --oom-score-adj="-999" Nov 02 21:52:35.006127 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999480 2569 flags.go:64] FLAG: --pod-cidr="" Nov 02 21:52:35.006127 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999482 2569 flags.go:64] FLAG: --pod-manifest-path="" Nov 02 21:52:35.006127 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999486 2569 flags.go:64] FLAG: --pod-max-pids="-1" Nov 02 21:52:35.006127 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999489 2569 flags.go:64] FLAG: --pods-per-core="0" Nov 02 21:52:35.006127 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999491 2569 flags.go:64] FLAG: --port="10250" Nov 02 21:52:35.006127 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999494 2569 flags.go:64] FLAG: --protect-kernel-defaults="false" Nov 02 21:52:35.006127 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999497 2569 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-09688befc106c82d8" Nov 02 21:52:35.006127 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999500 2569 flags.go:64] FLAG: --qos-reserved="" Nov 02 21:52:35.006127 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999503 2569 flags.go:64] FLAG: --read-only-port="10255" Nov 02 21:52:35.006127 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999505 2569 flags.go:64] FLAG: --register-node="true" Nov 02 21:52:35.006127 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999508 2569 flags.go:64] FLAG: --register-with-taints="" Nov 02 21:52:35.006127 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999513 2569 flags.go:64] FLAG: --registry-burst="10" Nov 02 21:52:35.006127 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999516 2569 flags.go:64] FLAG: --registry-qps="5" Nov 02 21:52:35.006127 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999519 2569 flags.go:64] FLAG: --reserved-cpus="" Nov 02 21:52:35.006127 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999522 2569 flags.go:64] FLAG: --reserved-memory="" Nov 02 21:52:35.006127 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999525 2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Nov 02 21:52:35.006127 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999528 2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Nov 02 21:52:35.006127 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999531 2569 flags.go:64] FLAG: --rotate-certificates="false" Nov 02 21:52:35.006127 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999534 2569 flags.go:64] FLAG: --rotate-server-certificates="false" Nov 02 21:52:35.006127 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999536 2569 flags.go:64] FLAG: --runonce="false" Nov 02 21:52:35.006747 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999539 2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Nov 02 21:52:35.006747 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999542 2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Nov 02 21:52:35.006747 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999545 2569 flags.go:64] FLAG: --seccomp-default="false" Nov 02 21:52:35.006747 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999548 2569 flags.go:64] FLAG: --serialize-image-pulls="true" Nov 02 21:52:35.006747 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999550 2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Nov 02 21:52:35.006747 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999554 2569 flags.go:64] FLAG: --storage-driver-db="cadvisor" Nov 02 21:52:35.006747 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999557 2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Nov 02 21:52:35.006747 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999559 2569 flags.go:64] FLAG: --storage-driver-password="root" Nov 02 21:52:35.006747 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999562 2569 flags.go:64] FLAG: --storage-driver-secure="false" Nov 02 21:52:35.006747 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999565 2569 flags.go:64] FLAG: --storage-driver-table="stats" Nov 02 21:52:35.006747 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999568 2569 flags.go:64] FLAG: --storage-driver-user="root" Nov 02 21:52:35.006747 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999570 2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Nov 02 21:52:35.006747 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999573 2569 flags.go:64] FLAG: --sync-frequency="1m0s" Nov 02 21:52:35.006747 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999576 2569 flags.go:64] FLAG: --system-cgroups="" Nov 02 21:52:35.006747 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999578 2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Nov 02 21:52:35.006747 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999583 2569 flags.go:64] FLAG: --system-reserved-cgroup="" Nov 02 21:52:35.006747 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999586 2569 flags.go:64] FLAG: --tls-cert-file="" Nov 02 21:52:35.006747 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999589 2569 flags.go:64] FLAG: --tls-cipher-suites="[]" Nov 02 21:52:35.006747 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999593 2569 flags.go:64] FLAG: --tls-min-version="" Nov 02 21:52:35.006747 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999596 2569 flags.go:64] FLAG: --tls-private-key-file="" Nov 02 21:52:35.006747 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999598 2569 flags.go:64] FLAG: --topology-manager-policy="none" Nov 02 21:52:35.006747 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999601 2569 flags.go:64] FLAG: --topology-manager-policy-options="" Nov 02 21:52:35.006747 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999604 2569 flags.go:64] FLAG: --topology-manager-scope="container" Nov 02 21:52:35.006747 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999608 2569 flags.go:64] FLAG: --v="2" Nov 02 21:52:35.006747 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999612 2569 flags.go:64] FLAG: --version="false" Nov 02 21:52:35.007348 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999616 2569 flags.go:64] FLAG: --vmodule="" Nov 02 21:52:35.007348 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999619 2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Nov 02 21:52:35.007348 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:34.999622 2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Nov 02 21:52:35.007348 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999767 2569 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 02 21:52:35.007348 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999771 2569 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 02 21:52:35.007348 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999774 2569 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 02 21:52:35.007348 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999789 2569 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 02 21:52:35.007348 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999792 2569 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 02 21:52:35.007348 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999795 2569 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 02 21:52:35.007348 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999798 2569 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 02 21:52:35.007348 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999800 2569 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 02 21:52:35.007348 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999803 2569 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 02 21:52:35.007348 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999806 2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 02 21:52:35.007348 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999809 2569 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 02 21:52:35.007348 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999812 2569 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 02 21:52:35.007348 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999814 2569 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 02 21:52:35.007348 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999817 2569 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 02 21:52:35.007348 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999819 2569 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 02 21:52:35.007348 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999821 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 02 21:52:35.007348 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999824 2569 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 02 21:52:35.007833 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999827 2569 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 02 21:52:35.007833 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999829 2569 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 02 21:52:35.007833 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999832 2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 02 21:52:35.007833 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999834 2569 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 02 21:52:35.007833 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999837 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 02 21:52:35.007833 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999839 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 02 21:52:35.007833 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999842 2569 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 02 21:52:35.007833 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999844 2569 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 02 21:52:35.007833 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999846 2569 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 02 21:52:35.007833 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999849 2569 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 02 21:52:35.007833 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999853 2569 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 02 21:52:35.007833 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999856 2569 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 02 21:52:35.007833 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999858 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 02 21:52:35.007833 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999860 2569 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 02 21:52:35.007833 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999863 2569 feature_gate.go:386] unrecognized feature gate: Example Nov 02 21:52:35.007833 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999867 2569 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 02 21:52:35.007833 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999870 2569 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 02 21:52:35.007833 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999874 2569 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 02 21:52:35.007833 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999877 2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 02 21:52:35.007833 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999879 2569 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 02 21:52:35.008312 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999882 2569 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 02 21:52:35.008312 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999885 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 02 21:52:35.008312 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999887 2569 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 02 21:52:35.008312 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999890 2569 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 02 21:52:35.008312 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999892 2569 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 02 21:52:35.008312 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999895 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 02 21:52:35.008312 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999898 2569 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 02 21:52:35.008312 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999901 2569 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 02 21:52:35.008312 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999903 2569 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 02 21:52:35.008312 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999906 2569 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 02 21:52:35.008312 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999910 2569 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 02 21:52:35.008312 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999913 2569 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 02 21:52:35.008312 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999916 2569 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 02 21:52:35.008312 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999919 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 02 21:52:35.008312 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999922 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 02 21:52:35.008312 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999924 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 02 21:52:35.008312 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999927 2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 02 21:52:35.008312 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999930 2569 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 02 21:52:35.008312 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999932 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 02 21:52:35.008842 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999934 2569 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 02 21:52:35.008842 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999937 2569 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 02 21:52:35.008842 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999940 2569 feature_gate.go:386] unrecognized feature gate: EVPN Nov 02 21:52:35.008842 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999943 2569 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 02 21:52:35.008842 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999945 2569 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 02 21:52:35.008842 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999948 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 02 21:52:35.008842 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999950 2569 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 02 21:52:35.008842 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999953 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 02 21:52:35.008842 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999955 2569 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 02 21:52:35.008842 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999957 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 02 21:52:35.008842 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999961 2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 02 21:52:35.008842 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999964 2569 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 02 21:52:35.008842 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999966 2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 02 21:52:35.008842 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999969 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 02 21:52:35.008842 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999971 2569 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 02 21:52:35.008842 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999974 2569 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 02 21:52:35.008842 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999977 2569 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 02 21:52:35.008842 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999979 2569 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 02 21:52:35.008842 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999982 2569 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 02 21:52:35.008842 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999984 2569 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 02 21:52:35.009304 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999987 2569 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 02 21:52:35.009304 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999990 2569 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 02 21:52:35.009304 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999993 2569 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 02 21:52:35.009304 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999995 2569 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 02 21:52:35.009304 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:34.999998 2569 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 02 21:52:35.009304 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000000 2569 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 02 21:52:35.009304 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000003 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 02 21:52:35.009304 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000005 2569 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 02 21:52:35.009304 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000007 2569 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 02 21:52:35.009304 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000010 2569 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 02 21:52:35.009304 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000012 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 02 21:52:35.009304 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000015 2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 02 21:52:35.009304 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000017 2569 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 02 21:52:35.009304 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000019 2569 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 02 21:52:35.009304 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000022 2569 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 02 21:52:35.009304 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000024 2569 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 02 21:52:35.009304 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000027 2569 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 02 21:52:35.009304 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000029 2569 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 02 21:52:35.009304 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000032 2569 feature_gate.go:386] unrecognized feature gate: Example2 Nov 02 21:52:35.009304 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000034 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 02 21:52:35.009876 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000036 2569 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 02 21:52:35.009876 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000039 2569 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 02 21:52:35.009876 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000043 2569 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 02 21:52:35.009876 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000045 2569 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 02 21:52:35.009876 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000048 2569 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 02 21:52:35.009876 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000050 2569 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 02 21:52:35.009876 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000053 2569 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 02 21:52:35.009876 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000056 2569 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 02 21:52:35.009876 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000058 2569 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 02 21:52:35.009876 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000060 2569 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 02 21:52:35.009876 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.000087 2569 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 02 21:52:35.009876 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000125 2569 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 02 21:52:35.009876 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000129 2569 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 02 21:52:35.009876 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000133 2569 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 02 21:52:35.009876 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000136 2569 feature_gate.go:386] unrecognized feature gate: Example2 Nov 02 21:52:35.009876 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000138 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 02 21:52:35.010234 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000141 2569 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 02 21:52:35.010234 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000143 2569 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 02 21:52:35.010234 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000146 2569 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 02 21:52:35.010234 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000148 2569 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 02 21:52:35.010234 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000151 2569 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 02 21:52:35.010234 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000153 2569 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 02 21:52:35.010234 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000156 2569 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 02 21:52:35.010234 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000158 2569 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 02 21:52:35.010234 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000161 2569 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 02 21:52:35.010234 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000163 2569 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 02 21:52:35.010234 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000166 2569 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 02 21:52:35.010234 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000169 2569 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 02 21:52:35.010234 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000171 2569 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 02 21:52:35.010234 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000174 2569 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 02 21:52:35.010234 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000176 2569 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 02 21:52:35.010234 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000179 2569 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 02 21:52:35.010234 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000182 2569 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 02 21:52:35.010234 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000184 2569 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 02 21:52:35.010234 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000187 2569 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 02 21:52:35.010234 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000191 2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 02 21:52:35.010704 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000193 2569 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 02 21:52:35.010704 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000196 2569 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 02 21:52:35.010704 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000198 2569 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 02 21:52:35.010704 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000201 2569 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 02 21:52:35.010704 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000203 2569 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 02 21:52:35.010704 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000206 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 02 21:52:35.010704 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000208 2569 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 02 21:52:35.010704 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000211 2569 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 02 21:52:35.010704 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000213 2569 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 02 21:52:35.010704 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000216 2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 02 21:52:35.010704 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000218 2569 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 02 21:52:35.010704 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000221 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 02 21:52:35.010704 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000224 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 02 21:52:35.010704 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000226 2569 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 02 21:52:35.010704 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000228 2569 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 02 21:52:35.010704 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000231 2569 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 02 21:52:35.010704 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000234 2569 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 02 21:52:35.010704 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000236 2569 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 02 21:52:35.010704 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000239 2569 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 02 21:52:35.011169 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000241 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 02 21:52:35.011169 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000243 2569 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 02 21:52:35.011169 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000247 2569 feature_gate.go:386] unrecognized feature gate: Example Nov 02 21:52:35.011169 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000250 2569 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 02 21:52:35.011169 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000254 2569 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 02 21:52:35.011169 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000257 2569 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 02 21:52:35.011169 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000259 2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 02 21:52:35.011169 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000262 2569 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 02 21:52:35.011169 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000264 2569 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 02 21:52:35.011169 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000267 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 02 21:52:35.011169 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000269 2569 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 02 21:52:35.011169 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000272 2569 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 02 21:52:35.011169 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000275 2569 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 02 21:52:35.011169 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000278 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 02 21:52:35.011169 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000280 2569 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 02 21:52:35.011169 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000283 2569 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 02 21:52:35.011169 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000285 2569 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 02 21:52:35.011169 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000288 2569 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 02 21:52:35.011169 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000292 2569 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 02 21:52:35.011642 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000295 2569 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 02 21:52:35.011642 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000298 2569 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 02 21:52:35.011642 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000301 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 02 21:52:35.011642 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000304 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 02 21:52:35.011642 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000307 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 02 21:52:35.011642 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000310 2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 02 21:52:35.011642 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000312 2569 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 02 21:52:35.011642 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000315 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 02 21:52:35.011642 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000317 2569 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 02 21:52:35.011642 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000321 2569 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 02 21:52:35.011642 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000324 2569 feature_gate.go:386] unrecognized feature gate: EVPN Nov 02 21:52:35.011642 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000327 2569 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 02 21:52:35.011642 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000329 2569 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 02 21:52:35.011642 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000332 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 02 21:52:35.011642 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000335 2569 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 02 21:52:35.011642 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000350 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 02 21:52:35.011642 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000353 2569 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 02 21:52:35.011642 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000355 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 02 21:52:35.011642 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000358 2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 02 21:52:35.012113 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000360 2569 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 02 21:52:35.012113 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000363 2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 02 21:52:35.012113 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000365 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 02 21:52:35.012113 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000368 2569 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 02 21:52:35.012113 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000370 2569 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 02 21:52:35.012113 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000372 2569 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 02 21:52:35.012113 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000376 2569 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 02 21:52:35.012113 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000378 2569 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 02 21:52:35.012113 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000380 2569 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 02 21:52:35.012113 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000383 2569 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 02 21:52:35.012113 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000385 2569 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 02 21:52:35.012113 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000388 2569 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 02 21:52:35.012113 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000390 2569 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 02 21:52:35.012113 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000392 2569 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 02 21:52:35.012113 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000394 2569 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 02 21:52:35.012113 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000397 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 02 21:52:35.012113 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000399 2569 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 02 21:52:35.012113 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000401 2569 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 02 21:52:35.012113 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000404 2569 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 02 21:52:35.012113 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000412 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 02 21:52:35.012593 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000415 2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 02 21:52:35.012593 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000417 2569 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 02 21:52:35.012593 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000421 2569 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 02 21:52:35.012593 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.000423 2569 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 02 21:52:35.012593 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.007773 2569 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Nov 02 21:52:35.012593 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.007788 2569 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Nov 02 21:52:35.012593 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.008473 2569 watchdog_linux.go:95] "Systemd watchdog is not enabled" Nov 02 21:52:35.012593 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.008479 2569 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Nov 02 21:52:35.012593 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008537 2569 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 02 21:52:35.012593 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008543 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 02 21:52:35.012593 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008546 2569 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 02 21:52:35.012593 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008549 2569 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 02 21:52:35.012593 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008552 2569 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 02 21:52:35.012593 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008555 2569 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 02 21:52:35.012593 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008557 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 02 21:52:35.012593 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008577 2569 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 02 21:52:35.012593 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008580 2569 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 02 21:52:35.012593 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008583 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 02 21:52:35.012593 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008586 2569 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 02 21:52:35.012593 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008588 2569 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 02 21:52:35.013076 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008591 2569 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 02 21:52:35.013076 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008593 2569 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 02 21:52:35.013076 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008596 2569 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 02 21:52:35.013076 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008598 2569 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 02 21:52:35.013076 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008601 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 02 21:52:35.013076 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008604 2569 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 02 21:52:35.013076 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008606 2569 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 02 21:52:35.013076 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008609 2569 feature_gate.go:386] unrecognized feature gate: Example2 Nov 02 21:52:35.013076 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008612 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 02 21:52:35.013076 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008614 2569 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 02 21:52:35.013076 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008616 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 02 21:52:35.013076 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008619 2569 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 02 21:52:35.013076 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008621 2569 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 02 21:52:35.013076 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008624 2569 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 02 21:52:35.013076 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008626 2569 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 02 21:52:35.013076 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008628 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 02 21:52:35.013076 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008631 2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 02 21:52:35.013076 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008640 2569 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 02 21:52:35.013076 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008644 2569 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 02 21:52:35.013500 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008646 2569 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 02 21:52:35.013500 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008649 2569 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 02 21:52:35.013500 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008651 2569 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 02 21:52:35.013500 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008654 2569 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 02 21:52:35.013500 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008656 2569 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 02 21:52:35.013500 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008676 2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 02 21:52:35.013500 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008680 2569 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 02 21:52:35.013500 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008682 2569 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 02 21:52:35.013500 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008685 2569 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 02 21:52:35.013500 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008687 2569 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 02 21:52:35.013500 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008690 2569 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 02 21:52:35.013500 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008692 2569 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 02 21:52:35.013500 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008695 2569 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 02 21:52:35.013500 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008697 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 02 21:52:35.013500 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008700 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 02 21:52:35.013500 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008702 2569 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 02 21:52:35.013500 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008705 2569 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 02 21:52:35.013500 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008707 2569 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 02 21:52:35.013500 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008710 2569 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 02 21:52:35.013500 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008712 2569 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 02 21:52:35.013996 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008714 2569 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 02 21:52:35.013996 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008717 2569 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 02 21:52:35.013996 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008719 2569 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 02 21:52:35.013996 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008722 2569 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 02 21:52:35.013996 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008724 2569 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 02 21:52:35.013996 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008727 2569 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 02 21:52:35.013996 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008730 2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 02 21:52:35.013996 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008732 2569 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 02 21:52:35.013996 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008734 2569 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 02 21:52:35.013996 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008737 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 02 21:52:35.013996 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008739 2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 02 21:52:35.013996 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008748 2569 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 02 21:52:35.013996 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008750 2569 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 02 21:52:35.013996 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008753 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 02 21:52:35.013996 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008755 2569 feature_gate.go:386] unrecognized feature gate: Example Nov 02 21:52:35.013996 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008758 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 02 21:52:35.013996 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008760 2569 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 02 21:52:35.013996 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008762 2569 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 02 21:52:35.013996 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008765 2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 02 21:52:35.014419 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008767 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 02 21:52:35.014419 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008769 2569 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 02 21:52:35.014419 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008772 2569 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 02 21:52:35.014419 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008774 2569 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 02 21:52:35.014419 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008776 2569 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 02 21:52:35.014419 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008778 2569 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 02 21:52:35.014419 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008781 2569 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 02 21:52:35.014419 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008783 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 02 21:52:35.014419 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008785 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 02 21:52:35.014419 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008787 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 02 21:52:35.014419 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008790 2569 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 02 21:52:35.014419 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008793 2569 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 02 21:52:35.014419 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008795 2569 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 02 21:52:35.014419 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008797 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 02 21:52:35.014419 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008800 2569 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 02 21:52:35.014419 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008802 2569 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 02 21:52:35.014419 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008804 2569 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 02 21:52:35.014419 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008807 2569 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 02 21:52:35.014419 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008809 2569 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 02 21:52:35.014419 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008811 2569 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 02 21:52:35.014935 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008813 2569 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 02 21:52:35.014935 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008816 2569 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 02 21:52:35.014935 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008818 2569 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 02 21:52:35.014935 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008820 2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 02 21:52:35.014935 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008823 2569 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 02 21:52:35.014935 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008831 2569 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 02 21:52:35.014935 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008834 2569 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 02 21:52:35.014935 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008836 2569 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 02 21:52:35.014935 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008839 2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 02 21:52:35.014935 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008841 2569 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 02 21:52:35.014935 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008843 2569 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 02 21:52:35.014935 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008846 2569 feature_gate.go:386] unrecognized feature gate: EVPN Nov 02 21:52:35.014935 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008849 2569 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 02 21:52:35.014935 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008851 2569 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 02 21:52:35.014935 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008853 2569 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 02 21:52:35.014935 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.008858 2569 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 02 21:52:35.015315 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.008886 2569 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 02 21:52:35.015315 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009063 2569 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 02 21:52:35.015315 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009073 2569 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 02 21:52:35.015315 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009076 2569 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 02 21:52:35.015315 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009078 2569 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 02 21:52:35.015315 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009081 2569 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 02 21:52:35.015315 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009083 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 02 21:52:35.015315 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009086 2569 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 02 21:52:35.015315 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009089 2569 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 02 21:52:35.015315 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009091 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 02 21:52:35.015315 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009093 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 02 21:52:35.015315 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009096 2569 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 02 21:52:35.015315 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009098 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 02 21:52:35.015315 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009100 2569 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 02 21:52:35.015315 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009102 2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 02 21:52:35.015315 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009104 2569 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 02 21:52:35.015711 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009107 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 02 21:52:35.015711 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009109 2569 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 02 21:52:35.015711 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009111 2569 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 02 21:52:35.015711 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009114 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 02 21:52:35.015711 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009116 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 02 21:52:35.015711 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009118 2569 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 02 21:52:35.015711 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009127 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 02 21:52:35.015711 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009130 2569 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 02 21:52:35.015711 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009132 2569 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 02 21:52:35.015711 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009134 2569 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 02 21:52:35.015711 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009137 2569 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 02 21:52:35.015711 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009139 2569 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 02 21:52:35.015711 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009143 2569 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 02 21:52:35.015711 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009146 2569 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 02 21:52:35.015711 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009149 2569 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 02 21:52:35.015711 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009151 2569 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 02 21:52:35.015711 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009154 2569 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 02 21:52:35.015711 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009156 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 02 21:52:35.015711 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009159 2569 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 02 21:52:35.016146 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009161 2569 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 02 21:52:35.016146 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009163 2569 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 02 21:52:35.016146 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009166 2569 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 02 21:52:35.016146 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009168 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 02 21:52:35.016146 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009170 2569 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 02 21:52:35.016146 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009173 2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 02 21:52:35.016146 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009175 2569 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 02 21:52:35.016146 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009177 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 02 21:52:35.016146 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009179 2569 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 02 21:52:35.016146 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009182 2569 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 02 21:52:35.016146 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009184 2569 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 02 21:52:35.016146 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009186 2569 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 02 21:52:35.016146 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009189 2569 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 02 21:52:35.016146 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009191 2569 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 02 21:52:35.016146 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009193 2569 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 02 21:52:35.016146 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009195 2569 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 02 21:52:35.016146 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009197 2569 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 02 21:52:35.016146 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009200 2569 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 02 21:52:35.016146 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009202 2569 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 02 21:52:35.016146 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009204 2569 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 02 21:52:35.016615 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009212 2569 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 02 21:52:35.016615 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009215 2569 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 02 21:52:35.016615 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009217 2569 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 02 21:52:35.016615 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009219 2569 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 02 21:52:35.016615 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009221 2569 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 02 21:52:35.016615 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009224 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 02 21:52:35.016615 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009226 2569 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 02 21:52:35.016615 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009230 2569 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 02 21:52:35.016615 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009233 2569 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 02 21:52:35.016615 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009236 2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 02 21:52:35.016615 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009239 2569 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 02 21:52:35.016615 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009241 2569 feature_gate.go:386] unrecognized feature gate: Example Nov 02 21:52:35.016615 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009243 2569 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 02 21:52:35.016615 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009246 2569 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 02 21:52:35.016615 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009248 2569 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 02 21:52:35.016615 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009250 2569 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 02 21:52:35.016615 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009252 2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 02 21:52:35.016615 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009255 2569 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 02 21:52:35.016615 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009257 2569 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 02 21:52:35.016615 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009259 2569 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 02 21:52:35.017097 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009262 2569 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 02 21:52:35.017097 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009265 2569 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 02 21:52:35.017097 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009267 2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 02 21:52:35.017097 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009269 2569 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 02 21:52:35.017097 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009272 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 02 21:52:35.017097 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009274 2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 02 21:52:35.017097 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009276 2569 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 02 21:52:35.017097 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009279 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 02 21:52:35.017097 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009281 2569 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 02 21:52:35.017097 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009283 2569 feature_gate.go:386] unrecognized feature gate: EVPN Nov 02 21:52:35.017097 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009285 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 02 21:52:35.017097 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009288 2569 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 02 21:52:35.017097 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009290 2569 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 02 21:52:35.017097 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009298 2569 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 02 21:52:35.017097 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009300 2569 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 02 21:52:35.017097 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009302 2569 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 02 21:52:35.017097 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009305 2569 feature_gate.go:386] unrecognized feature gate: Example2 Nov 02 21:52:35.017097 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009308 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 02 21:52:35.017097 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009310 2569 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 02 21:52:35.017522 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009312 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 02 21:52:35.017522 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009315 2569 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 02 21:52:35.017522 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009318 2569 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 02 21:52:35.017522 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009320 2569 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 02 21:52:35.017522 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009322 2569 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 02 21:52:35.017522 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009325 2569 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 02 21:52:35.017522 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009327 2569 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 02 21:52:35.017522 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009329 2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 02 21:52:35.017522 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009332 2569 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 02 21:52:35.017522 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009334 2569 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 02 21:52:35.017522 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009337 2569 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 02 21:52:35.017522 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009339 2569 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 02 21:52:35.017522 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009341 2569 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 02 21:52:35.017522 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.009363 2569 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 02 21:52:35.017522 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009404 2569 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 02 21:52:35.017522 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009408 2569 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 02 21:52:35.017944 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009411 2569 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 02 21:52:35.017944 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009413 2569 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 02 21:52:35.017944 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009415 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 02 21:52:35.017944 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009418 2569 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 02 21:52:35.017944 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009421 2569 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 02 21:52:35.017944 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009423 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 02 21:52:35.017944 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009425 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 02 21:52:35.017944 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009427 2569 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 02 21:52:35.017944 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009430 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 02 21:52:35.017944 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009432 2569 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 02 21:52:35.017944 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009434 2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 02 21:52:35.017944 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009442 2569 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 02 21:52:35.017944 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009445 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 02 21:52:35.017944 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009447 2569 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 02 21:52:35.017944 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009449 2569 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 02 21:52:35.017944 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009452 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 02 21:52:35.017944 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009454 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 02 21:52:35.017944 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009456 2569 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 02 21:52:35.017944 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009458 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 02 21:52:35.017944 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009461 2569 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 02 21:52:35.018381 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009463 2569 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 02 21:52:35.018381 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009465 2569 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 02 21:52:35.018381 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009467 2569 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 02 21:52:35.018381 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009470 2569 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 02 21:52:35.018381 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009473 2569 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 02 21:52:35.018381 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009476 2569 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 02 21:52:35.018381 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009480 2569 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 02 21:52:35.018381 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009482 2569 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 02 21:52:35.018381 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009485 2569 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 02 21:52:35.018381 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009488 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 02 21:52:35.018381 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009490 2569 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 02 21:52:35.018381 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009493 2569 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 02 21:52:35.018381 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009495 2569 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 02 21:52:35.018381 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009498 2569 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 02 21:52:35.018381 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009500 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 02 21:52:35.018381 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009502 2569 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 02 21:52:35.018381 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009505 2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 02 21:52:35.018381 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009507 2569 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 02 21:52:35.018381 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009509 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 02 21:52:35.018813 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009511 2569 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 02 21:52:35.018813 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009514 2569 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 02 21:52:35.018813 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009516 2569 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 02 21:52:35.018813 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009518 2569 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 02 21:52:35.018813 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009521 2569 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 02 21:52:35.018813 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009528 2569 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 02 21:52:35.018813 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009531 2569 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 02 21:52:35.018813 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009534 2569 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 02 21:52:35.018813 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009536 2569 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 02 21:52:35.018813 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009538 2569 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 02 21:52:35.018813 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009540 2569 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 02 21:52:35.018813 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009543 2569 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 02 21:52:35.018813 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009546 2569 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 02 21:52:35.018813 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009548 2569 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 02 21:52:35.018813 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009550 2569 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 02 21:52:35.018813 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009553 2569 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 02 21:52:35.018813 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009555 2569 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 02 21:52:35.018813 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009557 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 02 21:52:35.018813 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009560 2569 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 02 21:52:35.018813 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009564 2569 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 02 21:52:35.019283 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009567 2569 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 02 21:52:35.019283 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009570 2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 02 21:52:35.019283 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009573 2569 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 02 21:52:35.019283 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009575 2569 feature_gate.go:386] unrecognized feature gate: Example Nov 02 21:52:35.019283 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009578 2569 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 02 21:52:35.019283 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009580 2569 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 02 21:52:35.019283 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009582 2569 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 02 21:52:35.019283 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009585 2569 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 02 21:52:35.019283 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009587 2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 02 21:52:35.019283 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009590 2569 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 02 21:52:35.019283 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009592 2569 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 02 21:52:35.019283 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009594 2569 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 02 21:52:35.019283 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009597 2569 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 02 21:52:35.019283 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009599 2569 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 02 21:52:35.019283 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009604 2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 02 21:52:35.019283 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009606 2569 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 02 21:52:35.019283 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009609 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 02 21:52:35.019283 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009611 2569 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 02 21:52:35.019283 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009620 2569 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 02 21:52:35.019861 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009623 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 02 21:52:35.019861 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009625 2569 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 02 21:52:35.019861 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009628 2569 feature_gate.go:386] unrecognized feature gate: EVPN Nov 02 21:52:35.019861 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009630 2569 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 02 21:52:35.019861 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009632 2569 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 02 21:52:35.019861 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009635 2569 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 02 21:52:35.019861 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009637 2569 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 02 21:52:35.019861 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009639 2569 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 02 21:52:35.019861 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009642 2569 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 02 21:52:35.019861 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009644 2569 feature_gate.go:386] unrecognized feature gate: Example2 Nov 02 21:52:35.019861 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009647 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 02 21:52:35.019861 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009649 2569 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 02 21:52:35.019861 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009651 2569 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 02 21:52:35.019861 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009654 2569 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 02 21:52:35.019861 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009656 2569 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 02 21:52:35.019861 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009673 2569 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 02 21:52:35.019861 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009677 2569 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 02 21:52:35.019861 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009682 2569 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 02 21:52:35.019861 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009684 2569 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 02 21:52:35.019861 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009687 2569 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 02 21:52:35.020651 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009689 2569 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 02 21:52:35.020651 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009691 2569 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 02 21:52:35.020651 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009694 2569 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 02 21:52:35.020651 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009696 2569 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 02 21:52:35.020651 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009698 2569 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 02 21:52:35.020651 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:35.009701 2569 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 02 21:52:35.020651 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.009758 2569 server.go:957] "Client rotation is on, will bootstrap in background" Nov 02 21:52:35.020651 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.012216 2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Nov 02 21:52:35.020651 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.013340 2569 server.go:1014] "Starting client certificate rotation" Nov 02 21:52:35.020651 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.013433 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 02 21:52:35.020651 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.013468 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 02 21:52:35.020651 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.015753 2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 02 21:52:35.023393 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.023377 2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 02 21:52:35.034279 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.034261 2569 log.go:25] "Validated CRI v1 runtime API" Nov 02 21:52:35.038283 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.038268 2569 log.go:25] "Validated CRI v1 image API" Nov 02 21:52:35.039192 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.039158 2569 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Nov 02 21:52:35.044399 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.044378 2569 fs.go:135] Filesystem UUIDs: map[6f462860-7eb3-42f1-b75e-03bf5933ff47:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8cd2655e-ae16-4489-a8d3-3f163cceab06:/dev/nvme0n1p3] Nov 02 21:52:35.044480 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.044399 2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}] Nov 02 21:52:35.050149 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.050032 2569 manager.go:217] Machine: {Timestamp:2026-11-02 21:52:35.048475363 +0000 UTC m=+0.379058675 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3140052 MemoryCapacity:32812015616 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2021d99c7af77898179a17946186de SystemUUID:ec2021d9-9c7a-f778-9817-9a17946186de BootID:ad8067dd-a372-49ed-8db4-b49a7dbe7817 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406007808 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d8:ff:04:57 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d8:ff:04:57 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ee:84:11:91:c9:b3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812015616 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Nov 02 21:52:35.050149 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.050142 2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Nov 02 21:52:35.050308 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.050290 2569 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Nov 02 21:52:35.051122 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.051098 2569 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Nov 02 21:52:35.052215 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.052189 2569 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Nov 02 21:52:35.052399 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.052220 2569 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-99.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Nov 02 21:52:35.052478 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.052407 2569 topology_manager.go:143] "Creating topology manager with none policy" Nov 02 21:52:35.052478 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.052420 2569 container_manager_linux.go:311] "Creating device plugin manager" Nov 02 21:52:35.052566 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.052487 2569 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 02 21:52:35.052566 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.052513 2569 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 02 21:52:35.053783 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.053764 2569 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Nov 02 21:52:35.058349 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.058335 2569 state_mem.go:41] "Initialized" logger="CPUManager state memory" Nov 02 21:52:35.058507 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.058496 2569 server.go:1235] "Using root directory" path="/var/lib/kubelet" Nov 02 21:52:35.058565 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.058557 2569 kubelet.go:493] "Attempting to sync node with API server" Nov 02 21:52:35.058613 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.058577 2569 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Nov 02 21:52:35.058613 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.058596 2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Nov 02 21:52:35.058613 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.058609 2569 kubelet.go:405] "Adding apiserver pod source" Nov 02 21:52:35.058755 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.058619 2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Nov 02 21:52:35.059145 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.059129 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 02 21:52:35.061782 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.061741 2569 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Nov 02 21:52:35.071124 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.071109 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 02 21:52:35.071973 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.071961 2569 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Nov 02 21:52:35.072009 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.071994 2569 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Nov 02 21:52:35.072136 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.072126 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Nov 02 21:52:35.072178 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.072142 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Nov 02 21:52:35.072178 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.072148 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Nov 02 21:52:35.072178 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.072154 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Nov 02 21:52:35.072178 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.072161 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Nov 02 21:52:35.072178 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.072169 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Nov 02 21:52:35.072873 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.072864 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Nov 02 21:52:35.072910 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.072874 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Nov 02 21:52:35.072910 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.072882 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Nov 02 21:52:35.072910 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.072888 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Nov 02 21:52:35.072910 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.072896 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Nov 02 21:52:35.072910 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.072905 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Nov 02 21:52:35.074522 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.074511 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Nov 02 21:52:35.074561 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.074526 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Nov 02 21:52:35.078145 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.078130 2569 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-99.us-east-2.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Nov 02 21:52:35.078636 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.078624 2569 server.go:1263] "Started kubelet" Nov 02 21:52:35.078833 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:35.078810 2569 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" Nov 02 21:52:35.078882 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:35.078815 2569 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-99.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node" Nov 02 21:52:35.079345 ip-10-0-139-99 systemd[1]: Started Kubernetes Kubelet. Nov 02 21:52:35.079512 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.079399 2569 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Nov 02 21:52:35.079512 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.079457 2569 server_v1.go:49] "podresources" method="list" useActivePods=true Nov 02 21:52:35.079601 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.079399 2569 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Nov 02 21:52:35.080567 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.080545 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gf87h" Nov 02 21:52:35.080919 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.080902 2569 server.go:317] "Adding debug handlers to kubelet server" Nov 02 21:52:35.081473 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.081459 2569 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Nov 02 21:52:35.085087 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:35.085069 2569 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Nov 02 21:52:35.086360 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:35.085199 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-99.us-east-2.compute.internal.18e458f3a594eb98 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-99.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-99.us-east-2.compute.internal,},FirstTimestamp:2026-11-02 21:52:35.078597528 +0000 UTC m=+0.409180840,LastTimestamp:2026-11-02 21:52:35.078597528 +0000 UTC m=+0.409180840,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-99.us-east-2.compute.internal,}" Nov 02 21:52:35.087298 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.087284 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Nov 02 21:52:35.087983 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.087967 2569 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Nov 02 21:52:35.088135 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:35.088112 2569 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-99.us-east-2.compute.internal\" not found" Nov 02 21:52:35.088744 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.088728 2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Nov 02 21:52:35.088744 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.088742 2569 factory.go:55] Registering systemd factory Nov 02 21:52:35.088744 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.088748 2569 factory.go:223] Registration of the systemd container factory successfully Nov 02 21:52:35.089091 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.088800 2569 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Nov 02 21:52:35.089091 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.088916 2569 volume_manager.go:309] "The desired_state_of_world populator starts" Nov 02 21:52:35.089091 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.088930 2569 volume_manager.go:311] "Starting Kubelet Volume Manager" Nov 02 21:52:35.089091 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.088947 2569 factory.go:153] Registering CRI-O factory Nov 02 21:52:35.089091 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.088959 2569 factory.go:223] Registration of the crio container factory successfully Nov 02 21:52:35.089091 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.088976 2569 factory.go:103] Registering Raw factory Nov 02 21:52:35.089091 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.088989 2569 manager.go:1199] Started watching for new ooms in manager Nov 02 21:52:35.089091 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.089034 2569 reconstruct.go:97] "Volume reconstruction finished" Nov 02 21:52:35.089091 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.089043 2569 reconciler.go:29] "Reconciler: start to sync state" Nov 02 21:52:35.090010 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.089995 2569 manager.go:319] Starting recovery of all containers Nov 02 21:52:35.090981 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.090956 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gf87h" Nov 02 21:52:35.092956 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:35.092869 2569 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-99.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Nov 02 21:52:35.101033 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.101001 2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Nov 02 21:52:35.101800 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.101764 2569 manager.go:324] Recovery completed Nov 02 21:52:35.102776 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.102305 2569 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Nov 02 21:52:35.104283 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:35.104244 2569 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Nov 02 21:52:35.107253 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.107238 2569 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 02 21:52:35.109072 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.109056 2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-99.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 02 21:52:35.109142 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.109083 2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-99.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 02 21:52:35.109142 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.109094 2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-99.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 02 21:52:35.109635 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.109620 2569 cpu_manager.go:226] "Starting" policy="none" Nov 02 21:52:35.109635 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.109635 2569 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Nov 02 21:52:35.109783 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.109626 2569 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 02 21:52:35.109783 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.109651 2569 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Nov 02 21:52:35.110305 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.110290 2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-99.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 02 21:52:35.110373 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.110323 2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-99.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 02 21:52:35.110373 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.110338 2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-99.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 02 21:52:35.111710 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.111697 2569 policy_none.go:50] "Start" Nov 02 21:52:35.111766 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.111720 2569 memory_manager.go:187] "Starting memorymanager" policy="None" Nov 02 21:52:35.111766 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.111731 2569 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Nov 02 21:52:35.113720 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.113709 2569 policy_none.go:44] "Start" Nov 02 21:52:35.153820 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.153691 2569 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Nov 02 21:52:35.167973 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.167959 2569 manager.go:341] "Starting Device Plugin manager" Nov 02 21:52:35.168037 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:35.167998 2569 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Nov 02 21:52:35.168037 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.168007 2569 server.go:87] "Starting device plugin registration server" Nov 02 21:52:35.168217 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.168206 2569 eviction_manager.go:194] "Eviction manager: starting control loop" Nov 02 21:52:35.168263 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.168217 2569 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Nov 02 21:52:35.168338 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.168312 2569 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Nov 02 21:52:35.168411 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.168395 2569 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Nov 02 21:52:35.168411 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.168407 2569 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Nov 02 21:52:35.168955 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:35.168937 2569 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Nov 02 21:52:35.169027 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:35.168988 2569 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-99.us-east-2.compute.internal\" not found" Nov 02 21:52:35.269243 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.269202 2569 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 02 21:52:35.271337 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.271322 2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-99.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 02 21:52:35.271416 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.271352 2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-99.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 02 21:52:35.271416 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.271366 2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-99.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 02 21:52:35.271416 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.271398 2569 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-139-99.us-east-2.compute.internal" Nov 02 21:52:35.277506 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.277486 2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Nov 02 21:52:35.277506 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.277507 2569 status_manager.go:249] "Starting to sync pod status with apiserver" Nov 02 21:52:35.277623 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.277524 2569 kubelet.go:2521] "Starting kubelet main sync loop" Nov 02 21:52:35.277623 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:35.277550 2569 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Nov 02 21:52:35.279862 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.279845 2569 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-139-99.us-east-2.compute.internal" Nov 02 21:52:35.279963 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:35.279872 2569 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-99.us-east-2.compute.internal\": node \"ip-10-0-139-99.us-east-2.compute.internal\" not found" Nov 02 21:52:35.281620 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.281605 2569 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 02 21:52:35.298834 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:35.298816 2569 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-99.us-east-2.compute.internal\" not found" Nov 02 21:52:35.377762 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.377733 2569 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-99.us-east-2.compute.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal"] Nov 02 21:52:35.377834 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.377805 2569 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 02 21:52:35.378577 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.378562 2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-99.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 02 21:52:35.378641 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.378591 2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-99.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 02 21:52:35.378641 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.378601 2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-99.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 02 21:52:35.380885 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.380874 2569 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 02 21:52:35.381036 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.381017 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-99.us-east-2.compute.internal" Nov 02 21:52:35.381072 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.381050 2569 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 02 21:52:35.381563 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.381547 2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-99.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 02 21:52:35.381624 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.381576 2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-99.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 02 21:52:35.381624 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.381586 2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-99.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 02 21:52:35.381624 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.381547 2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-99.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 02 21:52:35.381731 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.381644 2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-99.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 02 21:52:35.381731 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.381678 2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-99.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 02 21:52:35.383799 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.383775 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal" Nov 02 21:52:35.383904 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.383810 2569 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 02 21:52:35.384472 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.384456 2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-99.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 02 21:52:35.384554 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.384481 2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-99.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 02 21:52:35.384554 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.384492 2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-99.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 02 21:52:35.391011 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.390993 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/de883a853e4817557c8c217fade4c52e-config\") pod \"kube-apiserver-proxy-ip-10-0-139-99.us-east-2.compute.internal\" (UID: \"de883a853e4817557c8c217fade4c52e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-99.us-east-2.compute.internal" Nov 02 21:52:35.391089 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.391016 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/495aa330bd161682551682a6af54a40f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal\" (UID: \"495aa330bd161682551682a6af54a40f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal" Nov 02 21:52:35.391089 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.391041 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/495aa330bd161682551682a6af54a40f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal\" (UID: \"495aa330bd161682551682a6af54a40f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal" Nov 02 21:52:35.399110 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:35.399097 2569 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-99.us-east-2.compute.internal\" not found" Nov 02 21:52:35.416318 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:35.416292 2569 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-99.us-east-2.compute.internal\" not found" node="ip-10-0-139-99.us-east-2.compute.internal" Nov 02 21:52:35.422748 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:35.422731 2569 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-99.us-east-2.compute.internal\" not found" node="ip-10-0-139-99.us-east-2.compute.internal" Nov 02 21:52:35.491365 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.491344 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/de883a853e4817557c8c217fade4c52e-config\") pod \"kube-apiserver-proxy-ip-10-0-139-99.us-east-2.compute.internal\" (UID: \"de883a853e4817557c8c217fade4c52e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-99.us-east-2.compute.internal" Nov 02 21:52:35.491447 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.491368 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/495aa330bd161682551682a6af54a40f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal\" (UID: \"495aa330bd161682551682a6af54a40f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal" Nov 02 21:52:35.491447 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.491383 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/495aa330bd161682551682a6af54a40f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal\" (UID: \"495aa330bd161682551682a6af54a40f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal" Nov 02 21:52:35.491447 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.491410 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/495aa330bd161682551682a6af54a40f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal\" (UID: \"495aa330bd161682551682a6af54a40f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal" Nov 02 21:52:35.491447 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.491428 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/de883a853e4817557c8c217fade4c52e-config\") pod \"kube-apiserver-proxy-ip-10-0-139-99.us-east-2.compute.internal\" (UID: \"de883a853e4817557c8c217fade4c52e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-99.us-east-2.compute.internal" Nov 02 21:52:35.491582 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.491442 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/495aa330bd161682551682a6af54a40f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal\" (UID: \"495aa330bd161682551682a6af54a40f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal" Nov 02 21:52:35.499402 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:35.499383 2569 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-99.us-east-2.compute.internal\" not found" Nov 02 21:52:35.599603 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:35.599583 2569 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-99.us-east-2.compute.internal\" not found" Nov 02 21:52:35.700137 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:35.700111 2569 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-99.us-east-2.compute.internal\" not found" Nov 02 21:52:35.720300 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.720276 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-99.us-east-2.compute.internal" Nov 02 21:52:35.726084 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:35.726070 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal" Nov 02 21:52:35.800192 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:35.800157 2569 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-99.us-east-2.compute.internal\" not found" Nov 02 21:52:35.900784 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:35.900711 2569 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-99.us-east-2.compute.internal\" not found" Nov 02 21:52:36.001214 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:36.001179 2569 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-99.us-east-2.compute.internal\" not found" Nov 02 21:52:36.013361 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:36.013339 2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Nov 02 21:52:36.013507 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:36.013489 2569 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Nov 02 21:52:36.013543 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:36.013517 2569 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Nov 02 21:52:36.097078 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:36.097020 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-01 21:47:35 +0000 UTC" deadline="2028-05-17 12:42:46.287625911 +0000 UTC" Nov 02 21:52:36.097078 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:36.097065 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13478h50m10.190564692s" Nov 02 21:52:36.102028 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:36.102015 2569 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-99.us-east-2.compute.internal\" not found" Nov 02 21:52:36.202703 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:36.202609 2569 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-99.us-east-2.compute.internal\" not found" Nov 02 21:52:36.303729 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:36.303693 2569 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-99.us-east-2.compute.internal\" not found" Nov 02 21:52:36.344964 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:36.344932 2569 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Nov 02 21:52:36.389070 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:36.389032 2569 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal" Nov 02 21:52:36.401579 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:36.401552 2569 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 02 21:52:36.403052 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:36.403035 2569 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-99.us-east-2.compute.internal" Nov 02 21:52:36.412629 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:36.412610 2569 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 02 21:52:36.420803 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:36.420771 2569 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod495aa330bd161682551682a6af54a40f.slice/crio-78514c09bd915527d36f698947763edb10e4fc561c0df91d2d3aff429eb006b3 WatchSource:0}: Error finding container 78514c09bd915527d36f698947763edb10e4fc561c0df91d2d3aff429eb006b3: Status 404 returned error can't find the container with id 78514c09bd915527d36f698947763edb10e4fc561c0df91d2d3aff429eb006b3 Nov 02 21:52:36.421291 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:36.421274 2569 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde883a853e4817557c8c217fade4c52e.slice/crio-29088fd048caacb1e145426d5dd67dcd393ec5082be519d12dd8752559bbd3a1 WatchSource:0}: Error finding container 29088fd048caacb1e145426d5dd67dcd393ec5082be519d12dd8752559bbd3a1: Status 404 returned error can't find the container with id 29088fd048caacb1e145426d5dd67dcd393ec5082be519d12dd8752559bbd3a1 Nov 02 21:52:36.426997 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:36.426983 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 02 21:52:36.435859 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:36.435776 2569 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Nov 02 21:52:36.896612 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:36.896582 2569 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 02 21:52:37.060514 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.060481 2569 apiserver.go:52] "Watching apiserver" Nov 02 21:52:37.071146 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.071117 2569 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Nov 02 21:52:37.071538 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.071508 2569 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-km4nc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal","openshift-multus/multus-additional-cni-plugins-5mtfp","openshift-multus/multus-kbrwm","kube-system/kube-apiserver-proxy-ip-10-0-139-99.us-east-2.compute.internal","openshift-network-diagnostics/network-check-target-747nn","openshift-network-operator/iptables-alerter-kwr6l","kube-system/global-pull-secret-syncer-vcx54","openshift-cluster-node-tuning-operator/tuned-ff4h2","openshift-image-registry/node-ca-bjwd8","openshift-multus/network-metrics-daemon-gzkfr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq","openshift-dns/node-resolver-ck8br","openshift-ovn-kubernetes/ovnkube-node-g996m"] Nov 02 21:52:37.074746 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.074293 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kwr6l" Nov 02 21:52:37.076614 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.076585 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:52:37.076734 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:37.076665 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzkfr" podUID="84467c9f-0161-4e44-9420-dcc224215f05" Nov 02 21:52:37.078374 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.078346 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Nov 02 21:52:37.078503 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.078395 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Nov 02 21:52:37.078503 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.078485 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Nov 02 21:52:37.078591 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.078524 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kdpcq\"" Nov 02 21:52:37.079106 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.079088 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:52:37.081405 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.081388 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.084289 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.084267 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.087254 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.087237 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:52:37.087334 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:37.087288 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-747nn" podUID="87451849-2618-4958-bc4a-114cc208434e" Nov 02 21:52:37.088645 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.088606 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Nov 02 21:52:37.090545 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.090509 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.093071 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.093052 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ck8br" Nov 02 21:52:37.095952 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.095928 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:52:37.096047 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:37.095993 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vcx54" podUID="649dd5b0-1649-4f63-a148-40fd3f3e07f4" Nov 02 21:52:37.098374 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.098356 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bjwd8" Nov 02 21:52:37.100754 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.100729 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-km4nc" Nov 02 21:52:37.101799 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.101221 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-multus-cni-dir\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.101799 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.101271 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-cni-binary-copy\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.101799 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.101339 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-etc-kubernetes\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.101799 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.101383 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-systemd-units\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.101799 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.101418 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/15a806bb-6e90-479d-8f94-d9915b47cbde-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5mtfp\" (UID: \"15a806bb-6e90-479d-8f94-d9915b47cbde\") " pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:52:37.101799 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.101456 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55vdw\" (UniqueName: \"kubernetes.io/projected/2e2913f2-f166-4ce6-b93b-cea606008bba-kube-api-access-55vdw\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.101799 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.101621 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-host-var-lib-cni-multus\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.101799 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.101653 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwdt6\" (UniqueName: \"kubernetes.io/projected/e011b0d4-3387-4b79-9a3f-b3fac185c126-kube-api-access-qwdt6\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.101799 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.101701 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-modprobe-d\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.101799 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.101734 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-sysconfig\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.101799 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.101765 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-tuned\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.101799 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.101798 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dlhh\" (UniqueName: \"kubernetes.io/projected/41a3e68b-3746-48ca-89c7-99347353fb8b-kube-api-access-8dlhh\") pod \"iptables-alerter-kwr6l\" (UID: \"41a3e68b-3746-48ca-89c7-99347353fb8b\") " pod="openshift-network-operator/iptables-alerter-kwr6l" Nov 02 21:52:37.102290 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.101824 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-cnibin\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.102290 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.101855 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-etc-openvswitch\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.102290 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.101888 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-cni-netd\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.102290 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.101909 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snzkj\" (UniqueName: \"kubernetes.io/projected/84467c9f-0161-4e44-9420-dcc224215f05-kube-api-access-snzkj\") pod \"network-metrics-daemon-gzkfr\" (UID: \"84467c9f-0161-4e44-9420-dcc224215f05\") " pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:52:37.102290 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.101929 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15a806bb-6e90-479d-8f94-d9915b47cbde-cnibin\") pod \"multus-additional-cni-plugins-5mtfp\" (UID: \"15a806bb-6e90-479d-8f94-d9915b47cbde\") " pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:52:37.102290 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.101945 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15a806bb-6e90-479d-8f94-d9915b47cbde-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5mtfp\" (UID: \"15a806bb-6e90-479d-8f94-d9915b47cbde\") " pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:52:37.102290 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.101968 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15a806bb-6e90-479d-8f94-d9915b47cbde-cni-binary-copy\") pod \"multus-additional-cni-plugins-5mtfp\" (UID: \"15a806bb-6e90-479d-8f94-d9915b47cbde\") " pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:52:37.102290 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.102003 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-systemd\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.102290 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.102021 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e2913f2-f166-4ce6-b93b-cea606008bba-tmp\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.102290 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.102042 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-run-openvswitch\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.102290 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.102060 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-cni-bin\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.102290 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.102083 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/15a806bb-6e90-479d-8f94-d9915b47cbde-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5mtfp\" (UID: \"15a806bb-6e90-479d-8f94-d9915b47cbde\") " pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:52:37.102290 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.102103 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-sysctl-conf\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.102290 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.102122 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-sys\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.102290 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.102140 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-hostroot\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.102290 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.102157 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/41a3e68b-3746-48ca-89c7-99347353fb8b-host-slash\") pod \"iptables-alerter-kwr6l\" (UID: \"41a3e68b-3746-48ca-89c7-99347353fb8b\") " pod="openshift-network-operator/iptables-alerter-kwr6l" Nov 02 21:52:37.103129 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.102177 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84467c9f-0161-4e44-9420-dcc224215f05-metrics-certs\") pod \"network-metrics-daemon-gzkfr\" (UID: \"84467c9f-0161-4e44-9420-dcc224215f05\") " pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:52:37.103129 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.102195 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-kubernetes\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.103129 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.102213 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-host-run-netns\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.103129 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.102232 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-host-var-lib-kubelet\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.103129 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.102254 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-lib-modules\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.103129 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.102283 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-multus-conf-dir\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.103129 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.102313 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-host-run-multus-certs\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.103129 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.102352 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-kubelet\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.103129 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.102401 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-run-netns\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.103129 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.102430 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-run-systemd\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.103129 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.102460 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-var-lib-openvswitch\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.103129 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.102493 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-multus-daemon-config\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.103129 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.102529 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-run-ovn-kubernetes\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.103129 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.102561 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e011b0d4-3387-4b79-9a3f-b3fac185c126-ovnkube-script-lib\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.103129 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.102603 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsdqt\" (UniqueName: \"kubernetes.io/projected/87451849-2618-4958-bc4a-114cc208434e-kube-api-access-fsdqt\") pod \"network-check-target-747nn\" (UID: \"87451849-2618-4958-bc4a-114cc208434e\") " pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:52:37.103129 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.102636 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/41a3e68b-3746-48ca-89c7-99347353fb8b-iptables-alerter-script\") pod \"iptables-alerter-kwr6l\" (UID: \"41a3e68b-3746-48ca-89c7-99347353fb8b\") " pod="openshift-network-operator/iptables-alerter-kwr6l" Nov 02 21:52:37.103873 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.102661 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-multus-socket-dir-parent\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.103873 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.102691 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-slash\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.103873 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.102724 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8kx7\" (UniqueName: \"kubernetes.io/projected/15a806bb-6e90-479d-8f94-d9915b47cbde-kube-api-access-t8kx7\") pod \"multus-additional-cni-plugins-5mtfp\" (UID: \"15a806bb-6e90-479d-8f94-d9915b47cbde\") " pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:52:37.103873 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.102829 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-host-run-k8s-cni-cncf-io\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.103873 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.102865 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-host-var-lib-cni-bin\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.103873 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.102897 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-run-ovn\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.103873 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.102926 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-node-log\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.103873 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.102958 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e011b0d4-3387-4b79-9a3f-b3fac185c126-ovnkube-config\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.103873 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.103018 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e011b0d4-3387-4b79-9a3f-b3fac185c126-env-overrides\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.104265 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.103940 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:52:37.104732 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.104276 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e011b0d4-3387-4b79-9a3f-b3fac185c126-ovn-node-metrics-cert\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.104732 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.104341 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-host\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.104732 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.104374 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-log-socket\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.104732 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.104406 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-run\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.104732 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.104437 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxhzp\" (UniqueName: \"kubernetes.io/projected/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-kube-api-access-xxhzp\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.104732 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.104493 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.104732 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.104543 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15a806bb-6e90-479d-8f94-d9915b47cbde-system-cni-dir\") pod \"multus-additional-cni-plugins-5mtfp\" (UID: \"15a806bb-6e90-479d-8f94-d9915b47cbde\") " pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:52:37.104732 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.104611 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-sysctl-d\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.104732 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.104715 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-var-lib-kubelet\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.105136 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.104778 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-system-cni-dir\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.107398 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.107372 2569 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Nov 02 21:52:37.127762 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.127730 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gzdf2" Nov 02 21:52:37.139072 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.139049 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gzdf2" Nov 02 21:52:37.171933 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.171905 2569 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Nov 02 21:52:37.187860 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.187836 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Nov 02 21:52:37.188033 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.188012 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Nov 02 21:52:37.188098 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.188049 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Nov 02 21:52:37.188226 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.188207 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Nov 02 21:52:37.188283 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.188253 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Nov 02 21:52:37.188283 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.188261 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-hfjlh\"" Nov 02 21:52:37.189375 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.189356 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Nov 02 21:52:37.189458 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.189373 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Nov 02 21:52:37.189458 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.189425 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Nov 02 21:52:37.189569 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.189489 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-t9kl2\"" Nov 02 21:52:37.189569 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.189510 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Nov 02 21:52:37.189569 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.189513 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Nov 02 21:52:37.189756 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.189581 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sktbt\"" Nov 02 21:52:37.189756 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.189629 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Nov 02 21:52:37.189756 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.189640 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Nov 02 21:52:37.189756 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.189643 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Nov 02 21:52:37.189756 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.189672 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Nov 02 21:52:37.189756 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.189678 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Nov 02 21:52:37.189756 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.189728 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Nov 02 21:52:37.189756 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.189730 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Nov 02 21:52:37.190146 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.189887 2569 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Nov 02 21:52:37.190633 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.190615 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-plhfq\"" Nov 02 21:52:37.190698 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.190648 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Nov 02 21:52:37.190774 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.190743 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Nov 02 21:52:37.190832 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.190748 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Nov 02 21:52:37.190832 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.190792 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Nov 02 21:52:37.190832 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.190797 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Nov 02 21:52:37.190985 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.190911 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Nov 02 21:52:37.190985 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.190948 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7jc6l\"" Nov 02 21:52:37.190985 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.190949 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dwp2s\"" Nov 02 21:52:37.190985 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.190981 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Nov 02 21:52:37.191171 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.190985 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dx6x8\"" Nov 02 21:52:37.191171 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.191011 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-9vfns\"" Nov 02 21:52:37.205893 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.205862 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15a806bb-6e90-479d-8f94-d9915b47cbde-cni-binary-copy\") pod \"multus-additional-cni-plugins-5mtfp\" (UID: \"15a806bb-6e90-479d-8f94-d9915b47cbde\") " pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:52:37.206021 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.205902 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-systemd\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.206021 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.205927 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e2913f2-f166-4ce6-b93b-cea606008bba-tmp\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.206021 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.205975 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-run-openvswitch\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.206021 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.206000 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-cni-bin\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.206339 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.206026 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/15a806bb-6e90-479d-8f94-d9915b47cbde-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5mtfp\" (UID: \"15a806bb-6e90-479d-8f94-d9915b47cbde\") " pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:52:37.206339 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.206052 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-sysctl-conf\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.206339 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.206073 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-sys\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.206339 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.206095 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-hostroot\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.206339 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.206119 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/41a3e68b-3746-48ca-89c7-99347353fb8b-host-slash\") pod \"iptables-alerter-kwr6l\" (UID: \"41a3e68b-3746-48ca-89c7-99347353fb8b\") " pod="openshift-network-operator/iptables-alerter-kwr6l" Nov 02 21:52:37.206339 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.206158 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7ccd\" (UniqueName: \"kubernetes.io/projected/c0fdd204-e1ad-4de8-ab18-52ab672cc3a4-kube-api-access-n7ccd\") pod \"node-ca-bjwd8\" (UID: \"c0fdd204-e1ad-4de8-ab18-52ab672cc3a4\") " pod="openshift-image-registry/node-ca-bjwd8" Nov 02 21:52:37.206339 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.206190 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84467c9f-0161-4e44-9420-dcc224215f05-metrics-certs\") pod \"network-metrics-daemon-gzkfr\" (UID: \"84467c9f-0161-4e44-9420-dcc224215f05\") " pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:52:37.206339 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.206214 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-kubernetes\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.206339 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.206238 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-host-run-netns\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.206339 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.206265 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-host-var-lib-kubelet\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.206339 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.206291 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/649dd5b0-1649-4f63-a148-40fd3f3e07f4-kubelet-config\") pod \"global-pull-secret-syncer-vcx54\" (UID: \"649dd5b0-1649-4f63-a148-40fd3f3e07f4\") " pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:52:37.206339 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.206325 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9d5c\" (UniqueName: \"kubernetes.io/projected/e7658661-8ddc-4443-91d0-edeaab291256-kube-api-access-p9d5c\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:52:37.207148 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.206350 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-lib-modules\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.207148 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.206395 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-multus-conf-dir\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.207148 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.206421 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-host-run-multus-certs\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.207148 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.206445 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-kubelet\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.207148 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.206471 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-run-netns\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.207148 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.206496 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-run-systemd\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.207148 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.206523 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-var-lib-openvswitch\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.207148 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.206549 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd77571d-49e8-4127-951a-f8a4412d8e43-agent-certs\") pod \"konnectivity-agent-km4nc\" (UID: \"fd77571d-49e8-4127-951a-f8a4412d8e43\") " pod="kube-system/konnectivity-agent-km4nc" Nov 02 21:52:37.207148 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.206575 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-multus-daemon-config\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.207148 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.206602 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-run-ovn-kubernetes\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.207148 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.206635 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e011b0d4-3387-4b79-9a3f-b3fac185c126-ovnkube-script-lib\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.207148 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.206663 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsdqt\" (UniqueName: \"kubernetes.io/projected/87451849-2618-4958-bc4a-114cc208434e-kube-api-access-fsdqt\") pod \"network-check-target-747nn\" (UID: \"87451849-2618-4958-bc4a-114cc208434e\") " pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:52:37.207148 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.206689 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/983b05f9-8574-4a23-b3de-951a68c553a1-tmp-dir\") pod \"node-resolver-ck8br\" (UID: \"983b05f9-8574-4a23-b3de-951a68c553a1\") " pod="openshift-dns/node-resolver-ck8br" Nov 02 21:52:37.207148 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.206719 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/41a3e68b-3746-48ca-89c7-99347353fb8b-iptables-alerter-script\") pod \"iptables-alerter-kwr6l\" (UID: \"41a3e68b-3746-48ca-89c7-99347353fb8b\") " pod="openshift-network-operator/iptables-alerter-kwr6l" Nov 02 21:52:37.207148 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.206762 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e7658661-8ddc-4443-91d0-edeaab291256-sys-fs\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:52:37.207148 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.206788 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-multus-socket-dir-parent\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.207148 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.206823 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-slash\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.208013 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.206850 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c0fdd204-e1ad-4de8-ab18-52ab672cc3a4-serviceca\") pod \"node-ca-bjwd8\" (UID: \"c0fdd204-e1ad-4de8-ab18-52ab672cc3a4\") " pod="openshift-image-registry/node-ca-bjwd8" Nov 02 21:52:37.208013 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.206880 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8kx7\" (UniqueName: \"kubernetes.io/projected/15a806bb-6e90-479d-8f94-d9915b47cbde-kube-api-access-t8kx7\") pod \"multus-additional-cni-plugins-5mtfp\" (UID: \"15a806bb-6e90-479d-8f94-d9915b47cbde\") " pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:52:37.208013 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.206911 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-host-run-k8s-cni-cncf-io\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.208013 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.206937 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-host-var-lib-cni-bin\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.208013 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.206963 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-run-ovn\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.208013 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.206994 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-node-log\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.208013 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.207019 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e011b0d4-3387-4b79-9a3f-b3fac185c126-ovnkube-config\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.208013 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.207044 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e011b0d4-3387-4b79-9a3f-b3fac185c126-env-overrides\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.208013 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.207087 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e011b0d4-3387-4b79-9a3f-b3fac185c126-ovn-node-metrics-cert\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.208013 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.207114 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-host\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.208013 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.207159 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-log-socket\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.208013 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.207188 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd77571d-49e8-4127-951a-f8a4412d8e43-konnectivity-ca\") pod \"konnectivity-agent-km4nc\" (UID: \"fd77571d-49e8-4127-951a-f8a4412d8e43\") " pod="kube-system/konnectivity-agent-km4nc" Nov 02 21:52:37.208013 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.207218 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e7658661-8ddc-4443-91d0-edeaab291256-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:52:37.208013 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.207246 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e7658661-8ddc-4443-91d0-edeaab291256-socket-dir\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:52:37.208013 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.207300 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/983b05f9-8574-4a23-b3de-951a68c553a1-hosts-file\") pod \"node-resolver-ck8br\" (UID: \"983b05f9-8574-4a23-b3de-951a68c553a1\") " pod="openshift-dns/node-resolver-ck8br" Nov 02 21:52:37.208013 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.207389 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnhnw\" (UniqueName: \"kubernetes.io/projected/983b05f9-8574-4a23-b3de-951a68c553a1-kube-api-access-wnhnw\") pod \"node-resolver-ck8br\" (UID: \"983b05f9-8574-4a23-b3de-951a68c553a1\") " pod="openshift-dns/node-resolver-ck8br" Nov 02 21:52:37.208013 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.207443 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-run\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.208842 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.207471 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxhzp\" (UniqueName: \"kubernetes.io/projected/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-kube-api-access-xxhzp\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.208842 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.207509 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.208842 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.207553 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15a806bb-6e90-479d-8f94-d9915b47cbde-system-cni-dir\") pod \"multus-additional-cni-plugins-5mtfp\" (UID: \"15a806bb-6e90-479d-8f94-d9915b47cbde\") " pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:52:37.208842 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.207581 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-sysctl-d\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.208842 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.207608 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-var-lib-kubelet\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.208842 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.207635 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-system-cni-dir\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.208842 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.207672 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-multus-cni-dir\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.208842 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.207702 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-cni-binary-copy\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.208842 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.207727 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-etc-kubernetes\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.208842 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.207776 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-systemd-units\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.208842 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.207806 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/649dd5b0-1649-4f63-a148-40fd3f3e07f4-original-pull-secret\") pod \"global-pull-secret-syncer-vcx54\" (UID: \"649dd5b0-1649-4f63-a148-40fd3f3e07f4\") " pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:52:37.208842 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.207836 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e7658661-8ddc-4443-91d0-edeaab291256-registration-dir\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:52:37.208842 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.207867 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e7658661-8ddc-4443-91d0-edeaab291256-device-dir\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:52:37.208842 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.207895 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e7658661-8ddc-4443-91d0-edeaab291256-etc-selinux\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:52:37.208842 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.207925 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/15a806bb-6e90-479d-8f94-d9915b47cbde-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5mtfp\" (UID: \"15a806bb-6e90-479d-8f94-d9915b47cbde\") " pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:52:37.208842 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.207954 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55vdw\" (UniqueName: \"kubernetes.io/projected/2e2913f2-f166-4ce6-b93b-cea606008bba-kube-api-access-55vdw\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.208842 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.207981 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-host-var-lib-cni-multus\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.209761 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.208011 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwdt6\" (UniqueName: \"kubernetes.io/projected/e011b0d4-3387-4b79-9a3f-b3fac185c126-kube-api-access-qwdt6\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.209761 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.208037 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/649dd5b0-1649-4f63-a148-40fd3f3e07f4-dbus\") pod \"global-pull-secret-syncer-vcx54\" (UID: \"649dd5b0-1649-4f63-a148-40fd3f3e07f4\") " pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:52:37.209761 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.208065 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c0fdd204-e1ad-4de8-ab18-52ab672cc3a4-host\") pod \"node-ca-bjwd8\" (UID: \"c0fdd204-e1ad-4de8-ab18-52ab672cc3a4\") " pod="openshift-image-registry/node-ca-bjwd8" Nov 02 21:52:37.209761 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.208092 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-modprobe-d\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.209761 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.208123 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-sysconfig\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.209761 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.208155 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-tuned\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.209761 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.208185 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dlhh\" (UniqueName: \"kubernetes.io/projected/41a3e68b-3746-48ca-89c7-99347353fb8b-kube-api-access-8dlhh\") pod \"iptables-alerter-kwr6l\" (UID: \"41a3e68b-3746-48ca-89c7-99347353fb8b\") " pod="openshift-network-operator/iptables-alerter-kwr6l" Nov 02 21:52:37.209761 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.208215 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-cnibin\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.209761 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.208241 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-etc-openvswitch\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.209761 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.208269 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-cni-netd\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.209761 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.208297 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snzkj\" (UniqueName: \"kubernetes.io/projected/84467c9f-0161-4e44-9420-dcc224215f05-kube-api-access-snzkj\") pod \"network-metrics-daemon-gzkfr\" (UID: \"84467c9f-0161-4e44-9420-dcc224215f05\") " pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:52:37.209761 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.208327 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15a806bb-6e90-479d-8f94-d9915b47cbde-cnibin\") pod \"multus-additional-cni-plugins-5mtfp\" (UID: \"15a806bb-6e90-479d-8f94-d9915b47cbde\") " pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:52:37.209761 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.208355 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15a806bb-6e90-479d-8f94-d9915b47cbde-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5mtfp\" (UID: \"15a806bb-6e90-479d-8f94-d9915b47cbde\") " pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:52:37.209761 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.208607 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15a806bb-6e90-479d-8f94-d9915b47cbde-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5mtfp\" (UID: \"15a806bb-6e90-479d-8f94-d9915b47cbde\") " pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:52:37.209761 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.209234 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15a806bb-6e90-479d-8f94-d9915b47cbde-cni-binary-copy\") pod \"multus-additional-cni-plugins-5mtfp\" (UID: \"15a806bb-6e90-479d-8f94-d9915b47cbde\") " pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:52:37.209761 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.209337 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-systemd\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.209761 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.209632 2569 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Nov 02 21:52:37.210626 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.210054 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-systemd-units\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.210626 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.210342 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e011b0d4-3387-4b79-9a3f-b3fac185c126-env-overrides\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.210626 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.210391 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-run-openvswitch\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.210626 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.210422 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-cni-bin\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.210626 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.210545 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-log-socket\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.211041 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.210809 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-run\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.211041 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.210871 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-var-lib-kubelet\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.211041 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.210915 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.211041 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.210961 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15a806bb-6e90-479d-8f94-d9915b47cbde-system-cni-dir\") pod \"multus-additional-cni-plugins-5mtfp\" (UID: \"15a806bb-6e90-479d-8f94-d9915b47cbde\") " pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:52:37.211041 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.210964 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/15a806bb-6e90-479d-8f94-d9915b47cbde-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5mtfp\" (UID: \"15a806bb-6e90-479d-8f94-d9915b47cbde\") " pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:52:37.211308 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.211078 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-sysctl-d\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.211308 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.211082 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-var-lib-openvswitch\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.211308 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.211150 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-cnibin\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.211308 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.211177 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-sysctl-conf\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.211308 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.211237 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-modprobe-d\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.211308 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.211246 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-sys\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.211308 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.211288 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-hostroot\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.211308 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.211290 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-sysconfig\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.211777 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.211341 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/41a3e68b-3746-48ca-89c7-99347353fb8b-host-slash\") pod \"iptables-alerter-kwr6l\" (UID: \"41a3e68b-3746-48ca-89c7-99347353fb8b\") " pod="openshift-network-operator/iptables-alerter-kwr6l" Nov 02 21:52:37.211777 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:37.211446 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 02 21:52:37.211777 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:37.211528 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84467c9f-0161-4e44-9420-dcc224215f05-metrics-certs podName:84467c9f-0161-4e44-9420-dcc224215f05 nodeName:}" failed. No retries permitted until 2026-11-02 21:52:37.711488664 +0000 UTC m=+3.042071998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/84467c9f-0161-4e44-9420-dcc224215f05-metrics-certs") pod "network-metrics-daemon-gzkfr" (UID: "84467c9f-0161-4e44-9420-dcc224215f05") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 02 21:52:37.211777 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.211584 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-kubernetes\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.211777 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.211634 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-host-run-netns\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.211777 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.211677 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-host-var-lib-kubelet\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.211777 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.211767 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-multus-daemon-config\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.212036 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.211833 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-lib-modules\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.212036 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.211844 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-run-ovn-kubernetes\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.212036 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.211897 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-multus-conf-dir\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.212036 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.211944 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-host-run-multus-certs\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.212036 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.211982 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-kubelet\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.212036 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.211989 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/15a806bb-6e90-479d-8f94-d9915b47cbde-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5mtfp\" (UID: \"15a806bb-6e90-479d-8f94-d9915b47cbde\") " pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:52:37.212036 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.212025 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-run-netns\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.212276 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.212068 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-run-systemd\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.213602 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.213185 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-etc-openvswitch\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.213602 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.213205 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e011b0d4-3387-4b79-9a3f-b3fac185c126-ovnkube-script-lib\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.213602 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.213267 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-cni-netd\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.213602 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.213368 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15a806bb-6e90-479d-8f94-d9915b47cbde-cnibin\") pod \"multus-additional-cni-plugins-5mtfp\" (UID: \"15a806bb-6e90-479d-8f94-d9915b47cbde\") " pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:52:37.213890 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.213866 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-host-run-k8s-cni-cncf-io\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.213967 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.213944 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e2913f2-f166-4ce6-b93b-cea606008bba-tmp\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.214018 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.213992 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-multus-socket-dir-parent\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.214069 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.214011 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/41a3e68b-3746-48ca-89c7-99347353fb8b-iptables-alerter-script\") pod \"iptables-alerter-kwr6l\" (UID: \"41a3e68b-3746-48ca-89c7-99347353fb8b\") " pod="openshift-network-operator/iptables-alerter-kwr6l" Nov 02 21:52:37.214156 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.214064 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-node-log\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.214156 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.214130 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-run-ovn\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.214259 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.214178 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-slash\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.214512 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.214474 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-multus-cni-dir\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.214617 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.214526 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-system-cni-dir\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.214617 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.214534 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-etc-kubernetes\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.214617 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.214538 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-host-var-lib-cni-multus\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.214617 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.214595 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-host\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.214873 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.214633 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-tuned\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.214873 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.214698 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e011b0d4-3387-4b79-9a3f-b3fac185c126-ovn-node-metrics-cert\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.215589 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.215535 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e011b0d4-3387-4b79-9a3f-b3fac185c126-ovnkube-config\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.215589 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.215535 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-cni-binary-copy\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.217770 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.217127 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-host-var-lib-cni-bin\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.225006 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:37.224663 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 02 21:52:37.225006 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:37.224711 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 02 21:52:37.225006 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:37.224724 2569 projected.go:196] Error preparing data for projected volume kube-api-access-fsdqt for pod openshift-network-diagnostics/network-check-target-747nn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 02 21:52:37.225006 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:37.224780 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87451849-2618-4958-bc4a-114cc208434e-kube-api-access-fsdqt podName:87451849-2618-4958-bc4a-114cc208434e nodeName:}" failed. No retries permitted until 2026-11-02 21:52:37.724761843 +0000 UTC m=+3.055345166 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fsdqt" (UniqueName: "kubernetes.io/projected/87451849-2618-4958-bc4a-114cc208434e-kube-api-access-fsdqt") pod "network-check-target-747nn" (UID: "87451849-2618-4958-bc4a-114cc208434e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 02 21:52:37.227335 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.227310 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxhzp\" (UniqueName: \"kubernetes.io/projected/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-kube-api-access-xxhzp\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.231132 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.231105 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55vdw\" (UniqueName: \"kubernetes.io/projected/2e2913f2-f166-4ce6-b93b-cea606008bba-kube-api-access-55vdw\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.231839 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.231812 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwdt6\" (UniqueName: \"kubernetes.io/projected/e011b0d4-3387-4b79-9a3f-b3fac185c126-kube-api-access-qwdt6\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.232070 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.232048 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8kx7\" (UniqueName: \"kubernetes.io/projected/15a806bb-6e90-479d-8f94-d9915b47cbde-kube-api-access-t8kx7\") pod \"multus-additional-cni-plugins-5mtfp\" (UID: \"15a806bb-6e90-479d-8f94-d9915b47cbde\") " pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:52:37.232573 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.232544 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snzkj\" (UniqueName: \"kubernetes.io/projected/84467c9f-0161-4e44-9420-dcc224215f05-kube-api-access-snzkj\") pod \"network-metrics-daemon-gzkfr\" (UID: \"84467c9f-0161-4e44-9420-dcc224215f05\") " pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:52:37.233814 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.233726 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dlhh\" (UniqueName: \"kubernetes.io/projected/41a3e68b-3746-48ca-89c7-99347353fb8b-kube-api-access-8dlhh\") pod \"iptables-alerter-kwr6l\" (UID: \"41a3e68b-3746-48ca-89c7-99347353fb8b\") " pod="openshift-network-operator/iptables-alerter-kwr6l" Nov 02 21:52:37.284271 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.284191 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-99.us-east-2.compute.internal" event={"ID":"de883a853e4817557c8c217fade4c52e","Type":"ContainerStarted","Data":"29088fd048caacb1e145426d5dd67dcd393ec5082be519d12dd8752559bbd3a1"} Nov 02 21:52:37.286326 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.286295 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal" event={"ID":"495aa330bd161682551682a6af54a40f","Type":"ContainerStarted","Data":"78514c09bd915527d36f698947763edb10e4fc561c0df91d2d3aff429eb006b3"} Nov 02 21:52:37.309069 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.309034 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c0fdd204-e1ad-4de8-ab18-52ab672cc3a4-serviceca\") pod \"node-ca-bjwd8\" (UID: \"c0fdd204-e1ad-4de8-ab18-52ab672cc3a4\") " pod="openshift-image-registry/node-ca-bjwd8" Nov 02 21:52:37.309214 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.309091 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd77571d-49e8-4127-951a-f8a4412d8e43-konnectivity-ca\") pod \"konnectivity-agent-km4nc\" (UID: \"fd77571d-49e8-4127-951a-f8a4412d8e43\") " pod="kube-system/konnectivity-agent-km4nc" Nov 02 21:52:37.309214 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.309120 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e7658661-8ddc-4443-91d0-edeaab291256-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:52:37.309214 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.309144 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e7658661-8ddc-4443-91d0-edeaab291256-socket-dir\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:52:37.309214 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.309169 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/983b05f9-8574-4a23-b3de-951a68c553a1-hosts-file\") pod \"node-resolver-ck8br\" (UID: \"983b05f9-8574-4a23-b3de-951a68c553a1\") " pod="openshift-dns/node-resolver-ck8br" Nov 02 21:52:37.309214 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.309193 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnhnw\" (UniqueName: \"kubernetes.io/projected/983b05f9-8574-4a23-b3de-951a68c553a1-kube-api-access-wnhnw\") pod \"node-resolver-ck8br\" (UID: \"983b05f9-8574-4a23-b3de-951a68c553a1\") " pod="openshift-dns/node-resolver-ck8br" Nov 02 21:52:37.309431 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.309227 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/649dd5b0-1649-4f63-a148-40fd3f3e07f4-original-pull-secret\") pod \"global-pull-secret-syncer-vcx54\" (UID: \"649dd5b0-1649-4f63-a148-40fd3f3e07f4\") " pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:52:37.309431 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.309251 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e7658661-8ddc-4443-91d0-edeaab291256-registration-dir\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:52:37.309431 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.309274 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e7658661-8ddc-4443-91d0-edeaab291256-device-dir\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:52:37.309431 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.309296 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e7658661-8ddc-4443-91d0-edeaab291256-etc-selinux\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:52:37.309431 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.309326 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/649dd5b0-1649-4f63-a148-40fd3f3e07f4-dbus\") pod \"global-pull-secret-syncer-vcx54\" (UID: \"649dd5b0-1649-4f63-a148-40fd3f3e07f4\") " pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:52:37.309431 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.309348 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c0fdd204-e1ad-4de8-ab18-52ab672cc3a4-host\") pod \"node-ca-bjwd8\" (UID: \"c0fdd204-e1ad-4de8-ab18-52ab672cc3a4\") " pod="openshift-image-registry/node-ca-bjwd8" Nov 02 21:52:37.309431 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.309392 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7ccd\" (UniqueName: \"kubernetes.io/projected/c0fdd204-e1ad-4de8-ab18-52ab672cc3a4-kube-api-access-n7ccd\") pod \"node-ca-bjwd8\" (UID: \"c0fdd204-e1ad-4de8-ab18-52ab672cc3a4\") " pod="openshift-image-registry/node-ca-bjwd8" Nov 02 21:52:37.309683 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.309433 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/649dd5b0-1649-4f63-a148-40fd3f3e07f4-kubelet-config\") pod \"global-pull-secret-syncer-vcx54\" (UID: \"649dd5b0-1649-4f63-a148-40fd3f3e07f4\") " pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:52:37.309683 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.309458 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9d5c\" (UniqueName: \"kubernetes.io/projected/e7658661-8ddc-4443-91d0-edeaab291256-kube-api-access-p9d5c\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:52:37.309683 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.309491 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd77571d-49e8-4127-951a-f8a4412d8e43-agent-certs\") pod \"konnectivity-agent-km4nc\" (UID: \"fd77571d-49e8-4127-951a-f8a4412d8e43\") " pod="kube-system/konnectivity-agent-km4nc" Nov 02 21:52:37.309683 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.309531 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/983b05f9-8574-4a23-b3de-951a68c553a1-tmp-dir\") pod \"node-resolver-ck8br\" (UID: \"983b05f9-8574-4a23-b3de-951a68c553a1\") " pod="openshift-dns/node-resolver-ck8br" Nov 02 21:52:37.309683 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.309556 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e7658661-8ddc-4443-91d0-edeaab291256-sys-fs\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:52:37.309683 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.309566 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c0fdd204-e1ad-4de8-ab18-52ab672cc3a4-serviceca\") pod \"node-ca-bjwd8\" (UID: \"c0fdd204-e1ad-4de8-ab18-52ab672cc3a4\") " pod="openshift-image-registry/node-ca-bjwd8" Nov 02 21:52:37.309683 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.309649 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e7658661-8ddc-4443-91d0-edeaab291256-device-dir\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:52:37.309952 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.309710 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/649dd5b0-1649-4f63-a148-40fd3f3e07f4-dbus\") pod \"global-pull-secret-syncer-vcx54\" (UID: \"649dd5b0-1649-4f63-a148-40fd3f3e07f4\") " pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:52:37.309952 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.309842 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e7658661-8ddc-4443-91d0-edeaab291256-etc-selinux\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:52:37.309952 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.309873 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c0fdd204-e1ad-4de8-ab18-52ab672cc3a4-host\") pod \"node-ca-bjwd8\" (UID: \"c0fdd204-e1ad-4de8-ab18-52ab672cc3a4\") " pod="openshift-image-registry/node-ca-bjwd8" Nov 02 21:52:37.310142 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.310119 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd77571d-49e8-4127-951a-f8a4412d8e43-konnectivity-ca\") pod \"konnectivity-agent-km4nc\" (UID: \"fd77571d-49e8-4127-951a-f8a4412d8e43\") " pod="kube-system/konnectivity-agent-km4nc" Nov 02 21:52:37.310210 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.310188 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e7658661-8ddc-4443-91d0-edeaab291256-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:52:37.310265 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.310239 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/649dd5b0-1649-4f63-a148-40fd3f3e07f4-kubelet-config\") pod \"global-pull-secret-syncer-vcx54\" (UID: \"649dd5b0-1649-4f63-a148-40fd3f3e07f4\") " pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:52:37.310456 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:37.310435 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 02 21:52:37.310527 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.310476 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e7658661-8ddc-4443-91d0-edeaab291256-registration-dir\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:52:37.310527 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:37.310489 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/649dd5b0-1649-4f63-a148-40fd3f3e07f4-original-pull-secret podName:649dd5b0-1649-4f63-a148-40fd3f3e07f4 nodeName:}" failed. No retries permitted until 2026-11-02 21:52:37.810474653 +0000 UTC m=+3.141058004 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/649dd5b0-1649-4f63-a148-40fd3f3e07f4-original-pull-secret") pod "global-pull-secret-syncer-vcx54" (UID: "649dd5b0-1649-4f63-a148-40fd3f3e07f4") : object "kube-system"/"original-pull-secret" not registered Nov 02 21:52:37.310647 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.309652 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e7658661-8ddc-4443-91d0-edeaab291256-sys-fs\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:52:37.310647 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.310629 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/983b05f9-8574-4a23-b3de-951a68c553a1-hosts-file\") pod \"node-resolver-ck8br\" (UID: \"983b05f9-8574-4a23-b3de-951a68c553a1\") " pod="openshift-dns/node-resolver-ck8br" Nov 02 21:52:37.310922 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.310897 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e7658661-8ddc-4443-91d0-edeaab291256-socket-dir\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:52:37.311109 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.311084 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/983b05f9-8574-4a23-b3de-951a68c553a1-tmp-dir\") pod \"node-resolver-ck8br\" (UID: \"983b05f9-8574-4a23-b3de-951a68c553a1\") " pod="openshift-dns/node-resolver-ck8br" Nov 02 21:52:37.314134 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.314032 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd77571d-49e8-4127-951a-f8a4412d8e43-agent-certs\") pod \"konnectivity-agent-km4nc\" (UID: \"fd77571d-49e8-4127-951a-f8a4412d8e43\") " pod="kube-system/konnectivity-agent-km4nc" Nov 02 21:52:37.324708 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.324685 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7ccd\" (UniqueName: \"kubernetes.io/projected/c0fdd204-e1ad-4de8-ab18-52ab672cc3a4-kube-api-access-n7ccd\") pod \"node-ca-bjwd8\" (UID: \"c0fdd204-e1ad-4de8-ab18-52ab672cc3a4\") " pod="openshift-image-registry/node-ca-bjwd8" Nov 02 21:52:37.324872 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.324847 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnhnw\" (UniqueName: \"kubernetes.io/projected/983b05f9-8574-4a23-b3de-951a68c553a1-kube-api-access-wnhnw\") pod \"node-resolver-ck8br\" (UID: \"983b05f9-8574-4a23-b3de-951a68c553a1\") " pod="openshift-dns/node-resolver-ck8br" Nov 02 21:52:37.325676 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.325204 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9d5c\" (UniqueName: \"kubernetes.io/projected/e7658661-8ddc-4443-91d0-edeaab291256-kube-api-access-p9d5c\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:52:37.389343 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.389305 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kwr6l" Nov 02 21:52:37.410119 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.410050 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kbrwm" Nov 02 21:52:37.413033 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.413008 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:52:37.421514 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:37.421486 2569 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bdd0bfc_5731_4aaa_8aea_d805a8ff0d34.slice/crio-677ad3e7f4a3f85fe674245da968f88dcf453ef09002af72d9e89c9314b4e283 WatchSource:0}: Error finding container 677ad3e7f4a3f85fe674245da968f88dcf453ef09002af72d9e89c9314b4e283: Status 404 returned error can't find the container with id 677ad3e7f4a3f85fe674245da968f88dcf453ef09002af72d9e89c9314b4e283 Nov 02 21:52:37.424042 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:37.424015 2569 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a806bb_6e90_479d_8f94_d9915b47cbde.slice/crio-917b680b6a8034f28d5adcd0a2daad9f2899a4d72cdb931b4f044ef6e0000732 WatchSource:0}: Error finding container 917b680b6a8034f28d5adcd0a2daad9f2899a4d72cdb931b4f044ef6e0000732: Status 404 returned error can't find the container with id 917b680b6a8034f28d5adcd0a2daad9f2899a4d72cdb931b4f044ef6e0000732 Nov 02 21:52:37.425891 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.425871 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:52:37.427935 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.427897 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ck8br" Nov 02 21:52:37.436196 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.436173 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:37.438236 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.438188 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bjwd8" Nov 02 21:52:37.438985 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:37.438960 2569 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e2913f2_f166_4ce6_b93b_cea606008bba.slice/crio-9753892cc5adc09f1ad0a82ad64d7681de9d17103160e2ed899d9573b1402d2f WatchSource:0}: Error finding container 9753892cc5adc09f1ad0a82ad64d7681de9d17103160e2ed899d9573b1402d2f: Status 404 returned error can't find the container with id 9753892cc5adc09f1ad0a82ad64d7681de9d17103160e2ed899d9573b1402d2f Nov 02 21:52:37.443497 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:37.443471 2569 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod983b05f9_8574_4a23_b3de_951a68c553a1.slice/crio-ea5fccd4474977471ef68389849a0ebd56b1ad2e99e79b8f4f49d651ef6af6f6 WatchSource:0}: Error finding container ea5fccd4474977471ef68389849a0ebd56b1ad2e99e79b8f4f49d651ef6af6f6: Status 404 returned error can't find the container with id ea5fccd4474977471ef68389849a0ebd56b1ad2e99e79b8f4f49d651ef6af6f6 Nov 02 21:52:37.449366 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.449344 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-km4nc" Nov 02 21:52:37.449884 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:37.449860 2569 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode011b0d4_3387_4b79_9a3f_b3fac185c126.slice/crio-558b386bac0a04c1c81fa904b658128a1530a435a226d307b63c4b9611cee112 WatchSource:0}: Error finding container 558b386bac0a04c1c81fa904b658128a1530a435a226d307b63c4b9611cee112: Status 404 returned error can't find the container with id 558b386bac0a04c1c81fa904b658128a1530a435a226d307b63c4b9611cee112 Nov 02 21:52:37.452457 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:37.452433 2569 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0fdd204_e1ad_4de8_ab18_52ab672cc3a4.slice/crio-1a280937337ffdfc84a36b3b3fca9664c8a362c5736abc011890fec2672f283d WatchSource:0}: Error finding container 1a280937337ffdfc84a36b3b3fca9664c8a362c5736abc011890fec2672f283d: Status 404 returned error can't find the container with id 1a280937337ffdfc84a36b3b3fca9664c8a362c5736abc011890fec2672f283d Nov 02 21:52:37.458703 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.458672 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:52:37.460563 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:52:37.460539 2569 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd77571d_49e8_4127_951a_f8a4412d8e43.slice/crio-7aef818a8d6fb609cd74e4d5049534a199a24e35cbed217de7b76ba4649a9546 WatchSource:0}: Error finding container 7aef818a8d6fb609cd74e4d5049534a199a24e35cbed217de7b76ba4649a9546: Status 404 returned error can't find the container with id 7aef818a8d6fb609cd74e4d5049534a199a24e35cbed217de7b76ba4649a9546 Nov 02 21:52:37.712426 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.712326 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84467c9f-0161-4e44-9420-dcc224215f05-metrics-certs\") pod \"network-metrics-daemon-gzkfr\" (UID: \"84467c9f-0161-4e44-9420-dcc224215f05\") " pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:52:37.712611 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:37.712495 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 02 21:52:37.712611 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:37.712566 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84467c9f-0161-4e44-9420-dcc224215f05-metrics-certs podName:84467c9f-0161-4e44-9420-dcc224215f05 nodeName:}" failed. No retries permitted until 2026-11-02 21:52:38.712546478 +0000 UTC m=+4.043129804 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/84467c9f-0161-4e44-9420-dcc224215f05-metrics-certs") pod "network-metrics-daemon-gzkfr" (UID: "84467c9f-0161-4e44-9420-dcc224215f05") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 02 21:52:37.813446 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.813409 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/649dd5b0-1649-4f63-a148-40fd3f3e07f4-original-pull-secret\") pod \"global-pull-secret-syncer-vcx54\" (UID: \"649dd5b0-1649-4f63-a148-40fd3f3e07f4\") " pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:52:37.813618 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:37.813471 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsdqt\" (UniqueName: \"kubernetes.io/projected/87451849-2618-4958-bc4a-114cc208434e-kube-api-access-fsdqt\") pod \"network-check-target-747nn\" (UID: \"87451849-2618-4958-bc4a-114cc208434e\") " pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:52:37.813618 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:37.813613 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 02 21:52:37.813719 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:37.813627 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 02 21:52:37.813719 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:37.813637 2569 projected.go:196] Error preparing data for projected volume kube-api-access-fsdqt for pod openshift-network-diagnostics/network-check-target-747nn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 02 21:52:37.813719 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:37.813691 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87451849-2618-4958-bc4a-114cc208434e-kube-api-access-fsdqt podName:87451849-2618-4958-bc4a-114cc208434e nodeName:}" failed. No retries permitted until 2026-11-02 21:52:38.813673362 +0000 UTC m=+4.144256678 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fsdqt" (UniqueName: "kubernetes.io/projected/87451849-2618-4958-bc4a-114cc208434e-kube-api-access-fsdqt") pod "network-check-target-747nn" (UID: "87451849-2618-4958-bc4a-114cc208434e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 02 21:52:37.813898 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:37.813841 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 02 21:52:37.813940 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:37.813911 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/649dd5b0-1649-4f63-a148-40fd3f3e07f4-original-pull-secret podName:649dd5b0-1649-4f63-a148-40fd3f3e07f4 nodeName:}" failed. No retries permitted until 2026-11-02 21:52:38.813897006 +0000 UTC m=+4.144480306 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/649dd5b0-1649-4f63-a148-40fd3f3e07f4-original-pull-secret") pod "global-pull-secret-syncer-vcx54" (UID: "649dd5b0-1649-4f63-a148-40fd3f3e07f4") : object "kube-system"/"original-pull-secret" not registered Nov 02 21:52:38.141990 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:38.141924 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-01 21:47:38 +0000 UTC" deadline="2028-06-05 11:10:58.286623694 +0000 UTC" Nov 02 21:52:38.141990 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:38.141988 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13933h18m20.144639865s" Nov 02 21:52:38.294906 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:38.294859 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" event={"ID":"e7658661-8ddc-4443-91d0-edeaab291256","Type":"ContainerStarted","Data":"217f56323a79c3e1ca3bfb72dfbcbd780ca055ccb1e4f40df66d0a9825a7ccc3"} Nov 02 21:52:38.314756 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:38.314683 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bjwd8" event={"ID":"c0fdd204-e1ad-4de8-ab18-52ab672cc3a4","Type":"ContainerStarted","Data":"1a280937337ffdfc84a36b3b3fca9664c8a362c5736abc011890fec2672f283d"} Nov 02 21:52:38.316841 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:38.316804 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g996m" event={"ID":"e011b0d4-3387-4b79-9a3f-b3fac185c126","Type":"ContainerStarted","Data":"558b386bac0a04c1c81fa904b658128a1530a435a226d307b63c4b9611cee112"} Nov 02 21:52:38.325369 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:38.325325 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-km4nc" event={"ID":"fd77571d-49e8-4127-951a-f8a4412d8e43","Type":"ContainerStarted","Data":"7aef818a8d6fb609cd74e4d5049534a199a24e35cbed217de7b76ba4649a9546"} Nov 02 21:52:38.337652 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:38.337612 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ck8br" event={"ID":"983b05f9-8574-4a23-b3de-951a68c553a1","Type":"ContainerStarted","Data":"ea5fccd4474977471ef68389849a0ebd56b1ad2e99e79b8f4f49d651ef6af6f6"} Nov 02 21:52:38.355764 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:38.354316 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" event={"ID":"2e2913f2-f166-4ce6-b93b-cea606008bba","Type":"ContainerStarted","Data":"9753892cc5adc09f1ad0a82ad64d7681de9d17103160e2ed899d9573b1402d2f"} Nov 02 21:52:38.362036 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:38.361984 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5mtfp" event={"ID":"15a806bb-6e90-479d-8f94-d9915b47cbde","Type":"ContainerStarted","Data":"917b680b6a8034f28d5adcd0a2daad9f2899a4d72cdb931b4f044ef6e0000732"} Nov 02 21:52:38.372430 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:38.372335 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kbrwm" event={"ID":"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34","Type":"ContainerStarted","Data":"677ad3e7f4a3f85fe674245da968f88dcf453ef09002af72d9e89c9314b4e283"} Nov 02 21:52:38.397145 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:38.397051 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kwr6l" event={"ID":"41a3e68b-3746-48ca-89c7-99347353fb8b","Type":"ContainerStarted","Data":"999df1dddddc5ec92ae1e4b7737620325724e656c49d382a324e842d76d58a10"} Nov 02 21:52:38.722262 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:38.722178 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84467c9f-0161-4e44-9420-dcc224215f05-metrics-certs\") pod \"network-metrics-daemon-gzkfr\" (UID: \"84467c9f-0161-4e44-9420-dcc224215f05\") " pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:52:38.722427 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:38.722355 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 02 21:52:38.722427 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:38.722425 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84467c9f-0161-4e44-9420-dcc224215f05-metrics-certs podName:84467c9f-0161-4e44-9420-dcc224215f05 nodeName:}" failed. No retries permitted until 2026-11-02 21:52:40.722405959 +0000 UTC m=+6.052989264 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/84467c9f-0161-4e44-9420-dcc224215f05-metrics-certs") pod "network-metrics-daemon-gzkfr" (UID: "84467c9f-0161-4e44-9420-dcc224215f05") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 02 21:52:38.824434 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:38.823577 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsdqt\" (UniqueName: \"kubernetes.io/projected/87451849-2618-4958-bc4a-114cc208434e-kube-api-access-fsdqt\") pod \"network-check-target-747nn\" (UID: \"87451849-2618-4958-bc4a-114cc208434e\") " pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:52:38.824434 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:38.823648 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/649dd5b0-1649-4f63-a148-40fd3f3e07f4-original-pull-secret\") pod \"global-pull-secret-syncer-vcx54\" (UID: \"649dd5b0-1649-4f63-a148-40fd3f3e07f4\") " pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:52:38.824434 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:38.823811 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 02 21:52:38.824434 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:38.823877 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/649dd5b0-1649-4f63-a148-40fd3f3e07f4-original-pull-secret podName:649dd5b0-1649-4f63-a148-40fd3f3e07f4 nodeName:}" failed. No retries permitted until 2026-11-02 21:52:40.823858552 +0000 UTC m=+6.154441857 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/649dd5b0-1649-4f63-a148-40fd3f3e07f4-original-pull-secret") pod "global-pull-secret-syncer-vcx54" (UID: "649dd5b0-1649-4f63-a148-40fd3f3e07f4") : object "kube-system"/"original-pull-secret" not registered Nov 02 21:52:38.824434 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:38.824311 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 02 21:52:38.824434 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:38.824333 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 02 21:52:38.824434 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:38.824346 2569 projected.go:196] Error preparing data for projected volume kube-api-access-fsdqt for pod openshift-network-diagnostics/network-check-target-747nn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 02 21:52:38.824434 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:38.824394 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87451849-2618-4958-bc4a-114cc208434e-kube-api-access-fsdqt podName:87451849-2618-4958-bc4a-114cc208434e nodeName:}" failed. No retries permitted until 2026-11-02 21:52:40.824379316 +0000 UTC m=+6.154962626 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fsdqt" (UniqueName: "kubernetes.io/projected/87451849-2618-4958-bc4a-114cc208434e-kube-api-access-fsdqt") pod "network-check-target-747nn" (UID: "87451849-2618-4958-bc4a-114cc208434e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 02 21:52:39.142895 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:39.142617 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-01 21:47:38 +0000 UTC" deadline="2028-07-05 14:02:20.182013224 +0000 UTC" Nov 02 21:52:39.142895 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:39.142892 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14656h9m41.039126327s" Nov 02 21:52:39.279650 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:39.278905 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:52:39.279650 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:39.279025 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-747nn" podUID="87451849-2618-4958-bc4a-114cc208434e" Nov 02 21:52:39.279650 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:39.279398 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:52:39.279650 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:39.279472 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzkfr" podUID="84467c9f-0161-4e44-9420-dcc224215f05" Nov 02 21:52:39.279650 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:39.279501 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:52:39.279650 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:39.279594 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vcx54" podUID="649dd5b0-1649-4f63-a148-40fd3f3e07f4" Nov 02 21:52:39.410031 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:39.409992 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal" event={"ID":"495aa330bd161682551682a6af54a40f","Type":"ContainerStarted","Data":"8308e43645ec4ef17fa489b26333631c47f55c9ec5ebe660f195c8b2c4a5fc55"} Nov 02 21:52:39.415184 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:39.415150 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-99.us-east-2.compute.internal" event={"ID":"de883a853e4817557c8c217fade4c52e","Type":"ContainerStarted","Data":"f18eb8305c9dfdcdda725077094b31a7069c058898dc938c3691c18b521fa0ec"} Nov 02 21:52:40.427710 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:40.426964 2569 generic.go:356] "Generic (PLEG): container finished" podID="495aa330bd161682551682a6af54a40f" containerID="8308e43645ec4ef17fa489b26333631c47f55c9ec5ebe660f195c8b2c4a5fc55" exitCode=0 Nov 02 21:52:40.428113 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:40.428060 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal" event={"ID":"495aa330bd161682551682a6af54a40f","Type":"ContainerDied","Data":"8308e43645ec4ef17fa489b26333631c47f55c9ec5ebe660f195c8b2c4a5fc55"} Nov 02 21:52:40.457222 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:40.457157 2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-99.us-east-2.compute.internal" podStartSLOduration=3.457136635 podStartE2EDuration="3.457136635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 21:52:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:52:39.447865555 +0000 UTC m=+4.778448885" watchObservedRunningTime="2026-11-02 21:52:40.457136635 +0000 UTC m=+5.787719962" Nov 02 21:52:40.738011 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:40.737739 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84467c9f-0161-4e44-9420-dcc224215f05-metrics-certs\") pod \"network-metrics-daemon-gzkfr\" (UID: \"84467c9f-0161-4e44-9420-dcc224215f05\") " pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:52:40.738983 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:40.737977 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 02 21:52:40.738983 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:40.738492 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84467c9f-0161-4e44-9420-dcc224215f05-metrics-certs podName:84467c9f-0161-4e44-9420-dcc224215f05 nodeName:}" failed. No retries permitted until 2026-11-02 21:52:44.738470107 +0000 UTC m=+10.069053434 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/84467c9f-0161-4e44-9420-dcc224215f05-metrics-certs") pod "network-metrics-daemon-gzkfr" (UID: "84467c9f-0161-4e44-9420-dcc224215f05") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 02 21:52:40.840252 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:40.839368 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/649dd5b0-1649-4f63-a148-40fd3f3e07f4-original-pull-secret\") pod \"global-pull-secret-syncer-vcx54\" (UID: \"649dd5b0-1649-4f63-a148-40fd3f3e07f4\") " pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:52:40.840252 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:40.839462 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsdqt\" (UniqueName: \"kubernetes.io/projected/87451849-2618-4958-bc4a-114cc208434e-kube-api-access-fsdqt\") pod \"network-check-target-747nn\" (UID: \"87451849-2618-4958-bc4a-114cc208434e\") " pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:52:40.840252 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:40.839627 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 02 21:52:40.840252 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:40.839647 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 02 21:52:40.840252 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:40.839661 2569 projected.go:196] Error preparing data for projected volume kube-api-access-fsdqt for pod openshift-network-diagnostics/network-check-target-747nn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 02 21:52:40.840252 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:40.839748 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87451849-2618-4958-bc4a-114cc208434e-kube-api-access-fsdqt podName:87451849-2618-4958-bc4a-114cc208434e nodeName:}" failed. No retries permitted until 2026-11-02 21:52:44.839728102 +0000 UTC m=+10.170311422 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fsdqt" (UniqueName: "kubernetes.io/projected/87451849-2618-4958-bc4a-114cc208434e-kube-api-access-fsdqt") pod "network-check-target-747nn" (UID: "87451849-2618-4958-bc4a-114cc208434e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 02 21:52:40.840252 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:40.840163 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 02 21:52:40.840252 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:40.840213 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/649dd5b0-1649-4f63-a148-40fd3f3e07f4-original-pull-secret podName:649dd5b0-1649-4f63-a148-40fd3f3e07f4 nodeName:}" failed. No retries permitted until 2026-11-02 21:52:44.840198672 +0000 UTC m=+10.170781978 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/649dd5b0-1649-4f63-a148-40fd3f3e07f4-original-pull-secret") pod "global-pull-secret-syncer-vcx54" (UID: "649dd5b0-1649-4f63-a148-40fd3f3e07f4") : object "kube-system"/"original-pull-secret" not registered Nov 02 21:52:41.278899 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:41.278863 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:52:41.279125 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:41.278911 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:52:41.279125 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:41.278998 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-747nn" podUID="87451849-2618-4958-bc4a-114cc208434e" Nov 02 21:52:41.279125 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:41.279081 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:52:41.279348 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:41.279184 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vcx54" podUID="649dd5b0-1649-4f63-a148-40fd3f3e07f4" Nov 02 21:52:41.279348 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:41.279280 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzkfr" podUID="84467c9f-0161-4e44-9420-dcc224215f05" Nov 02 21:52:41.442537 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:41.442497 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal" event={"ID":"495aa330bd161682551682a6af54a40f","Type":"ContainerStarted","Data":"81fb46ab95eb53abe25a0bfed13a0233e2b5c72d5970ac90d6592bca82e49865"} Nov 02 21:52:41.450101 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:41.450024 2569 generic.go:356] "Generic (PLEG): container finished" podID="15a806bb-6e90-479d-8f94-d9915b47cbde" containerID="f1936ef66fc0e02512f75c5ac76104a3087d5d43146f05a8ae7c01dbad5644d7" exitCode=0 Nov 02 21:52:41.450829 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:41.450786 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5mtfp" event={"ID":"15a806bb-6e90-479d-8f94-d9915b47cbde","Type":"ContainerDied","Data":"f1936ef66fc0e02512f75c5ac76104a3087d5d43146f05a8ae7c01dbad5644d7"} Nov 02 21:52:41.493103 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:41.493038 2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal" podStartSLOduration=4.493019154 podStartE2EDuration="4.493019154s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 21:52:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:52:41.464973284 +0000 UTC m=+6.795556606" watchObservedRunningTime="2026-11-02 21:52:41.493019154 +0000 UTC m=+6.823602508" Nov 02 21:52:42.457872 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:42.457799 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-km4nc" event={"ID":"fd77571d-49e8-4127-951a-f8a4412d8e43","Type":"ContainerStarted","Data":"a237cfded0cfbae225a55ae7eabba4c50e6295007cd7770e1c4611f61bc0b8fa"} Nov 02 21:52:43.280569 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:43.280493 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:52:43.280764 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:43.280635 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-747nn" podUID="87451849-2618-4958-bc4a-114cc208434e" Nov 02 21:52:43.280764 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:43.280711 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:52:43.280880 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:43.280818 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzkfr" podUID="84467c9f-0161-4e44-9420-dcc224215f05" Nov 02 21:52:43.280880 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:43.280864 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:52:43.280989 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:43.280930 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vcx54" podUID="649dd5b0-1649-4f63-a148-40fd3f3e07f4" Nov 02 21:52:43.465773 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:43.465716 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bjwd8" event={"ID":"c0fdd204-e1ad-4de8-ab18-52ab672cc3a4","Type":"ContainerStarted","Data":"05f1674e6a544ec5ae0a63f27dfab944a1d49641d7217ace7611ec71434675f6"} Nov 02 21:52:43.483099 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:43.483038 2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-km4nc" podStartSLOduration=3.4980275 podStartE2EDuration="7.48301722s" totalImagesPullingTime="3.98498972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 21:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:52:42.478104039 +0000 UTC m=+7.808687364" watchObservedRunningTime="2026-11-02 21:52:43.48301722 +0000 UTC m=+8.813600546" Nov 02 21:52:44.470450 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:44.470413 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" event={"ID":"e7658661-8ddc-4443-91d0-edeaab291256","Type":"ContainerStarted","Data":"4bcb649fcfae0399f75e9c37ee6ca6ff296d6770884d2b88a5a7579ed6955215"} Nov 02 21:52:44.635035 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:44.634336 2569 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-km4nc" Nov 02 21:52:44.636085 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:44.635876 2569 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-km4nc" Nov 02 21:52:44.655031 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:44.653635 2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bjwd8" podStartSLOduration=3.104359918 podStartE2EDuration="8.653615111s" totalImagesPullingTime="5.549255193s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 21:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:52:43.483954232 +0000 UTC m=+8.814537559" watchObservedRunningTime="2026-11-02 21:52:44.653615111 +0000 UTC m=+9.984198437" Nov 02 21:52:44.774218 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:44.773350 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84467c9f-0161-4e44-9420-dcc224215f05-metrics-certs\") pod \"network-metrics-daemon-gzkfr\" (UID: \"84467c9f-0161-4e44-9420-dcc224215f05\") " pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:52:44.774218 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:44.773631 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 02 21:52:44.774218 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:44.773728 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84467c9f-0161-4e44-9420-dcc224215f05-metrics-certs podName:84467c9f-0161-4e44-9420-dcc224215f05 nodeName:}" failed. No retries permitted until 2026-11-02 21:52:52.773682612 +0000 UTC m=+18.104265927 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/84467c9f-0161-4e44-9420-dcc224215f05-metrics-certs") pod "network-metrics-daemon-gzkfr" (UID: "84467c9f-0161-4e44-9420-dcc224215f05") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 02 21:52:44.876263 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:44.875338 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsdqt\" (UniqueName: \"kubernetes.io/projected/87451849-2618-4958-bc4a-114cc208434e-kube-api-access-fsdqt\") pod \"network-check-target-747nn\" (UID: \"87451849-2618-4958-bc4a-114cc208434e\") " pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:52:44.876263 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:44.875410 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/649dd5b0-1649-4f63-a148-40fd3f3e07f4-original-pull-secret\") pod \"global-pull-secret-syncer-vcx54\" (UID: \"649dd5b0-1649-4f63-a148-40fd3f3e07f4\") " pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:52:44.876263 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:44.875567 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 02 21:52:44.876263 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:44.875640 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/649dd5b0-1649-4f63-a148-40fd3f3e07f4-original-pull-secret podName:649dd5b0-1649-4f63-a148-40fd3f3e07f4 nodeName:}" failed. No retries permitted until 2026-11-02 21:52:52.875620472 +0000 UTC m=+18.206203789 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/649dd5b0-1649-4f63-a148-40fd3f3e07f4-original-pull-secret") pod "global-pull-secret-syncer-vcx54" (UID: "649dd5b0-1649-4f63-a148-40fd3f3e07f4") : object "kube-system"/"original-pull-secret" not registered Nov 02 21:52:44.876263 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:44.876135 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 02 21:52:44.876263 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:44.876159 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 02 21:52:44.876263 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:44.876173 2569 projected.go:196] Error preparing data for projected volume kube-api-access-fsdqt for pod openshift-network-diagnostics/network-check-target-747nn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 02 21:52:44.876263 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:44.876224 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87451849-2618-4958-bc4a-114cc208434e-kube-api-access-fsdqt podName:87451849-2618-4958-bc4a-114cc208434e nodeName:}" failed. No retries permitted until 2026-11-02 21:52:52.876207826 +0000 UTC m=+18.206791146 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fsdqt" (UniqueName: "kubernetes.io/projected/87451849-2618-4958-bc4a-114cc208434e-kube-api-access-fsdqt") pod "network-check-target-747nn" (UID: "87451849-2618-4958-bc4a-114cc208434e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 02 21:52:45.279127 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:45.279090 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:52:45.279295 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:45.279212 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vcx54" podUID="649dd5b0-1649-4f63-a148-40fd3f3e07f4" Nov 02 21:52:45.279702 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:45.279647 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:52:45.280002 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:45.279770 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-747nn" podUID="87451849-2618-4958-bc4a-114cc208434e" Nov 02 21:52:45.280002 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:45.279841 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:52:45.280002 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:45.279933 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzkfr" podUID="84467c9f-0161-4e44-9420-dcc224215f05" Nov 02 21:52:45.491973 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:45.491929 2569 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Nov 02 21:52:46.176153 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:46.175810 2569 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-02T21:52:45.491955514Z","UUID":"cf1b158c-cf4b-4b86-a014-16ab69d207e7","Handler":null,"Name":"","Endpoint":""} Nov 02 21:52:46.178323 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:46.177942 2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Nov 02 21:52:46.178323 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:46.177975 2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Nov 02 21:52:46.479367 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:46.479320 2569 generic.go:356] "Generic (PLEG): container finished" podID="15a806bb-6e90-479d-8f94-d9915b47cbde" containerID="e8d94e9522964293492cf1fd2d3b73a3fcd74b5717c04aba938b53f2c910fa09" exitCode=0 Nov 02 21:52:46.479526 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:46.479411 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5mtfp" event={"ID":"15a806bb-6e90-479d-8f94-d9915b47cbde","Type":"ContainerDied","Data":"e8d94e9522964293492cf1fd2d3b73a3fcd74b5717c04aba938b53f2c910fa09"} Nov 02 21:52:46.482186 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:46.482155 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kbrwm" event={"ID":"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34","Type":"ContainerStarted","Data":"f710b35e94543daf2396913a4c313ecb81a7f78ff3a96e5445e9cbb9f1cad8dd"} Nov 02 21:52:46.486115 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:46.486045 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" event={"ID":"e7658661-8ddc-4443-91d0-edeaab291256","Type":"ContainerStarted","Data":"71404f4692ba10964095c2441071734e03d8532655a87348f2c355026dad07df"} Nov 02 21:52:46.487770 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:46.487749 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ck8br" event={"ID":"983b05f9-8574-4a23-b3de-951a68c553a1","Type":"ContainerStarted","Data":"f0ebcb80af6058f7aa673dbb83368160f665b86e6be26588e2a3ca78d74e0655"} Nov 02 21:52:46.526860 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:46.526384 2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-kbrwm" podStartSLOduration=2.177461791 podStartE2EDuration="10.526363289s" totalImagesPullingTime="8.348901498s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 21:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:52:46.525800312 +0000 UTC m=+11.856383637" watchObservedRunningTime="2026-11-02 21:52:46.526363289 +0000 UTC m=+11.856946615" Nov 02 21:52:47.278381 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:47.278344 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:52:47.278572 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:47.278426 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:52:47.278572 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:47.278533 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:52:47.278572 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:47.278556 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vcx54" podUID="649dd5b0-1649-4f63-a148-40fd3f3e07f4" Nov 02 21:52:47.278770 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:47.278652 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzkfr" podUID="84467c9f-0161-4e44-9420-dcc224215f05" Nov 02 21:52:47.278821 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:47.278764 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-747nn" podUID="87451849-2618-4958-bc4a-114cc208434e" Nov 02 21:52:47.494191 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:47.494142 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" event={"ID":"e7658661-8ddc-4443-91d0-edeaab291256","Type":"ContainerStarted","Data":"e1b2390a90fca4291a7d8793d24c38a0e2f2ba8f34c2464556b12a037cbab8e6"} Nov 02 21:52:47.534180 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:47.534119 2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" podStartSLOduration=2.756557629 podStartE2EDuration="11.534103764s" totalImagesPullingTime="8.777546135s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 21:52:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:52:47.533394701 +0000 UTC m=+12.863978024" watchObservedRunningTime="2026-11-02 21:52:47.534103764 +0000 UTC m=+12.864687147" Nov 02 21:52:47.534761 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:47.534275 2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-ck8br" podStartSLOduration=3.215819812 podStartE2EDuration="11.534267698s" totalImagesPullingTime="8.318447886s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 21:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:52:46.544882553 +0000 UTC m=+11.875465881" watchObservedRunningTime="2026-11-02 21:52:47.534267698 +0000 UTC m=+12.864851026" Nov 02 21:52:48.501226 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:48.501190 2569 generic.go:356] "Generic (PLEG): container finished" podID="15a806bb-6e90-479d-8f94-d9915b47cbde" containerID="2c7f42e3f3cda59d741914494c40405cb35f01d75556e0dec9e2c4d53fe5a0dc" exitCode=0 Nov 02 21:52:48.501378 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:48.501296 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5mtfp" event={"ID":"15a806bb-6e90-479d-8f94-d9915b47cbde","Type":"ContainerDied","Data":"2c7f42e3f3cda59d741914494c40405cb35f01d75556e0dec9e2c4d53fe5a0dc"} Nov 02 21:52:48.503118 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:48.503075 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kwr6l" event={"ID":"41a3e68b-3746-48ca-89c7-99347353fb8b","Type":"ContainerStarted","Data":"9d200d9fab71f763924ec673ac7696e86b434e8d689e6d9483dddc623e7c29f5"} Nov 02 21:52:48.554860 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:48.554798 2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kwr6l" podStartSLOduration=3.76425755 podStartE2EDuration="12.554780587s" totalImagesPullingTime="8.790523037s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 21:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:52:48.554155691 +0000 UTC m=+13.884739015" watchObservedRunningTime="2026-11-02 21:52:48.554780587 +0000 UTC m=+13.885363911" Nov 02 21:52:49.278767 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:49.278722 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:52:49.278767 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:49.278753 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:52:49.278968 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:49.278722 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:52:49.278968 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:49.278850 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vcx54" podUID="649dd5b0-1649-4f63-a148-40fd3f3e07f4" Nov 02 21:52:49.278968 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:49.278904 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzkfr" podUID="84467c9f-0161-4e44-9420-dcc224215f05" Nov 02 21:52:49.278968 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:49.278963 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-747nn" podUID="87451849-2618-4958-bc4a-114cc208434e" Nov 02 21:52:49.342350 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:49.342316 2569 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-km4nc" Nov 02 21:52:49.342524 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:49.342454 2569 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 02 21:52:49.343124 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:49.343099 2569 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-km4nc" Nov 02 21:52:49.507227 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:49.507161 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" event={"ID":"2e2913f2-f166-4ce6-b93b-cea606008bba","Type":"ContainerStarted","Data":"35202de16667478a490f7e71c13e035b1d836c3f6d1fea5df201a7cb80670016"} Nov 02 21:52:49.527374 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:49.527325 2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" podStartSLOduration=2.55216537 podStartE2EDuration="13.527311588s" totalImagesPullingTime="10.975146218s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 21:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:52:49.526741664 +0000 UTC m=+14.857325004" watchObservedRunningTime="2026-11-02 21:52:49.527311588 +0000 UTC m=+14.857894908" Nov 02 21:52:50.511329 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:50.511296 2569 generic.go:356] "Generic (PLEG): container finished" podID="15a806bb-6e90-479d-8f94-d9915b47cbde" containerID="0628aaf5748970e05c44be500eb803c60e839c16d7ca689575375e456fa65b17" exitCode=0 Nov 02 21:52:50.511992 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:50.511368 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5mtfp" event={"ID":"15a806bb-6e90-479d-8f94-d9915b47cbde","Type":"ContainerDied","Data":"0628aaf5748970e05c44be500eb803c60e839c16d7ca689575375e456fa65b17"} Nov 02 21:52:51.278784 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:51.278553 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:52:51.278983 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:51.278560 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:52:51.278983 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:51.278883 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vcx54" podUID="649dd5b0-1649-4f63-a148-40fd3f3e07f4" Nov 02 21:52:51.279097 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:51.278980 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzkfr" podUID="84467c9f-0161-4e44-9420-dcc224215f05" Nov 02 21:52:51.279097 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:51.278612 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:52:51.279097 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:51.279064 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-747nn" podUID="87451849-2618-4958-bc4a-114cc208434e" Nov 02 21:52:52.858481 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:52.858445 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84467c9f-0161-4e44-9420-dcc224215f05-metrics-certs\") pod \"network-metrics-daemon-gzkfr\" (UID: \"84467c9f-0161-4e44-9420-dcc224215f05\") " pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:52:52.858910 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:52.858560 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 02 21:52:52.858910 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:52.858612 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84467c9f-0161-4e44-9420-dcc224215f05-metrics-certs podName:84467c9f-0161-4e44-9420-dcc224215f05 nodeName:}" failed. No retries permitted until 2026-11-02 21:53:08.858600725 +0000 UTC m=+34.189184025 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/84467c9f-0161-4e44-9420-dcc224215f05-metrics-certs") pod "network-metrics-daemon-gzkfr" (UID: "84467c9f-0161-4e44-9420-dcc224215f05") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 02 21:52:52.958930 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:52.958904 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsdqt\" (UniqueName: \"kubernetes.io/projected/87451849-2618-4958-bc4a-114cc208434e-kube-api-access-fsdqt\") pod \"network-check-target-747nn\" (UID: \"87451849-2618-4958-bc4a-114cc208434e\") " pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:52:52.959069 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:52.958944 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/649dd5b0-1649-4f63-a148-40fd3f3e07f4-original-pull-secret\") pod \"global-pull-secret-syncer-vcx54\" (UID: \"649dd5b0-1649-4f63-a148-40fd3f3e07f4\") " pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:52:52.959069 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:52.959049 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 02 21:52:52.959174 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:52.959072 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 02 21:52:52.959174 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:52.959094 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 02 21:52:52.959174 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:52.959107 2569 projected.go:196] Error preparing data for projected volume kube-api-access-fsdqt for pod openshift-network-diagnostics/network-check-target-747nn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 02 21:52:52.959174 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:52.959097 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/649dd5b0-1649-4f63-a148-40fd3f3e07f4-original-pull-secret podName:649dd5b0-1649-4f63-a148-40fd3f3e07f4 nodeName:}" failed. No retries permitted until 2026-11-02 21:53:08.959085755 +0000 UTC m=+34.289669055 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/649dd5b0-1649-4f63-a148-40fd3f3e07f4-original-pull-secret") pod "global-pull-secret-syncer-vcx54" (UID: "649dd5b0-1649-4f63-a148-40fd3f3e07f4") : object "kube-system"/"original-pull-secret" not registered Nov 02 21:52:52.959174 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:52.959167 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87451849-2618-4958-bc4a-114cc208434e-kube-api-access-fsdqt podName:87451849-2618-4958-bc4a-114cc208434e nodeName:}" failed. No retries permitted until 2026-11-02 21:53:08.959150207 +0000 UTC m=+34.289733515 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fsdqt" (UniqueName: "kubernetes.io/projected/87451849-2618-4958-bc4a-114cc208434e-kube-api-access-fsdqt") pod "network-check-target-747nn" (UID: "87451849-2618-4958-bc4a-114cc208434e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 02 21:52:53.277793 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:53.277765 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:52:53.277949 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:53.277767 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:52:53.277949 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:53.277883 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-747nn" podUID="87451849-2618-4958-bc4a-114cc208434e" Nov 02 21:52:53.277949 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:53.277765 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:52:53.278074 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:53.277960 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vcx54" podUID="649dd5b0-1649-4f63-a148-40fd3f3e07f4" Nov 02 21:52:53.278074 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:53.278011 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzkfr" podUID="84467c9f-0161-4e44-9420-dcc224215f05" Nov 02 21:52:53.519687 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:53.519644 2569 generic.go:356] "Generic (PLEG): container finished" podID="15a806bb-6e90-479d-8f94-d9915b47cbde" containerID="0fb064cd2d465eb0ffdedfd1adfa4cd712eabbf3f8957358719ce41d22ac47a1" exitCode=0 Nov 02 21:52:53.519793 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:53.519696 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5mtfp" event={"ID":"15a806bb-6e90-479d-8f94-d9915b47cbde","Type":"ContainerDied","Data":"0fb064cd2d465eb0ffdedfd1adfa4cd712eabbf3f8957358719ce41d22ac47a1"} Nov 02 21:52:54.524741 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:54.524546 2569 generic.go:356] "Generic (PLEG): container finished" podID="15a806bb-6e90-479d-8f94-d9915b47cbde" containerID="ef5c0fdc2fd95673d5891ddd6f3771285b345fd0b9c66514390bdd2ae877377a" exitCode=0 Nov 02 21:52:54.525204 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:54.524623 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5mtfp" event={"ID":"15a806bb-6e90-479d-8f94-d9915b47cbde","Type":"ContainerDied","Data":"ef5c0fdc2fd95673d5891ddd6f3771285b345fd0b9c66514390bdd2ae877377a"} Nov 02 21:52:54.527863 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:54.527838 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g996m" event={"ID":"e011b0d4-3387-4b79-9a3f-b3fac185c126","Type":"ContainerStarted","Data":"0bf43bc6c3cd15ab0134708f9d2ec102343056747b418b396bfef825e17b8178"} Nov 02 21:52:54.527950 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:54.527918 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g996m" event={"ID":"e011b0d4-3387-4b79-9a3f-b3fac185c126","Type":"ContainerStarted","Data":"55714ea10ecfe962067b834a8e7073d0185d67657a4875c9a23afedb2929f285"} Nov 02 21:52:54.527985 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:54.527975 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g996m" event={"ID":"e011b0d4-3387-4b79-9a3f-b3fac185c126","Type":"ContainerStarted","Data":"8865f55b8371bbf1bd5e505f7efefce2b1e5a8d6609c2316745ef89779e2e7f3"} Nov 02 21:52:54.528029 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:54.528019 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g996m" event={"ID":"e011b0d4-3387-4b79-9a3f-b3fac185c126","Type":"ContainerStarted","Data":"e06f5254d4cf8d357e9317522328c72a5d4767b81aeb55febd6b64e786fdb5ca"} Nov 02 21:52:54.528075 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:54.528061 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g996m" event={"ID":"e011b0d4-3387-4b79-9a3f-b3fac185c126","Type":"ContainerStarted","Data":"98eb88541ac3457e7f1abe6b1d94941c8f35ffdaeb3decaee61c105b02055c58"} Nov 02 21:52:54.528123 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:54.528111 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g996m" event={"ID":"e011b0d4-3387-4b79-9a3f-b3fac185c126","Type":"ContainerStarted","Data":"be660d2648589953453a222242b5c018219c422f07ce2734ec662dadb4307a8a"} Nov 02 21:52:55.278737 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:55.278703 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:52:55.278905 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:55.278799 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:52:55.278905 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:55.278804 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzkfr" podUID="84467c9f-0161-4e44-9420-dcc224215f05" Nov 02 21:52:55.282047 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:55.279361 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:52:55.282047 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:55.280117 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-747nn" podUID="87451849-2618-4958-bc4a-114cc208434e" Nov 02 21:52:55.282401 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:55.282378 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vcx54" podUID="649dd5b0-1649-4f63-a148-40fd3f3e07f4" Nov 02 21:52:55.533278 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:55.533201 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5mtfp" event={"ID":"15a806bb-6e90-479d-8f94-d9915b47cbde","Type":"ContainerStarted","Data":"1d33c1871b643079efd32cf00100fbf69ba83c35b5689b74d046b50a55981656"} Nov 02 21:52:55.559418 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:55.559373 2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5mtfp" podStartSLOduration=7.456797424 podStartE2EDuration="19.559359533s" totalImagesPullingTime="12.102562109s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 21:52:36 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:52:55.558934048 +0000 UTC m=+20.889517367" watchObservedRunningTime="2026-11-02 21:52:55.559359533 +0000 UTC m=+20.889942854" Nov 02 21:52:56.538010 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:56.537977 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g996m" event={"ID":"e011b0d4-3387-4b79-9a3f-b3fac185c126","Type":"ContainerStarted","Data":"a79c8ce68cb3aeec9cb71ae826a3a0b6c5526693805f984c0e5682bb798e9d48"} Nov 02 21:52:56.779479 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:56.779437 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:52:56.922935 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:56.922904 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:52:57.278380 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:57.278295 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:52:57.278380 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:57.278319 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:52:57.278604 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:57.278414 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzkfr" podUID="84467c9f-0161-4e44-9420-dcc224215f05" Nov 02 21:52:57.278604 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:57.278491 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vcx54" podUID="649dd5b0-1649-4f63-a148-40fd3f3e07f4" Nov 02 21:52:57.278604 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:57.278537 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:52:57.278741 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:57.278605 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-747nn" podUID="87451849-2618-4958-bc4a-114cc208434e" Nov 02 21:52:58.179854 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:58.179822 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:52:58.274933 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:58.274855 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:52:58.546453 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:58.546359 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g996m" event={"ID":"e011b0d4-3387-4b79-9a3f-b3fac185c126","Type":"ContainerStarted","Data":"eaaae94b1348038c9d05faffcbb27c64b6e6c71d458801a2393b918748dae709"} Nov 02 21:52:58.546697 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:58.546680 2569 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:58.562973 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:58.562947 2569 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:58.580551 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:58.580504 2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-g996m" podStartSLOduration=6.521038886 podStartE2EDuration="22.580492414s" totalImagesPullingTime="16.059453528s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 21:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:52:58.580171411 +0000 UTC m=+23.910754730" watchObservedRunningTime="2026-11-02 21:52:58.580492414 +0000 UTC m=+23.911075735" Nov 02 21:52:58.643993 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:58.643958 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:52:59.277763 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:59.277735 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:52:59.277763 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:59.277759 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:52:59.278306 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:59.277861 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vcx54" podUID="649dd5b0-1649-4f63-a148-40fd3f3e07f4" Nov 02 21:52:59.278306 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:59.277947 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:52:59.278306 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:59.278040 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-747nn" podUID="87451849-2618-4958-bc4a-114cc208434e" Nov 02 21:52:59.278306 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:59.278118 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzkfr" podUID="84467c9f-0161-4e44-9420-dcc224215f05" Nov 02 21:52:59.549323 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:59.549127 2569 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 02 21:52:59.549455 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:59.549253 2569 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:59.566302 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:59.566279 2569 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:52:59.763034 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:59.763004 2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vcx54"] Nov 02 21:52:59.763203 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:59.763119 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:52:59.763264 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:59.763226 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vcx54" podUID="649dd5b0-1649-4f63-a148-40fd3f3e07f4" Nov 02 21:52:59.766094 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:59.766066 2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-747nn"] Nov 02 21:52:59.766221 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:59.766166 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:52:59.766281 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:59.766260 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-747nn" podUID="87451849-2618-4958-bc4a-114cc208434e" Nov 02 21:52:59.766787 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:59.766768 2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gzkfr"] Nov 02 21:52:59.766892 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:52:59.766857 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:52:59.766978 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:52:59.766961 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzkfr" podUID="84467c9f-0161-4e44-9420-dcc224215f05" Nov 02 21:53:00.527955 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:00.527921 2569 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:00.769026 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:00.768993 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:00.870067 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:00.870034 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:01.278822 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:01.278742 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:53:01.278822 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:01.278790 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:53:01.279193 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:01.278751 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:53:01.279193 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:01.278873 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-747nn" podUID="87451849-2618-4958-bc4a-114cc208434e" Nov 02 21:53:01.279193 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:01.278939 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vcx54" podUID="649dd5b0-1649-4f63-a148-40fd3f3e07f4" Nov 02 21:53:01.279193 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:01.279017 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzkfr" podUID="84467c9f-0161-4e44-9420-dcc224215f05" Nov 02 21:53:01.932542 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:01.932515 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:02.034217 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:02.034185 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:02.479297 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:02.479246 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:02.586888 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:02.586850 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:02.682645 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:02.682619 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:02.782834 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:02.782756 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:02.882429 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:02.882400 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:03.278560 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:03.278528 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:53:03.278560 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:03.278558 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:53:03.279121 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:03.278537 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:53:03.279121 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:03.278636 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-747nn" podUID="87451849-2618-4958-bc4a-114cc208434e" Nov 02 21:53:03.279121 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:03.278744 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vcx54" podUID="649dd5b0-1649-4f63-a148-40fd3f3e07f4" Nov 02 21:53:03.279121 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:03.278815 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzkfr" podUID="84467c9f-0161-4e44-9420-dcc224215f05" Nov 02 21:53:03.480808 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:03.480776 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:03.588287 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:03.588260 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:03.939549 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:03.939474 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:05.281138 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:05.281109 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:53:05.281499 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:05.281186 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:53:05.281499 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:05.281213 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:53:05.281499 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:05.281280 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzkfr" podUID="84467c9f-0161-4e44-9420-dcc224215f05" Nov 02 21:53:05.281499 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:05.281326 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-747nn" podUID="87451849-2618-4958-bc4a-114cc208434e" Nov 02 21:53:05.281499 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:05.281391 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vcx54" podUID="649dd5b0-1649-4f63-a148-40fd3f3e07f4" Nov 02 21:53:05.707298 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:05.707204 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:05.807464 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:05.807432 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:06.825144 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:06.825101 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:07.281457 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:07.281386 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:53:07.281457 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:07.281414 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:53:07.281637 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:07.281485 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzkfr" podUID="84467c9f-0161-4e44-9420-dcc224215f05" Nov 02 21:53:07.281637 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:07.281515 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:53:07.281637 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:07.281591 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vcx54" podUID="649dd5b0-1649-4f63-a148-40fd3f3e07f4" Nov 02 21:53:07.281753 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:07.281675 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-747nn" podUID="87451849-2618-4958-bc4a-114cc208434e" Nov 02 21:53:08.372849 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:08.372822 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ck8br_983b05f9-8574-4a23-b3de-951a68c553a1/dns-node-resolver/0.log" Nov 02 21:53:08.748643 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:08.748567 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:08.848432 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:08.848399 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:08.875079 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:08.875053 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84467c9f-0161-4e44-9420-dcc224215f05-metrics-certs\") pod \"network-metrics-daemon-gzkfr\" (UID: \"84467c9f-0161-4e44-9420-dcc224215f05\") " pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:53:08.875252 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:08.875219 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 02 21:53:08.875344 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:08.875320 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84467c9f-0161-4e44-9420-dcc224215f05-metrics-certs podName:84467c9f-0161-4e44-9420-dcc224215f05 nodeName:}" failed. No retries permitted until 2026-11-02 21:53:40.875300229 +0000 UTC m=+66.205883530 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/84467c9f-0161-4e44-9420-dcc224215f05-metrics-certs") pod "network-metrics-daemon-gzkfr" (UID: "84467c9f-0161-4e44-9420-dcc224215f05") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 02 21:53:08.948426 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:08.948400 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:08.975516 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:08.975478 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/649dd5b0-1649-4f63-a148-40fd3f3e07f4-original-pull-secret\") pod \"global-pull-secret-syncer-vcx54\" (UID: \"649dd5b0-1649-4f63-a148-40fd3f3e07f4\") " pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:53:08.975642 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:08.975551 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsdqt\" (UniqueName: \"kubernetes.io/projected/87451849-2618-4958-bc4a-114cc208434e-kube-api-access-fsdqt\") pod \"network-check-target-747nn\" (UID: \"87451849-2618-4958-bc4a-114cc208434e\") " pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:53:08.975642 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:08.975632 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 02 21:53:08.975794 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:08.975705 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 02 21:53:08.975794 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:08.975727 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 02 21:53:08.975794 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:08.975729 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/649dd5b0-1649-4f63-a148-40fd3f3e07f4-original-pull-secret podName:649dd5b0-1649-4f63-a148-40fd3f3e07f4 nodeName:}" failed. No retries permitted until 2026-11-02 21:53:40.975713395 +0000 UTC m=+66.306296695 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/649dd5b0-1649-4f63-a148-40fd3f3e07f4-original-pull-secret") pod "global-pull-secret-syncer-vcx54" (UID: "649dd5b0-1649-4f63-a148-40fd3f3e07f4") : object "kube-system"/"original-pull-secret" not registered Nov 02 21:53:08.975794 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:08.975740 2569 projected.go:196] Error preparing data for projected volume kube-api-access-fsdqt for pod openshift-network-diagnostics/network-check-target-747nn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 02 21:53:08.975794 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:08.975789 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87451849-2618-4958-bc4a-114cc208434e-kube-api-access-fsdqt podName:87451849-2618-4958-bc4a-114cc208434e nodeName:}" failed. No retries permitted until 2026-11-02 21:53:40.975773544 +0000 UTC m=+66.306356858 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fsdqt" (UniqueName: "kubernetes.io/projected/87451849-2618-4958-bc4a-114cc208434e-kube-api-access-fsdqt") pod "network-check-target-747nn" (UID: "87451849-2618-4958-bc4a-114cc208434e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 02 21:53:09.049977 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:09.049907 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:09.207104 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:09.207072 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:09.280573 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:09.280552 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:53:09.280723 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:09.280643 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-747nn" podUID="87451849-2618-4958-bc4a-114cc208434e" Nov 02 21:53:09.280776 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:09.280724 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:53:09.280834 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:09.280819 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzkfr" podUID="84467c9f-0161-4e44-9420-dcc224215f05" Nov 02 21:53:09.280868 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:09.280854 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:53:09.280922 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:09.280909 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vcx54" podUID="649dd5b0-1649-4f63-a148-40fd3f3e07f4" Nov 02 21:53:09.321203 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:09.321168 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:09.397569 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:09.397542 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bjwd8_c0fdd204-e1ad-4de8-ab18-52ab672cc3a4/node-ca/0.log" Nov 02 21:53:09.461868 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:09.461825 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:10.210907 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:10.210875 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:10.325256 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:10.325210 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:10.610409 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:10.610374 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:10.808132 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:10.808072 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:11.002021 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:11.001938 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:11.277981 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:11.277900 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:53:11.277981 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:11.277919 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:53:11.278189 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:11.278000 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzkfr" podUID="84467c9f-0161-4e44-9420-dcc224215f05" Nov 02 21:53:11.278189 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:11.278034 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:53:11.278189 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:11.278096 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vcx54" podUID="649dd5b0-1649-4f63-a148-40fd3f3e07f4" Nov 02 21:53:11.278346 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:11.278199 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-747nn" podUID="87451849-2618-4958-bc4a-114cc208434e" Nov 02 21:53:11.408767 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:11.408736 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:12.214154 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:12.214119 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:12.611147 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:12.611104 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:12.804421 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:12.804392 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:13.007294 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:13.007190 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:13.278142 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:13.278067 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:53:13.278142 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:13.278081 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:53:13.278142 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:13.278068 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:53:13.278575 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:13.278217 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzkfr" podUID="84467c9f-0161-4e44-9420-dcc224215f05" Nov 02 21:53:13.278575 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:13.278254 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-747nn" podUID="87451849-2618-4958-bc4a-114cc208434e" Nov 02 21:53:13.278575 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:13.278317 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vcx54" podUID="649dd5b0-1649-4f63-a148-40fd3f3e07f4" Nov 02 21:53:13.403555 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:13.403518 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:14.212949 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:14.212912 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:14.378743 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:14.378681 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:14.479090 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:14.478986 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:14.580396 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:14.580342 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:14.680902 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:14.680845 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:14.805938 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:14.805915 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:15.008623 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:15.008580 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:15.106829 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:15.106728 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:15.279419 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:15.279383 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:53:15.279594 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:15.279518 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:53:15.279594 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:15.279531 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-747nn" podUID="87451849-2618-4958-bc4a-114cc208434e" Nov 02 21:53:15.279710 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:15.279624 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:53:15.279710 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:15.279623 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzkfr" podUID="84467c9f-0161-4e44-9420-dcc224215f05" Nov 02 21:53:15.279771 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:15.279721 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vcx54" podUID="649dd5b0-1649-4f63-a148-40fd3f3e07f4" Nov 02 21:53:15.405548 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:15.405472 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:16.209111 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:16.209066 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:16.517446 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:16.517358 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:16.618257 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:16.618223 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:16.801811 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:16.801716 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:17.009257 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:17.009228 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:17.277976 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:17.277950 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:53:17.277976 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:17.277971 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:53:17.278210 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:17.278028 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:53:17.278210 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:17.278136 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-747nn" podUID="87451849-2618-4958-bc4a-114cc208434e" Nov 02 21:53:17.278308 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:17.278216 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzkfr" podUID="84467c9f-0161-4e44-9420-dcc224215f05" Nov 02 21:53:17.278410 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:17.278386 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vcx54" podUID="649dd5b0-1649-4f63-a148-40fd3f3e07f4" Nov 02 21:53:17.407445 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:17.407413 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:18.209882 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:18.209839 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:18.603768 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:18.603733 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:18.803621 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:18.803593 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:19.009247 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:19.009163 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:19.277882 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:19.277801 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:53:19.278334 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:19.277804 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:53:19.278334 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:19.277910 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzkfr" podUID="84467c9f-0161-4e44-9420-dcc224215f05" Nov 02 21:53:19.278334 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:19.277808 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:53:19.278334 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:19.278033 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-747nn" podUID="87451849-2618-4958-bc4a-114cc208434e" Nov 02 21:53:19.278334 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:19.277966 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vcx54" podUID="649dd5b0-1649-4f63-a148-40fd3f3e07f4" Nov 02 21:53:19.405002 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:19.404968 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:19.609419 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:19.609388 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:20.135466 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:20.135432 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:20.498409 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:20.498339 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:20.598064 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:20.598031 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:20.698230 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:20.698206 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:21.278124 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:21.278090 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:53:21.278124 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:21.278109 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:53:21.278368 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:21.278200 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-747nn" podUID="87451849-2618-4958-bc4a-114cc208434e" Nov 02 21:53:21.278368 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:21.278271 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzkfr" podUID="84467c9f-0161-4e44-9420-dcc224215f05" Nov 02 21:53:21.278368 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:21.278311 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:53:21.278526 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:21.278385 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vcx54" podUID="649dd5b0-1649-4f63-a148-40fd3f3e07f4" Nov 02 21:53:21.577029 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:21.576995 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:21.668538 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:21.668509 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:22.592793 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:22.592764 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:22.788372 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:22.788340 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:23.277923 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.277894 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:53:23.277923 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.277918 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:53:23.278061 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.277896 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:53:23.278061 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:23.278040 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vcx54" podUID="649dd5b0-1649-4f63-a148-40fd3f3e07f4" Nov 02 21:53:23.278152 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:23.278060 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzkfr" podUID="84467c9f-0161-4e44-9420-dcc224215f05" Nov 02 21:53:23.278152 ip-10-0-139-99 kubenswrapper[2569]: E1102 21:53:23.278129 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-747nn" podUID="87451849-2618-4958-bc4a-114cc208434e" Nov 02 21:53:23.438440 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.438369 2569 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-99.us-east-2.compute.internal" event="NodeReady" Nov 02 21:53:23.438735 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.438508 2569 kubelet_node_status.go:477] "Fast updating node status as it just became ready" Nov 02 21:53:23.488822 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.488790 2569 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-m95sf"] Nov 02 21:53:23.491827 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.491804 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m95sf" Nov 02 21:53:23.491940 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.491849 2569 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nltff"] Nov 02 21:53:23.494818 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.494802 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nltff" Nov 02 21:53:23.501265 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.501116 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Nov 02 21:53:23.501265 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.501232 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Nov 02 21:53:23.501265 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.501259 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Nov 02 21:53:23.501483 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.501343 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-n89v9\"" Nov 02 21:53:23.501870 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.501853 2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m95sf"] Nov 02 21:53:23.503816 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.503798 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Nov 02 21:53:23.504037 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.504005 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dlndp\"" Nov 02 21:53:23.504133 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.504083 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Nov 02 21:53:23.504133 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.504096 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Nov 02 21:53:23.504133 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.504128 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Nov 02 21:53:23.509257 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.509237 2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nltff"] Nov 02 21:53:23.513733 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.513712 2569 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ntgwx"] Nov 02 21:53:23.517343 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.517078 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ntgwx" Nov 02 21:53:23.528639 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.528618 2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ntgwx"] Nov 02 21:53:23.583366 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.583327 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e761db17-b05a-4f51-8fb9-c2126ee35fe1-metrics-tls\") pod \"dns-default-ntgwx\" (UID: \"e761db17-b05a-4f51-8fb9-c2126ee35fe1\") " pod="openshift-dns/dns-default-ntgwx" Nov 02 21:53:23.583536 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.583386 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2026273-f131-45c2-a443-c66a07d518ae-data-volume\") pod \"insights-runtime-extractor-nltff\" (UID: \"e2026273-f131-45c2-a443-c66a07d518ae\") " pod="openshift-insights/insights-runtime-extractor-nltff" Nov 02 21:53:23.583536 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.583506 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e761db17-b05a-4f51-8fb9-c2126ee35fe1-config-volume\") pod \"dns-default-ntgwx\" (UID: \"e761db17-b05a-4f51-8fb9-c2126ee35fe1\") " pod="openshift-dns/dns-default-ntgwx" Nov 02 21:53:23.583536 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.583534 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvh9s\" (UniqueName: \"kubernetes.io/projected/76322934-bb51-4c0e-a7df-37f506b6cfc4-kube-api-access-lvh9s\") pod \"ingress-canary-m95sf\" (UID: \"76322934-bb51-4c0e-a7df-37f506b6cfc4\") " pod="openshift-ingress-canary/ingress-canary-m95sf" Nov 02 21:53:23.583714 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.583551 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2026273-f131-45c2-a443-c66a07d518ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nltff\" (UID: \"e2026273-f131-45c2-a443-c66a07d518ae\") " pod="openshift-insights/insights-runtime-extractor-nltff" Nov 02 21:53:23.583714 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.583576 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2026273-f131-45c2-a443-c66a07d518ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nltff\" (UID: \"e2026273-f131-45c2-a443-c66a07d518ae\") " pod="openshift-insights/insights-runtime-extractor-nltff" Nov 02 21:53:23.583815 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.583721 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df98z\" (UniqueName: \"kubernetes.io/projected/e2026273-f131-45c2-a443-c66a07d518ae-kube-api-access-df98z\") pod \"insights-runtime-extractor-nltff\" (UID: \"e2026273-f131-45c2-a443-c66a07d518ae\") " pod="openshift-insights/insights-runtime-extractor-nltff" Nov 02 21:53:23.583815 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.583755 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76322934-bb51-4c0e-a7df-37f506b6cfc4-cert\") pod \"ingress-canary-m95sf\" (UID: \"76322934-bb51-4c0e-a7df-37f506b6cfc4\") " pod="openshift-ingress-canary/ingress-canary-m95sf" Nov 02 21:53:23.583815 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.583780 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99wqw\" (UniqueName: \"kubernetes.io/projected/e761db17-b05a-4f51-8fb9-c2126ee35fe1-kube-api-access-99wqw\") pod \"dns-default-ntgwx\" (UID: \"e761db17-b05a-4f51-8fb9-c2126ee35fe1\") " pod="openshift-dns/dns-default-ntgwx" Nov 02 21:53:23.583949 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.583815 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e2026273-f131-45c2-a443-c66a07d518ae-crio-socket\") pod \"insights-runtime-extractor-nltff\" (UID: \"e2026273-f131-45c2-a443-c66a07d518ae\") " pod="openshift-insights/insights-runtime-extractor-nltff" Nov 02 21:53:23.583949 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.583836 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e761db17-b05a-4f51-8fb9-c2126ee35fe1-tmp-dir\") pod \"dns-default-ntgwx\" (UID: \"e761db17-b05a-4f51-8fb9-c2126ee35fe1\") " pod="openshift-dns/dns-default-ntgwx" Nov 02 21:53:23.602174 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.602137 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Nov 02 21:53:23.602504 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.602216 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Nov 02 21:53:23.602504 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.602216 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pv8v8\"" Nov 02 21:53:23.684604 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.684559 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df98z\" (UniqueName: \"kubernetes.io/projected/e2026273-f131-45c2-a443-c66a07d518ae-kube-api-access-df98z\") pod \"insights-runtime-extractor-nltff\" (UID: \"e2026273-f131-45c2-a443-c66a07d518ae\") " pod="openshift-insights/insights-runtime-extractor-nltff" Nov 02 21:53:23.684604 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.684600 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76322934-bb51-4c0e-a7df-37f506b6cfc4-cert\") pod \"ingress-canary-m95sf\" (UID: \"76322934-bb51-4c0e-a7df-37f506b6cfc4\") " pod="openshift-ingress-canary/ingress-canary-m95sf" Nov 02 21:53:23.684867 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.684621 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99wqw\" (UniqueName: \"kubernetes.io/projected/e761db17-b05a-4f51-8fb9-c2126ee35fe1-kube-api-access-99wqw\") pod \"dns-default-ntgwx\" (UID: \"e761db17-b05a-4f51-8fb9-c2126ee35fe1\") " pod="openshift-dns/dns-default-ntgwx" Nov 02 21:53:23.684867 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.684638 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e2026273-f131-45c2-a443-c66a07d518ae-crio-socket\") pod \"insights-runtime-extractor-nltff\" (UID: \"e2026273-f131-45c2-a443-c66a07d518ae\") " pod="openshift-insights/insights-runtime-extractor-nltff" Nov 02 21:53:23.684867 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.684658 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e761db17-b05a-4f51-8fb9-c2126ee35fe1-tmp-dir\") pod \"dns-default-ntgwx\" (UID: \"e761db17-b05a-4f51-8fb9-c2126ee35fe1\") " pod="openshift-dns/dns-default-ntgwx" Nov 02 21:53:23.684867 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.684698 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e761db17-b05a-4f51-8fb9-c2126ee35fe1-metrics-tls\") pod \"dns-default-ntgwx\" (UID: \"e761db17-b05a-4f51-8fb9-c2126ee35fe1\") " pod="openshift-dns/dns-default-ntgwx" Nov 02 21:53:23.684867 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.684731 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2026273-f131-45c2-a443-c66a07d518ae-data-volume\") pod \"insights-runtime-extractor-nltff\" (UID: \"e2026273-f131-45c2-a443-c66a07d518ae\") " pod="openshift-insights/insights-runtime-extractor-nltff" Nov 02 21:53:23.685138 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.684876 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e761db17-b05a-4f51-8fb9-c2126ee35fe1-config-volume\") pod \"dns-default-ntgwx\" (UID: \"e761db17-b05a-4f51-8fb9-c2126ee35fe1\") " pod="openshift-dns/dns-default-ntgwx" Nov 02 21:53:23.685138 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.684888 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e2026273-f131-45c2-a443-c66a07d518ae-crio-socket\") pod \"insights-runtime-extractor-nltff\" (UID: \"e2026273-f131-45c2-a443-c66a07d518ae\") " pod="openshift-insights/insights-runtime-extractor-nltff" Nov 02 21:53:23.685138 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.684912 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvh9s\" (UniqueName: \"kubernetes.io/projected/76322934-bb51-4c0e-a7df-37f506b6cfc4-kube-api-access-lvh9s\") pod \"ingress-canary-m95sf\" (UID: \"76322934-bb51-4c0e-a7df-37f506b6cfc4\") " pod="openshift-ingress-canary/ingress-canary-m95sf" Nov 02 21:53:23.685138 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.684944 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2026273-f131-45c2-a443-c66a07d518ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nltff\" (UID: \"e2026273-f131-45c2-a443-c66a07d518ae\") " pod="openshift-insights/insights-runtime-extractor-nltff" Nov 02 21:53:23.685138 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.684984 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2026273-f131-45c2-a443-c66a07d518ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nltff\" (UID: \"e2026273-f131-45c2-a443-c66a07d518ae\") " pod="openshift-insights/insights-runtime-extractor-nltff" Nov 02 21:53:23.685138 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.685089 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2026273-f131-45c2-a443-c66a07d518ae-data-volume\") pod \"insights-runtime-extractor-nltff\" (UID: \"e2026273-f131-45c2-a443-c66a07d518ae\") " pod="openshift-insights/insights-runtime-extractor-nltff" Nov 02 21:53:23.685138 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.685089 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e761db17-b05a-4f51-8fb9-c2126ee35fe1-tmp-dir\") pod \"dns-default-ntgwx\" (UID: \"e761db17-b05a-4f51-8fb9-c2126ee35fe1\") " pod="openshift-dns/dns-default-ntgwx" Nov 02 21:53:23.685485 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.685466 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e761db17-b05a-4f51-8fb9-c2126ee35fe1-config-volume\") pod \"dns-default-ntgwx\" (UID: \"e761db17-b05a-4f51-8fb9-c2126ee35fe1\") " pod="openshift-dns/dns-default-ntgwx" Nov 02 21:53:23.685537 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.685477 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2026273-f131-45c2-a443-c66a07d518ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nltff\" (UID: \"e2026273-f131-45c2-a443-c66a07d518ae\") " pod="openshift-insights/insights-runtime-extractor-nltff" Nov 02 21:53:23.688343 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.688315 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e761db17-b05a-4f51-8fb9-c2126ee35fe1-metrics-tls\") pod \"dns-default-ntgwx\" (UID: \"e761db17-b05a-4f51-8fb9-c2126ee35fe1\") " pod="openshift-dns/dns-default-ntgwx" Nov 02 21:53:23.688435 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.688318 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2026273-f131-45c2-a443-c66a07d518ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nltff\" (UID: \"e2026273-f131-45c2-a443-c66a07d518ae\") " pod="openshift-insights/insights-runtime-extractor-nltff" Nov 02 21:53:23.688435 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.688356 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76322934-bb51-4c0e-a7df-37f506b6cfc4-cert\") pod \"ingress-canary-m95sf\" (UID: \"76322934-bb51-4c0e-a7df-37f506b6cfc4\") " pod="openshift-ingress-canary/ingress-canary-m95sf" Nov 02 21:53:23.697266 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.697211 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvh9s\" (UniqueName: \"kubernetes.io/projected/76322934-bb51-4c0e-a7df-37f506b6cfc4-kube-api-access-lvh9s\") pod \"ingress-canary-m95sf\" (UID: \"76322934-bb51-4c0e-a7df-37f506b6cfc4\") " pod="openshift-ingress-canary/ingress-canary-m95sf" Nov 02 21:53:23.697338 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.697268 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-df98z\" (UniqueName: \"kubernetes.io/projected/e2026273-f131-45c2-a443-c66a07d518ae-kube-api-access-df98z\") pod \"insights-runtime-extractor-nltff\" (UID: \"e2026273-f131-45c2-a443-c66a07d518ae\") " pod="openshift-insights/insights-runtime-extractor-nltff" Nov 02 21:53:23.697338 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.697315 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99wqw\" (UniqueName: \"kubernetes.io/projected/e761db17-b05a-4f51-8fb9-c2126ee35fe1-kube-api-access-99wqw\") pod \"dns-default-ntgwx\" (UID: \"e761db17-b05a-4f51-8fb9-c2126ee35fe1\") " pod="openshift-dns/dns-default-ntgwx" Nov 02 21:53:23.804533 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.804503 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m95sf" Nov 02 21:53:23.815783 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.815760 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nltff" Nov 02 21:53:23.829743 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:23.829715 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ntgwx" Nov 02 21:53:24.092400 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:24.092368 2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m95sf"] Nov 02 21:53:24.097836 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:24.097812 2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nltff"] Nov 02 21:53:24.100953 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:53:24.100932 2569 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2026273_f131_45c2_a443_c66a07d518ae.slice/crio-2d4621d091343a0a22e1a151ddbd2410b10d122e6853e90a486d28f69f97525d WatchSource:0}: Error finding container 2d4621d091343a0a22e1a151ddbd2410b10d122e6853e90a486d28f69f97525d: Status 404 returned error can't find the container with id 2d4621d091343a0a22e1a151ddbd2410b10d122e6853e90a486d28f69f97525d Nov 02 21:53:24.123678 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:24.123641 2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ntgwx"] Nov 02 21:53:24.126269 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:53:24.126242 2569 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode761db17_b05a_4f51_8fb9_c2126ee35fe1.slice/crio-e029b38ceaada5030743e14f1ba271133d056ff593954ef7c3bee0fed84c8611 WatchSource:0}: Error finding container e029b38ceaada5030743e14f1ba271133d056ff593954ef7c3bee0fed84c8611: Status 404 returned error can't find the container with id e029b38ceaada5030743e14f1ba271133d056ff593954ef7c3bee0fed84c8611 Nov 02 21:53:24.601496 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:24.601457 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m95sf" event={"ID":"76322934-bb51-4c0e-a7df-37f506b6cfc4","Type":"ContainerStarted","Data":"10a4536550cb2ed604ba15845641ceea53f12f3dbaf83459cff986f4581ce981"} Nov 02 21:53:24.602786 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:24.602729 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ntgwx" event={"ID":"e761db17-b05a-4f51-8fb9-c2126ee35fe1","Type":"ContainerStarted","Data":"e029b38ceaada5030743e14f1ba271133d056ff593954ef7c3bee0fed84c8611"} Nov 02 21:53:24.604447 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:24.604418 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nltff" event={"ID":"e2026273-f131-45c2-a443-c66a07d518ae","Type":"ContainerStarted","Data":"b297054ac83c04ad86d9d6891ff2b9e3ca82775ee0fa0d334ac03377da5d29dc"} Nov 02 21:53:24.604559 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:24.604470 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nltff" event={"ID":"e2026273-f131-45c2-a443-c66a07d518ae","Type":"ContainerStarted","Data":"2d4621d091343a0a22e1a151ddbd2410b10d122e6853e90a486d28f69f97525d"} Nov 02 21:53:25.279200 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:25.279165 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:53:25.280116 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:25.279552 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:53:25.280116 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:25.279956 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:53:25.283657 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:25.283632 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Nov 02 21:53:25.283780 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:25.283766 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Nov 02 21:53:25.284909 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:25.284888 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Nov 02 21:53:25.285021 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:25.284933 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-g5nbb\"" Nov 02 21:53:25.285021 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:25.284977 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-k7pz9\"" Nov 02 21:53:25.285126 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:25.285029 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t9jzj\"" Nov 02 21:53:25.285126 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:25.285087 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Nov 02 21:53:25.610976 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:25.610932 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nltff" event={"ID":"e2026273-f131-45c2-a443-c66a07d518ae","Type":"ContainerStarted","Data":"7a405c04efc72dc9ac248edf495e6caaf017ca3b31191b8b82c777651c2718af"} Nov 02 21:53:26.615527 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:26.615487 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ntgwx" event={"ID":"e761db17-b05a-4f51-8fb9-c2126ee35fe1","Type":"ContainerStarted","Data":"0b7404e1c9cb8d085625c7e01abce8e69255239c5337f3aa54789f2cfa2359dd"} Nov 02 21:53:26.616019 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:26.615552 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ntgwx" event={"ID":"e761db17-b05a-4f51-8fb9-c2126ee35fe1","Type":"ContainerStarted","Data":"379e555e505149180a99edd2b2bcb4e7dc34565af80f5669a532d670a0c28769"} Nov 02 21:53:26.616019 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:26.615656 2569 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ntgwx" Nov 02 21:53:26.618051 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:26.618020 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:26.637168 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:26.637140 2569 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-ltszg"] Nov 02 21:53:26.640404 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:26.640372 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-ltszg" Nov 02 21:53:26.646411 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:26.646320 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Nov 02 21:53:26.646411 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:26.646367 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Nov 02 21:53:26.646636 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:26.646613 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Nov 02 21:53:26.647208 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:26.647172 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Nov 02 21:53:26.647609 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:26.647569 2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-ntgwx" podStartSLOduration=1.530343102 podStartE2EDuration="3.647556845s" totalImagesPullingTime="2.117213743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 21:53:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:53:26.647038129 +0000 UTC m=+51.977621451" watchObservedRunningTime="2026-11-02 21:53:26.647556845 +0000 UTC m=+51.978140164" Nov 02 21:53:26.648344 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:26.648316 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Nov 02 21:53:26.648416 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:26.648376 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-krx6b\"" Nov 02 21:53:26.651412 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:26.651387 2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-ltszg"] Nov 02 21:53:26.709032 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:26.708997 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt8ph\" (UniqueName: \"kubernetes.io/projected/15d3a384-31d9-4152-9e38-491942e6d5c5-kube-api-access-mt8ph\") pod \"prometheus-operator-9cd89b74c-ltszg\" (UID: \"15d3a384-31d9-4152-9e38-491942e6d5c5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-ltszg" Nov 02 21:53:26.709169 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:26.709066 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/15d3a384-31d9-4152-9e38-491942e6d5c5-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-ltszg\" (UID: \"15d3a384-31d9-4152-9e38-491942e6d5c5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-ltszg" Nov 02 21:53:26.709290 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:26.709268 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/15d3a384-31d9-4152-9e38-491942e6d5c5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-ltszg\" (UID: \"15d3a384-31d9-4152-9e38-491942e6d5c5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-ltszg" Nov 02 21:53:26.709365 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:26.709352 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15d3a384-31d9-4152-9e38-491942e6d5c5-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-ltszg\" (UID: \"15d3a384-31d9-4152-9e38-491942e6d5c5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-ltszg" Nov 02 21:53:26.718001 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:26.717933 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:26.810156 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:26.810130 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mt8ph\" (UniqueName: \"kubernetes.io/projected/15d3a384-31d9-4152-9e38-491942e6d5c5-kube-api-access-mt8ph\") pod \"prometheus-operator-9cd89b74c-ltszg\" (UID: \"15d3a384-31d9-4152-9e38-491942e6d5c5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-ltszg" Nov 02 21:53:26.810277 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:26.810259 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/15d3a384-31d9-4152-9e38-491942e6d5c5-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-ltszg\" (UID: \"15d3a384-31d9-4152-9e38-491942e6d5c5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-ltszg" Nov 02 21:53:26.810334 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:26.810302 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/15d3a384-31d9-4152-9e38-491942e6d5c5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-ltszg\" (UID: \"15d3a384-31d9-4152-9e38-491942e6d5c5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-ltszg" Nov 02 21:53:26.810386 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:26.810356 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15d3a384-31d9-4152-9e38-491942e6d5c5-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-ltszg\" (UID: \"15d3a384-31d9-4152-9e38-491942e6d5c5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-ltszg" Nov 02 21:53:26.811214 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:26.811171 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15d3a384-31d9-4152-9e38-491942e6d5c5-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-ltszg\" (UID: \"15d3a384-31d9-4152-9e38-491942e6d5c5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-ltszg" Nov 02 21:53:26.813239 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:26.813202 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/15d3a384-31d9-4152-9e38-491942e6d5c5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-ltszg\" (UID: \"15d3a384-31d9-4152-9e38-491942e6d5c5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-ltszg" Nov 02 21:53:26.813299 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:26.813282 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/15d3a384-31d9-4152-9e38-491942e6d5c5-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-ltszg\" (UID: \"15d3a384-31d9-4152-9e38-491942e6d5c5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-ltszg" Nov 02 21:53:26.817955 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:26.817912 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:26.822906 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:26.822884 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt8ph\" (UniqueName: \"kubernetes.io/projected/15d3a384-31d9-4152-9e38-491942e6d5c5-kube-api-access-mt8ph\") pod \"prometheus-operator-9cd89b74c-ltszg\" (UID: \"15d3a384-31d9-4152-9e38-491942e6d5c5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-ltszg" Nov 02 21:53:26.960039 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:26.960001 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-ltszg" Nov 02 21:53:27.240943 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:27.240918 2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-ltszg"] Nov 02 21:53:27.243531 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:53:27.243503 2569 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15d3a384_31d9_4152_9e38_491942e6d5c5.slice/crio-e5dec6adfc8820000948b72af6828f2bc38ea8f4cc32dd8941bb9978578ce98b WatchSource:0}: Error finding container e5dec6adfc8820000948b72af6828f2bc38ea8f4cc32dd8941bb9978578ce98b: Status 404 returned error can't find the container with id e5dec6adfc8820000948b72af6828f2bc38ea8f4cc32dd8941bb9978578ce98b Nov 02 21:53:27.610700 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:27.610601 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:27.621316 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:27.621280 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-ltszg" event={"ID":"15d3a384-31d9-4152-9e38-491942e6d5c5","Type":"ContainerStarted","Data":"e5dec6adfc8820000948b72af6828f2bc38ea8f4cc32dd8941bb9978578ce98b"} Nov 02 21:53:27.623572 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:27.623547 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nltff" event={"ID":"e2026273-f131-45c2-a443-c66a07d518ae","Type":"ContainerStarted","Data":"e76047d3598f176562a6e2d7761e695078e402ac9b5bdda0178865e624c2484b"} Nov 02 21:53:27.625068 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:27.625041 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m95sf" event={"ID":"76322934-bb51-4c0e-a7df-37f506b6cfc4","Type":"ContainerStarted","Data":"6d7107b875350652d9d4adc036fc2957aa6d58614bfa19cb69853d3117bb7791"} Nov 02 21:53:27.648455 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:27.648413 2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nltff" podStartSLOduration=2.077895216 podStartE2EDuration="4.648399025s" totalImagesPullingTime="2.570503809s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 21:53:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:53:27.644127133 +0000 UTC m=+52.974710458" watchObservedRunningTime="2026-11-02 21:53:27.648399025 +0000 UTC m=+52.978982348" Nov 02 21:53:27.663279 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:27.663228 2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-m95sf" podStartSLOduration=1.616117693 podStartE2EDuration="4.663216637s" totalImagesPullingTime="3.047098944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 21:53:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:53:27.662550367 +0000 UTC m=+52.993133689" watchObservedRunningTime="2026-11-02 21:53:27.663216637 +0000 UTC m=+52.993799956" Nov 02 21:53:27.711345 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:27.711319 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:29.385214 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:29.385177 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:29.633189 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:29.633156 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-ltszg" event={"ID":"15d3a384-31d9-4152-9e38-491942e6d5c5","Type":"ContainerStarted","Data":"7f7484804c55dc678a8ee812ee8c98f9454a97788910c537846548afaf6cea20"} Nov 02 21:53:29.633344 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:29.633207 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-ltszg" event={"ID":"15d3a384-31d9-4152-9e38-491942e6d5c5","Type":"ContainerStarted","Data":"50e608974ca9a85e693d291aa63949adf9b98a788ef543742587460512bcbfc3"} Nov 02 21:53:29.654004 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:29.653925 2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-9cd89b74c-ltszg" podStartSLOduration=1.852826606 podStartE2EDuration="3.653906644s" totalImagesPullingTime="1.801080038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 21:53:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:53:29.652547752 +0000 UTC m=+54.983131072" watchObservedRunningTime="2026-11-02 21:53:29.653906644 +0000 UTC m=+54.984489965" Nov 02 21:53:30.411095 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:30.411062 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:30.541985 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:30.541952 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:30.637367 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:30.637333 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:30.959849 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:30.959816 2569 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d6f59494d-bzp74"] Nov 02 21:53:30.962799 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:30.962785 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:30.969636 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:30.969617 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Nov 02 21:53:30.969847 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:30.969828 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Nov 02 21:53:30.969918 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:30.969852 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Nov 02 21:53:30.969918 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:30.969882 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Nov 02 21:53:30.969918 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:30.969903 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Nov 02 21:53:30.970058 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:30.969927 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Nov 02 21:53:30.970058 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:30.969947 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Nov 02 21:53:30.970058 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:30.969954 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-clfxr\"" Nov 02 21:53:30.973677 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:30.973647 2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d6f59494d-bzp74"] Nov 02 21:53:31.044527 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:31.044496 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/943a1337-2968-4104-aa18-90f3cd407ea0-tmp\") pod \"console-7d6f59494d-bzp74\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:31.044699 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:31.044549 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/943a1337-2968-4104-aa18-90f3cd407ea0-console-serving-cert\") pod \"console-7d6f59494d-bzp74\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:31.044699 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:31.044572 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/943a1337-2968-4104-aa18-90f3cd407ea0-console-config\") pod \"console-7d6f59494d-bzp74\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:31.044699 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:31.044606 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/943a1337-2968-4104-aa18-90f3cd407ea0-oauth-serving-cert\") pod \"console-7d6f59494d-bzp74\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:31.044807 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:31.044773 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d9ln\" (UniqueName: \"kubernetes.io/projected/943a1337-2968-4104-aa18-90f3cd407ea0-kube-api-access-4d9ln\") pod \"console-7d6f59494d-bzp74\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:31.044807 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:31.044800 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/943a1337-2968-4104-aa18-90f3cd407ea0-console-oauth-config\") pod \"console-7d6f59494d-bzp74\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:31.044866 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:31.044817 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/943a1337-2968-4104-aa18-90f3cd407ea0-service-ca\") pod \"console-7d6f59494d-bzp74\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:31.146032 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:31.145995 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d9ln\" (UniqueName: \"kubernetes.io/projected/943a1337-2968-4104-aa18-90f3cd407ea0-kube-api-access-4d9ln\") pod \"console-7d6f59494d-bzp74\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:31.146032 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:31.146033 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/943a1337-2968-4104-aa18-90f3cd407ea0-console-oauth-config\") pod \"console-7d6f59494d-bzp74\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:31.146219 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:31.146050 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/943a1337-2968-4104-aa18-90f3cd407ea0-service-ca\") pod \"console-7d6f59494d-bzp74\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:31.146219 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:31.146079 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/943a1337-2968-4104-aa18-90f3cd407ea0-tmp\") pod \"console-7d6f59494d-bzp74\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:31.146219 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:31.146121 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/943a1337-2968-4104-aa18-90f3cd407ea0-console-serving-cert\") pod \"console-7d6f59494d-bzp74\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:31.146353 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:31.146223 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/943a1337-2968-4104-aa18-90f3cd407ea0-console-config\") pod \"console-7d6f59494d-bzp74\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:31.146353 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:31.146265 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/943a1337-2968-4104-aa18-90f3cd407ea0-oauth-serving-cert\") pod \"console-7d6f59494d-bzp74\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:31.146646 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:31.146621 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/943a1337-2968-4104-aa18-90f3cd407ea0-tmp\") pod \"console-7d6f59494d-bzp74\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:31.146860 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:31.146841 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/943a1337-2968-4104-aa18-90f3cd407ea0-service-ca\") pod \"console-7d6f59494d-bzp74\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:31.146924 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:31.146884 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/943a1337-2968-4104-aa18-90f3cd407ea0-console-config\") pod \"console-7d6f59494d-bzp74\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:31.147209 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:31.147189 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/943a1337-2968-4104-aa18-90f3cd407ea0-oauth-serving-cert\") pod \"console-7d6f59494d-bzp74\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:31.148742 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:31.148720 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/943a1337-2968-4104-aa18-90f3cd407ea0-console-oauth-config\") pod \"console-7d6f59494d-bzp74\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:31.148821 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:31.148755 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/943a1337-2968-4104-aa18-90f3cd407ea0-console-serving-cert\") pod \"console-7d6f59494d-bzp74\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:31.158764 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:31.158737 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d9ln\" (UniqueName: \"kubernetes.io/projected/943a1337-2968-4104-aa18-90f3cd407ea0-kube-api-access-4d9ln\") pod \"console-7d6f59494d-bzp74\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:31.273730 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:31.273621 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:31.549494 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:31.549422 2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d6f59494d-bzp74"] Nov 02 21:53:31.552470 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:53:31.552440 2569 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod943a1337_2968_4104_aa18_90f3cd407ea0.slice/crio-c226e31ec99116e0934c2bef84809cbf3754c952d373ee11f2e5763a8f62c26c WatchSource:0}: Error finding container c226e31ec99116e0934c2bef84809cbf3754c952d373ee11f2e5763a8f62c26c: Status 404 returned error can't find the container with id c226e31ec99116e0934c2bef84809cbf3754c952d373ee11f2e5763a8f62c26c Nov 02 21:53:31.564921 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:31.564901 2569 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:31.640266 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:31.640232 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d6f59494d-bzp74" event={"ID":"943a1337-2968-4104-aa18-90f3cd407ea0","Type":"ContainerStarted","Data":"c226e31ec99116e0934c2bef84809cbf3754c952d373ee11f2e5763a8f62c26c"} Nov 02 21:53:31.796465 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:31.796427 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:32.007019 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.006957 2569 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-jffwq"] Nov 02 21:53:32.011411 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.011387 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-jffwq" Nov 02 21:53:32.018530 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.018458 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Nov 02 21:53:32.018530 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.018503 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Nov 02 21:53:32.020562 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.020543 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:32.020809 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.020792 2569 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lzs7z"] Nov 02 21:53:32.021160 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.021146 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-h8996\"" Nov 02 21:53:32.023673 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.023637 2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-jffwq"] Nov 02 21:53:32.023768 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.023754 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:32.032733 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.032712 2569 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg"] Nov 02 21:53:32.035788 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.035772 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg" Nov 02 21:53:32.036645 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.036625 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Nov 02 21:53:32.050859 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.050841 2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg"] Nov 02 21:53:32.052105 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.052083 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-node-exporter-accelerators-collector-config\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:32.052213 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.052116 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9hbn\" (UniqueName: \"kubernetes.io/projected/4e73c1ca-fa5d-4485-a439-a6f8eb19a731-kube-api-access-r9hbn\") pod \"openshift-state-metrics-7bd7489957-jffwq\" (UID: \"4e73c1ca-fa5d-4485-a439-a6f8eb19a731\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-jffwq" Nov 02 21:53:32.052213 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.052135 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:32.052213 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.052197 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-root\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:32.052360 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.052294 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/52ac610d-a729-4e9f-b70b-700d30dbf64a-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-w8nqg\" (UID: \"52ac610d-a729-4e9f-b70b-700d30dbf64a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg" Nov 02 21:53:32.052360 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.052320 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gsxn\" (UniqueName: \"kubernetes.io/projected/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-kube-api-access-4gsxn\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:32.052360 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.052337 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e73c1ca-fa5d-4485-a439-a6f8eb19a731-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-jffwq\" (UID: \"4e73c1ca-fa5d-4485-a439-a6f8eb19a731\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-jffwq" Nov 02 21:53:32.052456 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.052359 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/52ac610d-a729-4e9f-b70b-700d30dbf64a-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-w8nqg\" (UID: \"52ac610d-a729-4e9f-b70b-700d30dbf64a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg" Nov 02 21:53:32.052487 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.052449 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqb44\" (UniqueName: \"kubernetes.io/projected/52ac610d-a729-4e9f-b70b-700d30dbf64a-kube-api-access-dqb44\") pod \"kube-state-metrics-5dc8d7d89b-w8nqg\" (UID: \"52ac610d-a729-4e9f-b70b-700d30dbf64a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg" Nov 02 21:53:32.052515 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.052501 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-sys\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:32.052568 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.052538 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/52ac610d-a729-4e9f-b70b-700d30dbf64a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-w8nqg\" (UID: \"52ac610d-a729-4e9f-b70b-700d30dbf64a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg" Nov 02 21:53:32.052600 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.052588 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-metrics-client-ca\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:32.052631 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.052606 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e73c1ca-fa5d-4485-a439-a6f8eb19a731-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-jffwq\" (UID: \"4e73c1ca-fa5d-4485-a439-a6f8eb19a731\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-jffwq" Nov 02 21:53:32.052631 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.052624 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e73c1ca-fa5d-4485-a439-a6f8eb19a731-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-jffwq\" (UID: \"4e73c1ca-fa5d-4485-a439-a6f8eb19a731\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-jffwq" Nov 02 21:53:32.052720 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.052675 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-node-exporter-textfile\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:32.052779 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.052765 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52ac610d-a729-4e9f-b70b-700d30dbf64a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-w8nqg\" (UID: \"52ac610d-a729-4e9f-b70b-700d30dbf64a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg" Nov 02 21:53:32.052812 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.052788 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-node-exporter-wtmp\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:32.052851 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.052821 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52ac610d-a729-4e9f-b70b-700d30dbf64a-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-w8nqg\" (UID: \"52ac610d-a729-4e9f-b70b-700d30dbf64a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg" Nov 02 21:53:32.052928 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.052910 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-node-exporter-tls\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:32.118887 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.118843 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Nov 02 21:53:32.118887 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.118843 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Nov 02 21:53:32.118887 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.118859 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-298jd\"" Nov 02 21:53:32.119141 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.118896 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Nov 02 21:53:32.119141 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.118968 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jnk9t\"" Nov 02 21:53:32.119141 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.119041 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Nov 02 21:53:32.132041 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.132011 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:32.136567 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.136547 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Nov 02 21:53:32.153839 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.153819 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52ac610d-a729-4e9f-b70b-700d30dbf64a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-w8nqg\" (UID: \"52ac610d-a729-4e9f-b70b-700d30dbf64a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg" Nov 02 21:53:32.153933 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.153846 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-node-exporter-wtmp\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:32.153933 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.153874 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52ac610d-a729-4e9f-b70b-700d30dbf64a-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-w8nqg\" (UID: \"52ac610d-a729-4e9f-b70b-700d30dbf64a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg" Nov 02 21:53:32.153933 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.153891 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-node-exporter-tls\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:32.154067 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.153961 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-node-exporter-accelerators-collector-config\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:32.154067 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.154006 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9hbn\" (UniqueName: \"kubernetes.io/projected/4e73c1ca-fa5d-4485-a439-a6f8eb19a731-kube-api-access-r9hbn\") pod \"openshift-state-metrics-7bd7489957-jffwq\" (UID: \"4e73c1ca-fa5d-4485-a439-a6f8eb19a731\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-jffwq" Nov 02 21:53:32.154067 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.154015 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-node-exporter-wtmp\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:32.154067 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.154040 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:32.154242 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.154194 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-root\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:32.154289 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.154263 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/52ac610d-a729-4e9f-b70b-700d30dbf64a-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-w8nqg\" (UID: \"52ac610d-a729-4e9f-b70b-700d30dbf64a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg" Nov 02 21:53:32.154350 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.154300 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gsxn\" (UniqueName: \"kubernetes.io/projected/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-kube-api-access-4gsxn\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:32.154350 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.154328 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e73c1ca-fa5d-4485-a439-a6f8eb19a731-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-jffwq\" (UID: \"4e73c1ca-fa5d-4485-a439-a6f8eb19a731\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-jffwq" Nov 02 21:53:32.154456 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.154366 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/52ac610d-a729-4e9f-b70b-700d30dbf64a-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-w8nqg\" (UID: \"52ac610d-a729-4e9f-b70b-700d30dbf64a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg" Nov 02 21:53:32.154456 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.154389 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqb44\" (UniqueName: \"kubernetes.io/projected/52ac610d-a729-4e9f-b70b-700d30dbf64a-kube-api-access-dqb44\") pod \"kube-state-metrics-5dc8d7d89b-w8nqg\" (UID: \"52ac610d-a729-4e9f-b70b-700d30dbf64a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg" Nov 02 21:53:32.154456 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.154431 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-sys\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:32.154607 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.154461 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/52ac610d-a729-4e9f-b70b-700d30dbf64a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-w8nqg\" (UID: \"52ac610d-a729-4e9f-b70b-700d30dbf64a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg" Nov 02 21:53:32.154607 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.154500 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-metrics-client-ca\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:32.154607 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.154527 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e73c1ca-fa5d-4485-a439-a6f8eb19a731-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-jffwq\" (UID: \"4e73c1ca-fa5d-4485-a439-a6f8eb19a731\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-jffwq" Nov 02 21:53:32.154607 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.154554 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e73c1ca-fa5d-4485-a439-a6f8eb19a731-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-jffwq\" (UID: \"4e73c1ca-fa5d-4485-a439-a6f8eb19a731\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-jffwq" Nov 02 21:53:32.154607 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.154583 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-node-exporter-textfile\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:32.154607 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.154595 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-node-exporter-accelerators-collector-config\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:32.154945 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.154636 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/52ac610d-a729-4e9f-b70b-700d30dbf64a-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-w8nqg\" (UID: \"52ac610d-a729-4e9f-b70b-700d30dbf64a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg" Nov 02 21:53:32.154945 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.154906 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-sys\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:32.154945 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.154935 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52ac610d-a729-4e9f-b70b-700d30dbf64a-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-w8nqg\" (UID: \"52ac610d-a729-4e9f-b70b-700d30dbf64a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg" Nov 02 21:53:32.155274 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.155242 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/52ac610d-a729-4e9f-b70b-700d30dbf64a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-w8nqg\" (UID: \"52ac610d-a729-4e9f-b70b-700d30dbf64a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg" Nov 02 21:53:32.155599 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.155502 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-metrics-client-ca\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:32.155599 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.155513 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-node-exporter-textfile\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:32.155599 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.155560 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-root\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:32.156364 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.156341 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e73c1ca-fa5d-4485-a439-a6f8eb19a731-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-jffwq\" (UID: \"4e73c1ca-fa5d-4485-a439-a6f8eb19a731\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-jffwq" Nov 02 21:53:32.157008 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.156981 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:32.157119 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.157070 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52ac610d-a729-4e9f-b70b-700d30dbf64a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-w8nqg\" (UID: \"52ac610d-a729-4e9f-b70b-700d30dbf64a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg" Nov 02 21:53:32.157220 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.157196 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-node-exporter-tls\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:32.157444 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.157426 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/52ac610d-a729-4e9f-b70b-700d30dbf64a-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-w8nqg\" (UID: \"52ac610d-a729-4e9f-b70b-700d30dbf64a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg" Nov 02 21:53:32.157967 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.157947 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e73c1ca-fa5d-4485-a439-a6f8eb19a731-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-jffwq\" (UID: \"4e73c1ca-fa5d-4485-a439-a6f8eb19a731\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-jffwq" Nov 02 21:53:32.158038 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.157981 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e73c1ca-fa5d-4485-a439-a6f8eb19a731-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-jffwq\" (UID: \"4e73c1ca-fa5d-4485-a439-a6f8eb19a731\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-jffwq" Nov 02 21:53:32.168040 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.167990 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9hbn\" (UniqueName: \"kubernetes.io/projected/4e73c1ca-fa5d-4485-a439-a6f8eb19a731-kube-api-access-r9hbn\") pod \"openshift-state-metrics-7bd7489957-jffwq\" (UID: \"4e73c1ca-fa5d-4485-a439-a6f8eb19a731\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-jffwq" Nov 02 21:53:32.168748 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.168729 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gsxn\" (UniqueName: \"kubernetes.io/projected/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-kube-api-access-4gsxn\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:32.169188 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.169164 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqb44\" (UniqueName: \"kubernetes.io/projected/52ac610d-a729-4e9f-b70b-700d30dbf64a-kube-api-access-dqb44\") pod \"kube-state-metrics-5dc8d7d89b-w8nqg\" (UID: \"52ac610d-a729-4e9f-b70b-700d30dbf64a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg" Nov 02 21:53:32.230213 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.230179 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:32.328046 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.328017 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-jffwq" Nov 02 21:53:32.330470 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.330443 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:32.339685 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.339636 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:32.351116 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.351089 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg" Nov 02 21:53:32.353389 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:53:32.353356 2569 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode71535c3_0a11_43fc_ad7e_4ea18213f0cf.slice/crio-32287d5eeb399a84296014918149d6f84f76c23abb32ef0a53092c34a1148076 WatchSource:0}: Error finding container 32287d5eeb399a84296014918149d6f84f76c23abb32ef0a53092c34a1148076: Status 404 returned error can't find the container with id 32287d5eeb399a84296014918149d6f84f76c23abb32ef0a53092c34a1148076 Nov 02 21:53:32.432283 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.432259 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:32.609890 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.609814 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:32.614864 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.614837 2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-jffwq"] Nov 02 21:53:32.617957 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:53:32.617928 2569 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e73c1ca_fa5d_4485_a439_a6f8eb19a731.slice/crio-6dfcc9201bb49276554033ae87390e30f9bf55f79b51e5115f0d11b528a8affd WatchSource:0}: Error finding container 6dfcc9201bb49276554033ae87390e30f9bf55f79b51e5115f0d11b528a8affd: Status 404 returned error can't find the container with id 6dfcc9201bb49276554033ae87390e30f9bf55f79b51e5115f0d11b528a8affd Nov 02 21:53:32.648557 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.648522 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lzs7z" event={"ID":"e71535c3-0a11-43fc-ad7e-4ea18213f0cf","Type":"ContainerStarted","Data":"32287d5eeb399a84296014918149d6f84f76c23abb32ef0a53092c34a1148076"} Nov 02 21:53:32.649016 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.648991 2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg"] Nov 02 21:53:32.650009 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:32.649980 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-jffwq" event={"ID":"4e73c1ca-fa5d-4485-a439-a6f8eb19a731","Type":"ContainerStarted","Data":"6dfcc9201bb49276554033ae87390e30f9bf55f79b51e5115f0d11b528a8affd"} Nov 02 21:53:32.652135 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:53:32.652111 2569 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52ac610d_a729_4e9f_b70b_700d30dbf64a.slice/crio-68ca63f9ce49f69740516bf93e90c055daa61df0fcaeada739b8405ef1e5a6bb WatchSource:0}: Error finding container 68ca63f9ce49f69740516bf93e90c055daa61df0fcaeada739b8405ef1e5a6bb: Status 404 returned error can't find the container with id 68ca63f9ce49f69740516bf93e90c055daa61df0fcaeada739b8405ef1e5a6bb Nov 02 21:53:33.023976 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.023896 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:33.103895 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.103859 2569 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 02 21:53:33.108830 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.108141 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.112619 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.112590 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Nov 02 21:53:33.112781 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.112646 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Nov 02 21:53:33.112781 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.112718 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Nov 02 21:53:33.112895 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.112806 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Nov 02 21:53:33.112895 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.112845 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Nov 02 21:53:33.112895 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.112887 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Nov 02 21:53:33.113096 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.112947 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Nov 02 21:53:33.113817 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.113782 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Nov 02 21:53:33.113817 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.113808 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-p5gzk\"" Nov 02 21:53:33.113960 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.113830 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Nov 02 21:53:33.128816 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.128771 2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 02 21:53:33.129555 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.129520 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:33.163684 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.163625 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.163821 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.163700 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.163821 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.163787 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.163896 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.163819 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.163896 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.163838 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-web-config\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.163967 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.163902 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-config-out\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.164048 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.164034 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mnfp\" (UniqueName: \"kubernetes.io/projected/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-kube-api-access-4mnfp\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.164091 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.164080 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.164125 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.164105 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.164163 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.164125 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.164241 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.164219 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.164283 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.164265 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-config-volume\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.164337 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.164322 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.229269 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.228902 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:33.265064 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.265027 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.265250 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.265067 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-web-config\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.265332 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.265303 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-config-out\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.265391 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.265365 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mnfp\" (UniqueName: \"kubernetes.io/projected/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-kube-api-access-4mnfp\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.265444 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.265416 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.265499 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.265456 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.265799 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.265776 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.265874 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.265822 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.265874 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.265857 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-config-volume\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.265975 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.265895 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.265975 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.265910 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.265975 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.265944 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.266113 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.265973 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.266113 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.266003 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.266341 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.266310 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.267735 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.267641 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.268999 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.268953 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-web-config\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.273706 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.270011 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.273706 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.270061 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.273706 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.270975 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.273706 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.270992 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.273706 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.271703 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.273706 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.271796 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.273706 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.273216 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-config-volume\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.276209 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.276162 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-config-out\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.282177 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.282135 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mnfp\" (UniqueName: \"kubernetes.io/projected/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-kube-api-access-4mnfp\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.391629 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.390368 2569 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-6bfc5dd8c9-24hxz"] Nov 02 21:53:33.394190 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.394165 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:33.407436 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.407380 2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bfc5dd8c9-24hxz"] Nov 02 21:53:33.410174 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.410149 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Nov 02 21:53:33.410930 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.410905 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:33.440085 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.440055 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:33.467930 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.467893 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-console-config\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:33.468090 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.467957 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2494f67-c3dd-4cc1-9035-da81cb1c6308-console-oauth-config\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:33.468090 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.468000 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wfn9\" (UniqueName: \"kubernetes.io/projected/e2494f67-c3dd-4cc1-9035-da81cb1c6308-kube-api-access-4wfn9\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:33.468090 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.468037 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-trusted-ca-bundle\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:33.468239 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.468116 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2494f67-c3dd-4cc1-9035-da81cb1c6308-console-serving-cert\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:33.468239 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.468144 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-service-ca\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:33.468239 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.468162 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2494f67-c3dd-4cc1-9035-da81cb1c6308-tmp\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:33.468239 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.468177 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-oauth-serving-cert\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:33.507034 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.506904 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:33.569064 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.569031 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-console-config\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:33.569223 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.569080 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2494f67-c3dd-4cc1-9035-da81cb1c6308-console-oauth-config\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:33.569223 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.569122 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wfn9\" (UniqueName: \"kubernetes.io/projected/e2494f67-c3dd-4cc1-9035-da81cb1c6308-kube-api-access-4wfn9\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:33.569223 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.569168 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-trusted-ca-bundle\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:33.569223 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.569221 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2494f67-c3dd-4cc1-9035-da81cb1c6308-console-serving-cert\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:33.569421 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.569256 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-service-ca\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:33.569421 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.569284 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2494f67-c3dd-4cc1-9035-da81cb1c6308-tmp\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:33.569421 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.569310 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-oauth-serving-cert\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:33.570931 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.570392 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-oauth-serving-cert\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:33.571283 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.571235 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-console-config\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:33.571436 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.571356 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2494f67-c3dd-4cc1-9035-da81cb1c6308-tmp\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:33.571436 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.571381 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-service-ca\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:33.571977 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.571931 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-trusted-ca-bundle\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:33.574258 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.574206 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2494f67-c3dd-4cc1-9035-da81cb1c6308-console-serving-cert\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:33.574258 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.574240 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2494f67-c3dd-4cc1-9035-da81cb1c6308-console-oauth-config\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:33.583379 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.583339 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wfn9\" (UniqueName: \"kubernetes.io/projected/e2494f67-c3dd-4cc1-9035-da81cb1c6308-kube-api-access-4wfn9\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:33.655318 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.655289 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg" event={"ID":"52ac610d-a729-4e9f-b70b-700d30dbf64a","Type":"ContainerStarted","Data":"68ca63f9ce49f69740516bf93e90c055daa61df0fcaeada739b8405ef1e5a6bb"} Nov 02 21:53:33.657445 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.657419 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-jffwq" event={"ID":"4e73c1ca-fa5d-4485-a439-a6f8eb19a731","Type":"ContainerStarted","Data":"bb3acbd199317720c95ed749c14b48e73d2587ac7d1d176da58b91565fab6aad"} Nov 02 21:53:33.657570 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.657467 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-jffwq" event={"ID":"4e73c1ca-fa5d-4485-a439-a6f8eb19a731","Type":"ContainerStarted","Data":"ff208a59d44094dc5bd65f389fd2e522e5b3be5075f29896a81d90606c5890f1"} Nov 02 21:53:33.713868 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.713832 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:33.744495 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:33.744390 2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 02 21:53:33.749538 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:53:33.749496 2569 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd45953b9_e0fd_49ec_9ec0_aa366fa92c79.slice/crio-20dee4bad545e8a356d919537c0f80d5a45ac3647ec5912cf8aa83ad05285258 WatchSource:0}: Error finding container 20dee4bad545e8a356d919537c0f80d5a45ac3647ec5912cf8aa83ad05285258: Status 404 returned error can't find the container with id 20dee4bad545e8a356d919537c0f80d5a45ac3647ec5912cf8aa83ad05285258 Nov 02 21:53:34.007249 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.007178 2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bfc5dd8c9-24hxz"] Nov 02 21:53:34.016217 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:53:34.016190 2569 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2494f67_c3dd_4cc1_9035_da81cb1c6308.slice/crio-b32881df604a3e3309316929c6e7485ad735c819a5dbedfe2c87ccf1b6bccdf8 WatchSource:0}: Error finding container b32881df604a3e3309316929c6e7485ad735c819a5dbedfe2c87ccf1b6bccdf8: Status 404 returned error can't find the container with id b32881df604a3e3309316929c6e7485ad735c819a5dbedfe2c87ccf1b6bccdf8 Nov 02 21:53:34.143334 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.143297 2569 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-74977cc9f9-qzn9x"] Nov 02 21:53:34.147314 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.147288 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:34.154796 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.154768 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Nov 02 21:53:34.155122 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.154919 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Nov 02 21:53:34.155122 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.155091 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-q5wrl\"" Nov 02 21:53:34.155981 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.155959 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Nov 02 21:53:34.156849 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.156819 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Nov 02 21:53:34.156951 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.156925 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Nov 02 21:53:34.158904 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.158887 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-7lqsboarsmul0\"" Nov 02 21:53:34.175149 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.175125 2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-74977cc9f9-qzn9x"] Nov 02 21:53:34.185912 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.185886 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e3415b9-cef2-439e-a516-f4adc73822c4-tmp\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:34.186022 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.185946 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2e3415b9-cef2-439e-a516-f4adc73822c4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:34.186074 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.186017 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2e3415b9-cef2-439e-a516-f4adc73822c4-secret-grpc-tls\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:34.186114 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.186095 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9bb7\" (UniqueName: \"kubernetes.io/projected/2e3415b9-cef2-439e-a516-f4adc73822c4-kube-api-access-j9bb7\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:34.186197 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.186160 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2e3415b9-cef2-439e-a516-f4adc73822c4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:34.186298 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.186274 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2e3415b9-cef2-439e-a516-f4adc73822c4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:34.186348 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.186319 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2e3415b9-cef2-439e-a516-f4adc73822c4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:34.186388 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.186372 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2e3415b9-cef2-439e-a516-f4adc73822c4-secret-thanos-querier-tls\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:34.186439 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.186407 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e3415b9-cef2-439e-a516-f4adc73822c4-metrics-client-ca\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:34.287425 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.287345 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e3415b9-cef2-439e-a516-f4adc73822c4-tmp\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:34.287425 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.287406 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2e3415b9-cef2-439e-a516-f4adc73822c4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:34.287650 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.287437 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2e3415b9-cef2-439e-a516-f4adc73822c4-secret-grpc-tls\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:34.287650 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.287459 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9bb7\" (UniqueName: \"kubernetes.io/projected/2e3415b9-cef2-439e-a516-f4adc73822c4-kube-api-access-j9bb7\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:34.287650 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.287504 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2e3415b9-cef2-439e-a516-f4adc73822c4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:34.287650 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.287552 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2e3415b9-cef2-439e-a516-f4adc73822c4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:34.287650 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.287580 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2e3415b9-cef2-439e-a516-f4adc73822c4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:34.287650 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.287625 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2e3415b9-cef2-439e-a516-f4adc73822c4-secret-thanos-querier-tls\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:34.287967 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.287655 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e3415b9-cef2-439e-a516-f4adc73822c4-metrics-client-ca\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:34.288424 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.288396 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e3415b9-cef2-439e-a516-f4adc73822c4-metrics-client-ca\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:34.288860 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.288822 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e3415b9-cef2-439e-a516-f4adc73822c4-tmp\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:34.290876 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.290849 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2e3415b9-cef2-439e-a516-f4adc73822c4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:34.290876 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.290865 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2e3415b9-cef2-439e-a516-f4adc73822c4-secret-grpc-tls\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:34.291048 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.291025 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2e3415b9-cef2-439e-a516-f4adc73822c4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:34.292428 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.292389 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2e3415b9-cef2-439e-a516-f4adc73822c4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:34.292959 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.292935 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2e3415b9-cef2-439e-a516-f4adc73822c4-secret-thanos-querier-tls\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:34.293648 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.293623 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2e3415b9-cef2-439e-a516-f4adc73822c4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:34.300782 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.300740 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9bb7\" (UniqueName: \"kubernetes.io/projected/2e3415b9-cef2-439e-a516-f4adc73822c4-kube-api-access-j9bb7\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:34.495420 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.495388 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:34.663848 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.663814 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-jffwq" event={"ID":"4e73c1ca-fa5d-4485-a439-a6f8eb19a731","Type":"ContainerStarted","Data":"6be856c4a51029fa52d5e4d2c792b9e7c8661d7249f560f4cfb1a3f800c88988"} Nov 02 21:53:34.665679 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.665634 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d45953b9-e0fd-49ec-9ec0-aa366fa92c79","Type":"ContainerStarted","Data":"20dee4bad545e8a356d919537c0f80d5a45ac3647ec5912cf8aa83ad05285258"} Nov 02 21:53:34.667501 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.667471 2569 generic.go:356] "Generic (PLEG): container finished" podID="e71535c3-0a11-43fc-ad7e-4ea18213f0cf" containerID="2d4148081faad2c22bfacd1f54f350c7646a3674f98a191693cc1105d312075d" exitCode=0 Nov 02 21:53:34.667618 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.667551 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lzs7z" event={"ID":"e71535c3-0a11-43fc-ad7e-4ea18213f0cf","Type":"ContainerDied","Data":"2d4148081faad2c22bfacd1f54f350c7646a3674f98a191693cc1105d312075d"} Nov 02 21:53:34.669003 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.668980 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bfc5dd8c9-24hxz" event={"ID":"e2494f67-c3dd-4cc1-9035-da81cb1c6308","Type":"ContainerStarted","Data":"b32881df604a3e3309316929c6e7485ad735c819a5dbedfe2c87ccf1b6bccdf8"} Nov 02 21:53:34.688042 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.687994 2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-jffwq" podStartSLOduration=2.420346925 podStartE2EDuration="3.687979815s" totalImagesPullingTime="1.26763289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 21:53:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:53:34.684783069 +0000 UTC m=+60.015366392" watchObservedRunningTime="2026-11-02 21:53:34.687979815 +0000 UTC m=+60.018563137" Nov 02 21:53:34.799363 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:34.799337 2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-74977cc9f9-qzn9x"] Nov 02 21:53:34.806984 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:53:34.806952 2569 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e3415b9_cef2_439e_a516_f4adc73822c4.slice/crio-8d2d30386797ac9b69c9c8d947700e2e4f8a7d33abdde1e3021c9147623865bd WatchSource:0}: Error finding container 8d2d30386797ac9b69c9c8d947700e2e4f8a7d33abdde1e3021c9147623865bd: Status 404 returned error can't find the container with id 8d2d30386797ac9b69c9c8d947700e2e4f8a7d33abdde1e3021c9147623865bd Nov 02 21:53:35.021279 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:35.021239 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:35.128335 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:35.128238 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:35.230121 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:35.229971 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:35.566519 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:35.566458 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:35.667866 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:35.667833 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:35.675572 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:35.675543 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d6f59494d-bzp74" event={"ID":"943a1337-2968-4104-aa18-90f3cd407ea0","Type":"ContainerStarted","Data":"c57340be14a0d5866af6287ffecc149c30dc77300aecf2ce4dd32d0e9bf2af39"} Nov 02 21:53:35.677908 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:35.677881 2569 generic.go:356] "Generic (PLEG): container finished" podID="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" containerID="a83d6a4a581be30b30f501dbc4934ec6538832baf6b39177932118adddb1d5b0" exitCode=0 Nov 02 21:53:35.678003 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:35.677965 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d45953b9-e0fd-49ec-9ec0-aa366fa92c79","Type":"ContainerDied","Data":"a83d6a4a581be30b30f501dbc4934ec6538832baf6b39177932118adddb1d5b0"} Nov 02 21:53:35.679825 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:35.679802 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" event={"ID":"2e3415b9-cef2-439e-a516-f4adc73822c4","Type":"ContainerStarted","Data":"8d2d30386797ac9b69c9c8d947700e2e4f8a7d33abdde1e3021c9147623865bd"} Nov 02 21:53:35.682620 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:35.682594 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lzs7z" event={"ID":"e71535c3-0a11-43fc-ad7e-4ea18213f0cf","Type":"ContainerStarted","Data":"a69e2b40e1365f72f5340e6eb10d27a8f74adc61da9a786712d579ef3a396c45"} Nov 02 21:53:35.682728 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:35.682646 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lzs7z" event={"ID":"e71535c3-0a11-43fc-ad7e-4ea18213f0cf","Type":"ContainerStarted","Data":"88d8bed5366861a66977a914dd865e1c1311d5cf1828e57831a7e59ba3bb5715"} Nov 02 21:53:35.686377 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:35.686150 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg" event={"ID":"52ac610d-a729-4e9f-b70b-700d30dbf64a","Type":"ContainerStarted","Data":"0f20e06efa3a3e6601dc7d024b1d102fba138cfb7937a0d2acec8bf32ddd6a44"} Nov 02 21:53:35.686377 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:35.686198 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg" event={"ID":"52ac610d-a729-4e9f-b70b-700d30dbf64a","Type":"ContainerStarted","Data":"02537a7933626d1ff27d405ade50b47a971c4a54e56bc4b0e1e3435403aca329"} Nov 02 21:53:35.686377 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:35.686222 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg" event={"ID":"52ac610d-a729-4e9f-b70b-700d30dbf64a","Type":"ContainerStarted","Data":"f279853bed392f50a10f27d885606881d0afc0c16057921f6dea19072105ed51"} Nov 02 21:53:35.696986 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:35.696912 2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-7d6f59494d-bzp74" podStartSLOduration=2.049451857 podStartE2EDuration="5.696900718s" totalImagesPullingTime="3.647448861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 21:53:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:53:35.696416674 +0000 UTC m=+61.026999999" watchObservedRunningTime="2026-11-02 21:53:35.696900718 +0000 UTC m=+61.027484041" Nov 02 21:53:35.720372 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:35.720328 2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lzs7z" podStartSLOduration=2.341672025 podStartE2EDuration="3.720313112s" totalImagesPullingTime="1.276014356s" totalInitContainerRuntime="102.626731ms" isStatefulPod=true podCreationTimestamp="2026-11-02 21:53:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:53:35.719421863 +0000 UTC m=+61.050005225" watchObservedRunningTime="2026-11-02 21:53:35.720313112 +0000 UTC m=+61.050896435" Nov 02 21:53:35.747133 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:35.747086 2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg" podStartSLOduration=1.703588448 podStartE2EDuration="3.747075504s" totalImagesPullingTime="2.043487056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 21:53:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:53:35.745772636 +0000 UTC m=+61.076355970" watchObservedRunningTime="2026-11-02 21:53:35.747075504 +0000 UTC m=+61.077658825" Nov 02 21:53:36.011783 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:36.011700 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:36.109725 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:36.109686 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:36.428239 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:36.427576 2569 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-76cf56f7bc-r5j6d"] Nov 02 21:53:36.431437 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:36.431408 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:53:36.436203 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:36.436092 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Nov 02 21:53:36.436203 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:36.436172 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Nov 02 21:53:36.443757 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:36.442050 2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-76cf56f7bc-r5j6d"] Nov 02 21:53:36.473778 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:36.473741 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-d7nj2\"" Nov 02 21:53:36.473951 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:36.473810 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Nov 02 21:53:36.473951 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:36.473739 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Nov 02 21:53:36.473951 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:36.473847 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-2me9mfojb6mr\"" Nov 02 21:53:36.514448 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:36.514373 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb3cdef3-ff8c-4e53-8852-81d064f58c21-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-76cf56f7bc-r5j6d\" (UID: \"cb3cdef3-ff8c-4e53-8852-81d064f58c21\") " pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:53:36.514448 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:36.514411 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb3cdef3-ff8c-4e53-8852-81d064f58c21-client-ca-bundle\") pod \"metrics-server-76cf56f7bc-r5j6d\" (UID: \"cb3cdef3-ff8c-4e53-8852-81d064f58c21\") " pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:53:36.514721 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:36.514460 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c47fh\" (UniqueName: \"kubernetes.io/projected/cb3cdef3-ff8c-4e53-8852-81d064f58c21-kube-api-access-c47fh\") pod \"metrics-server-76cf56f7bc-r5j6d\" (UID: \"cb3cdef3-ff8c-4e53-8852-81d064f58c21\") " pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:53:36.514721 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:36.514516 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/cb3cdef3-ff8c-4e53-8852-81d064f58c21-secret-metrics-server-client-certs\") pod \"metrics-server-76cf56f7bc-r5j6d\" (UID: \"cb3cdef3-ff8c-4e53-8852-81d064f58c21\") " pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:53:36.514721 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:36.514535 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/cb3cdef3-ff8c-4e53-8852-81d064f58c21-metrics-server-audit-profiles\") pod \"metrics-server-76cf56f7bc-r5j6d\" (UID: \"cb3cdef3-ff8c-4e53-8852-81d064f58c21\") " pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:53:36.514721 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:36.514556 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/cb3cdef3-ff8c-4e53-8852-81d064f58c21-secret-metrics-server-tls\") pod \"metrics-server-76cf56f7bc-r5j6d\" (UID: \"cb3cdef3-ff8c-4e53-8852-81d064f58c21\") " pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:53:36.514721 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:36.514591 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/cb3cdef3-ff8c-4e53-8852-81d064f58c21-audit-log\") pod \"metrics-server-76cf56f7bc-r5j6d\" (UID: \"cb3cdef3-ff8c-4e53-8852-81d064f58c21\") " pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:53:36.616075 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:36.616034 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb3cdef3-ff8c-4e53-8852-81d064f58c21-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-76cf56f7bc-r5j6d\" (UID: \"cb3cdef3-ff8c-4e53-8852-81d064f58c21\") " pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:53:36.616250 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:36.616091 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb3cdef3-ff8c-4e53-8852-81d064f58c21-client-ca-bundle\") pod \"metrics-server-76cf56f7bc-r5j6d\" (UID: \"cb3cdef3-ff8c-4e53-8852-81d064f58c21\") " pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:53:36.616250 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:36.616145 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c47fh\" (UniqueName: \"kubernetes.io/projected/cb3cdef3-ff8c-4e53-8852-81d064f58c21-kube-api-access-c47fh\") pod \"metrics-server-76cf56f7bc-r5j6d\" (UID: \"cb3cdef3-ff8c-4e53-8852-81d064f58c21\") " pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:53:36.616250 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:36.616205 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/cb3cdef3-ff8c-4e53-8852-81d064f58c21-secret-metrics-server-client-certs\") pod \"metrics-server-76cf56f7bc-r5j6d\" (UID: \"cb3cdef3-ff8c-4e53-8852-81d064f58c21\") " pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:53:36.616250 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:36.616235 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/cb3cdef3-ff8c-4e53-8852-81d064f58c21-metrics-server-audit-profiles\") pod \"metrics-server-76cf56f7bc-r5j6d\" (UID: \"cb3cdef3-ff8c-4e53-8852-81d064f58c21\") " pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:53:36.616471 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:36.616264 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/cb3cdef3-ff8c-4e53-8852-81d064f58c21-secret-metrics-server-tls\") pod \"metrics-server-76cf56f7bc-r5j6d\" (UID: \"cb3cdef3-ff8c-4e53-8852-81d064f58c21\") " pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:53:36.616471 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:36.616316 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/cb3cdef3-ff8c-4e53-8852-81d064f58c21-audit-log\") pod \"metrics-server-76cf56f7bc-r5j6d\" (UID: \"cb3cdef3-ff8c-4e53-8852-81d064f58c21\") " pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:53:36.616896 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:36.616704 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/cb3cdef3-ff8c-4e53-8852-81d064f58c21-audit-log\") pod \"metrics-server-76cf56f7bc-r5j6d\" (UID: \"cb3cdef3-ff8c-4e53-8852-81d064f58c21\") " pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:53:36.616896 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:36.616866 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb3cdef3-ff8c-4e53-8852-81d064f58c21-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-76cf56f7bc-r5j6d\" (UID: \"cb3cdef3-ff8c-4e53-8852-81d064f58c21\") " pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:53:36.617646 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:36.617626 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/cb3cdef3-ff8c-4e53-8852-81d064f58c21-metrics-server-audit-profiles\") pod \"metrics-server-76cf56f7bc-r5j6d\" (UID: \"cb3cdef3-ff8c-4e53-8852-81d064f58c21\") " pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:53:36.622854 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:36.622798 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/cb3cdef3-ff8c-4e53-8852-81d064f58c21-secret-metrics-server-tls\") pod \"metrics-server-76cf56f7bc-r5j6d\" (UID: \"cb3cdef3-ff8c-4e53-8852-81d064f58c21\") " pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:53:36.622955 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:36.622876 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb3cdef3-ff8c-4e53-8852-81d064f58c21-client-ca-bundle\") pod \"metrics-server-76cf56f7bc-r5j6d\" (UID: \"cb3cdef3-ff8c-4e53-8852-81d064f58c21\") " pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:53:36.625482 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:36.625176 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/cb3cdef3-ff8c-4e53-8852-81d064f58c21-secret-metrics-server-client-certs\") pod \"metrics-server-76cf56f7bc-r5j6d\" (UID: \"cb3cdef3-ff8c-4e53-8852-81d064f58c21\") " pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:53:36.628076 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:36.627238 2569 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ntgwx" Nov 02 21:53:36.629880 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:36.629834 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c47fh\" (UniqueName: \"kubernetes.io/projected/cb3cdef3-ff8c-4e53-8852-81d064f58c21-kube-api-access-c47fh\") pod \"metrics-server-76cf56f7bc-r5j6d\" (UID: \"cb3cdef3-ff8c-4e53-8852-81d064f58c21\") " pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:53:36.749899 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:36.749874 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:53:36.792567 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:36.792484 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:36.896634 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:36.896576 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:36.988650 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:36.988570 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:37.052878 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:37.052800 2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-76cf56f7bc-r5j6d"] Nov 02 21:53:37.067398 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:53:37.067372 2569 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb3cdef3_ff8c_4e53_8852_81d064f58c21.slice/crio-433c1bd296c4593fbeb70e1cde9d7d2c13ba40fc285ca4b1ad4251dddec2e8ba WatchSource:0}: Error finding container 433c1bd296c4593fbeb70e1cde9d7d2c13ba40fc285ca4b1ad4251dddec2e8ba: Status 404 returned error can't find the container with id 433c1bd296c4593fbeb70e1cde9d7d2c13ba40fc285ca4b1ad4251dddec2e8ba Nov 02 21:53:37.354796 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:37.354748 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:37.454920 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:37.454895 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:37.701417 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:37.701390 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d45953b9-e0fd-49ec-9ec0-aa366fa92c79","Type":"ContainerStarted","Data":"2f7b7a98f49c8a2c7473452f2cd54f3f12c37bdad32330eaeb1b13cfacc99690"} Nov 02 21:53:37.701565 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:37.701457 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d45953b9-e0fd-49ec-9ec0-aa366fa92c79","Type":"ContainerStarted","Data":"a822c83143587b2aacfbf41c2111f306b0ff11570eec49afcaf6b832a80059a6"} Nov 02 21:53:37.701565 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:37.701502 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d45953b9-e0fd-49ec-9ec0-aa366fa92c79","Type":"ContainerStarted","Data":"731aed8ef96af035785601ca05e4e1dd8ce19f381a2e2c518678e94c42a654f9"} Nov 02 21:53:37.701565 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:37.701533 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d45953b9-e0fd-49ec-9ec0-aa366fa92c79","Type":"ContainerStarted","Data":"e7c1b3941060b58914bbc302790fff4d58fd1b3eb80393d4f472eadb5f78c342"} Nov 02 21:53:37.701565 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:37.701557 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d45953b9-e0fd-49ec-9ec0-aa366fa92c79","Type":"ContainerStarted","Data":"66f253e12c92dd139d56b719ec01a70361e8d1af8d8cdf78cf944290e557bdea"} Nov 02 21:53:37.704233 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:37.704210 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" event={"ID":"2e3415b9-cef2-439e-a516-f4adc73822c4","Type":"ContainerStarted","Data":"4b39a0fdeff2187fa0e1da6c7b07241a6c0417f129e85a64a7bf4969fbd47e3a"} Nov 02 21:53:37.704358 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:37.704268 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" event={"ID":"2e3415b9-cef2-439e-a516-f4adc73822c4","Type":"ContainerStarted","Data":"8ce2dcf2a1aa56ccb31e51727462159fe67ce2f183a41aafa4d7b332e2503be1"} Nov 02 21:53:37.704358 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:37.704306 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" event={"ID":"2e3415b9-cef2-439e-a516-f4adc73822c4","Type":"ContainerStarted","Data":"f68e5fe0c475adbfa215c90d519d2928473c23142229cd0c0d126ea436071e16"} Nov 02 21:53:37.705521 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:37.705496 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" event={"ID":"cb3cdef3-ff8c-4e53-8852-81d064f58c21","Type":"ContainerStarted","Data":"433c1bd296c4593fbeb70e1cde9d7d2c13ba40fc285ca4b1ad4251dddec2e8ba"} Nov 02 21:53:37.707149 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:37.707125 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bfc5dd8c9-24hxz" event={"ID":"e2494f67-c3dd-4cc1-9035-da81cb1c6308","Type":"ContainerStarted","Data":"5e91b554665cbe9b1716333bdf78b5c533305322c1cc1aec5f9cf6938b33461d"} Nov 02 21:53:38.338341 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.333297 2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-6bfc5dd8c9-24hxz" podStartSLOduration=2.642032934 podStartE2EDuration="5.333270954s" totalImagesPullingTime="2.69123802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 21:53:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:53:37.727647437 +0000 UTC m=+63.058230761" watchObservedRunningTime="2026-11-02 21:53:38.333270954 +0000 UTC m=+63.663854277" Nov 02 21:53:38.338341 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.334549 2569 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Nov 02 21:53:38.346268 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.346235 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.351347 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.351322 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Nov 02 21:53:38.360860 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.360828 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:38.362244 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.362149 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Nov 02 21:53:38.369532 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.366716 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Nov 02 21:53:38.369532 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.366797 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Nov 02 21:53:38.369532 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.366799 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Nov 02 21:53:38.369532 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.366891 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Nov 02 21:53:38.369532 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.366988 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Nov 02 21:53:38.369532 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.367028 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Nov 02 21:53:38.369532 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.367101 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rfcf5\"" Nov 02 21:53:38.369532 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.367695 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Nov 02 21:53:38.369532 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.367742 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-409jhd5jfe14t\"" Nov 02 21:53:38.369532 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.369446 2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Nov 02 21:53:38.440388 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.440358 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr7j5\" (UniqueName: \"kubernetes.io/projected/646bc644-a377-48b5-bd3b-1562b53e93eb-kube-api-access-rr7j5\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.440488 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.440432 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.440488 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.440461 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.440588 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.440490 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.440588 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.440521 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.440588 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.440545 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.440588 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.440573 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.440829 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.440610 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.440829 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.440653 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-config\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.440829 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.440701 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.440829 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.440727 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/646bc644-a377-48b5-bd3b-1562b53e93eb-config-out\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.440829 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.440773 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.440829 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.440796 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.441117 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.440829 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.441117 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.440866 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/646bc644-a377-48b5-bd3b-1562b53e93eb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.441117 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.440912 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.441117 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.440938 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-web-config\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.441117 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.440977 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.441117 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.440999 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.441117 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.441038 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.453091 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.453066 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Nov 02 21:53:38.453182 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.453168 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Nov 02 21:53:38.453219 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.453209 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Nov 02 21:53:38.453454 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.453266 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Nov 02 21:53:38.453454 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.453339 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Nov 02 21:53:38.542045 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.542017 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.542208 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.542053 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.542208 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.542086 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.542208 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.542113 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr7j5\" (UniqueName: \"kubernetes.io/projected/646bc644-a377-48b5-bd3b-1562b53e93eb-kube-api-access-rr7j5\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.542208 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.542160 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.542208 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.542183 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.542457 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.542213 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.542457 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.542241 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.542457 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.542266 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.542457 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.542292 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.542457 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.542333 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.542457 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.542380 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-config\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.542457 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.542405 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.542457 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.542437 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/646bc644-a377-48b5-bd3b-1562b53e93eb-config-out\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.542838 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.542580 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.542838 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.542614 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.542838 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.542649 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.542838 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.542717 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/646bc644-a377-48b5-bd3b-1562b53e93eb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.543787 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.543358 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.543787 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.543582 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.543787 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.543617 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-web-config\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.544047 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.543909 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.546104 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.545045 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.546104 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.545829 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.546104 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.545917 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.547199 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.546961 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.547585 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.547539 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.547979 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.547922 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.549935 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.549906 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.552333 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.552310 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.553421 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.553193 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.553421 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.553213 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.553421 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.553373 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.554213 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.554082 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/646bc644-a377-48b5-bd3b-1562b53e93eb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.554883 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.554628 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-config\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.554883 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.554818 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.554883 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.554826 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.554883 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.554878 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/646bc644-a377-48b5-bd3b-1562b53e93eb-config-out\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.558087 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.558041 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-web-config\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.558942 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.558878 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr7j5\" (UniqueName: \"kubernetes.io/projected/646bc644-a377-48b5-bd3b-1562b53e93eb-kube-api-access-rr7j5\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.695052 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.695008 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:38.725675 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.722264 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d45953b9-e0fd-49ec-9ec0-aa366fa92c79","Type":"ContainerStarted","Data":"51c4c089d275254e34282547f9d0572366afcfb7b4bbe95f81003865158b1f4d"} Nov 02 21:53:38.729278 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.729160 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" event={"ID":"2e3415b9-cef2-439e-a516-f4adc73822c4","Type":"ContainerStarted","Data":"d004d67f284613cc64eaee31404ef0a536824abb2f4fb0d395c871968d8b2595"} Nov 02 21:53:38.729278 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.729219 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" event={"ID":"2e3415b9-cef2-439e-a516-f4adc73822c4","Type":"ContainerStarted","Data":"0379062a8a2f4c2533f706b1cc0c70f3507e2972d7cb0901c30913c2d3c04931"} Nov 02 21:53:38.729278 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.729246 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" event={"ID":"2e3415b9-cef2-439e-a516-f4adc73822c4","Type":"ContainerStarted","Data":"8a910087cbd506123fc5cd90945af978dd375632d861f6820f087861426b9973"} Nov 02 21:53:38.756958 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.756901 2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.583562009 podStartE2EDuration="5.756879376s" totalImagesPullingTime="4.156659577s" totalInitContainerRuntime="16.65779ms" isStatefulPod=false podCreationTimestamp="2026-11-02 21:53:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:53:38.755633285 +0000 UTC m=+64.086216605" watchObservedRunningTime="2026-11-02 21:53:38.756879376 +0000 UTC m=+64.087462699" Nov 02 21:53:38.789170 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:38.789107 2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" podStartSLOduration=1.488935289 podStartE2EDuration="4.789062027s" totalImagesPullingTime="3.300126738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 21:53:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:53:38.788371523 +0000 UTC m=+64.118954846" watchObservedRunningTime="2026-11-02 21:53:38.789062027 +0000 UTC m=+64.119645349" Nov 02 21:53:39.000233 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:39.000202 2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Nov 02 21:53:39.734183 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:39.734144 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" event={"ID":"cb3cdef3-ff8c-4e53-8852-81d064f58c21","Type":"ContainerStarted","Data":"d4749ee2ce0a9c1cbc4a2611e8aba85c8914631e7e237f2b3ea1167c48925f74"} Nov 02 21:53:39.735633 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:39.735608 2569 generic.go:356] "Generic (PLEG): container finished" podID="646bc644-a377-48b5-bd3b-1562b53e93eb" containerID="daa4ae9e23bc55b5e728ec658b4b361f8e847c756f967d68b8464ec4cf23b58a" exitCode=0 Nov 02 21:53:39.735769 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:39.735695 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"646bc644-a377-48b5-bd3b-1562b53e93eb","Type":"ContainerDied","Data":"daa4ae9e23bc55b5e728ec658b4b361f8e847c756f967d68b8464ec4cf23b58a"} Nov 02 21:53:39.735769 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:39.735750 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"646bc644-a377-48b5-bd3b-1562b53e93eb","Type":"ContainerStarted","Data":"249a9856013b47fb204ab861d32e3068bf3bb7d9a25cf8e8f901dfcb7321c0ed"} Nov 02 21:53:39.736183 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:39.736166 2569 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:39.756221 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:39.756172 2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" podStartSLOduration=1.931429326 podStartE2EDuration="3.756158617s" totalImagesPullingTime="1.824729291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 21:53:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:53:39.755145373 +0000 UTC m=+65.085728711" watchObservedRunningTime="2026-11-02 21:53:39.756158617 +0000 UTC m=+65.086741938" Nov 02 21:53:40.968370 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:40.968324 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84467c9f-0161-4e44-9420-dcc224215f05-metrics-certs\") pod \"network-metrics-daemon-gzkfr\" (UID: \"84467c9f-0161-4e44-9420-dcc224215f05\") " pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:53:40.971480 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:40.971458 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Nov 02 21:53:40.982678 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:40.982637 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84467c9f-0161-4e44-9420-dcc224215f05-metrics-certs\") pod \"network-metrics-daemon-gzkfr\" (UID: \"84467c9f-0161-4e44-9420-dcc224215f05\") " pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:53:41.069545 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:41.069512 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/649dd5b0-1649-4f63-a148-40fd3f3e07f4-original-pull-secret\") pod \"global-pull-secret-syncer-vcx54\" (UID: \"649dd5b0-1649-4f63-a148-40fd3f3e07f4\") " pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:53:41.069733 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:41.069566 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsdqt\" (UniqueName: \"kubernetes.io/projected/87451849-2618-4958-bc4a-114cc208434e-kube-api-access-fsdqt\") pod \"network-check-target-747nn\" (UID: \"87451849-2618-4958-bc4a-114cc208434e\") " pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:53:41.072702 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:41.072644 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Nov 02 21:53:41.075704 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:41.075655 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Nov 02 21:53:41.082527 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:41.082504 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/649dd5b0-1649-4f63-a148-40fd3f3e07f4-original-pull-secret\") pod \"global-pull-secret-syncer-vcx54\" (UID: \"649dd5b0-1649-4f63-a148-40fd3f3e07f4\") " pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:53:41.082827 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:41.082808 2569 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Nov 02 21:53:41.093283 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:41.093260 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsdqt\" (UniqueName: \"kubernetes.io/projected/87451849-2618-4958-bc4a-114cc208434e-kube-api-access-fsdqt\") pod \"network-check-target-747nn\" (UID: \"87451849-2618-4958-bc4a-114cc208434e\") " pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:53:41.198150 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:41.198110 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-k7pz9\"" Nov 02 21:53:41.205219 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:41.205175 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:53:41.211097 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:41.211075 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t9jzj\"" Nov 02 21:53:41.217857 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:41.217833 2569 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-g5nbb\"" Nov 02 21:53:41.219074 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:41.219016 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:53:41.224137 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:41.224117 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:53:41.278242 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:41.274000 2569 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:41.282035 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:41.278808 2569 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:41.290744 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:41.290539 2569 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:41.496536 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:41.496514 2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vcx54"] Nov 02 21:53:41.499384 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:53:41.499345 2569 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod649dd5b0_1649_4f63_a148_40fd3f3e07f4.slice/crio-b0c219fda0631bb6714472549c903682de2294233158f20ef03eb3fd1a222da4 WatchSource:0}: Error finding container b0c219fda0631bb6714472549c903682de2294233158f20ef03eb3fd1a222da4: Status 404 returned error can't find the container with id b0c219fda0631bb6714472549c903682de2294233158f20ef03eb3fd1a222da4 Nov 02 21:53:41.539975 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:41.539944 2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-747nn"] Nov 02 21:53:41.542242 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:41.542209 2569 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gzkfr"] Nov 02 21:53:41.542617 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:53:41.542589 2569 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87451849_2618_4958_bc4a_114cc208434e.slice/crio-d651d8300829fdc4f2ebf2387f9c67fbcd7e48bf36f859e83047c8beb6eadb41 WatchSource:0}: Error finding container d651d8300829fdc4f2ebf2387f9c67fbcd7e48bf36f859e83047c8beb6eadb41: Status 404 returned error can't find the container with id d651d8300829fdc4f2ebf2387f9c67fbcd7e48bf36f859e83047c8beb6eadb41 Nov 02 21:53:41.545827 ip-10-0-139-99 kubenswrapper[2569]: W1102 21:53:41.545795 2569 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84467c9f_0161_4e44_9420_dcc224215f05.slice/crio-e78d22ae35cb9c03e20ab4919fc73603d098e08b2144390099839d152875e5d9 WatchSource:0}: Error finding container e78d22ae35cb9c03e20ab4919fc73603d098e08b2144390099839d152875e5d9: Status 404 returned error can't find the container with id e78d22ae35cb9c03e20ab4919fc73603d098e08b2144390099839d152875e5d9 Nov 02 21:53:41.746213 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:41.746171 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-747nn" event={"ID":"87451849-2618-4958-bc4a-114cc208434e","Type":"ContainerStarted","Data":"d651d8300829fdc4f2ebf2387f9c67fbcd7e48bf36f859e83047c8beb6eadb41"} Nov 02 21:53:41.747773 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:41.747699 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gzkfr" event={"ID":"84467c9f-0161-4e44-9420-dcc224215f05","Type":"ContainerStarted","Data":"e78d22ae35cb9c03e20ab4919fc73603d098e08b2144390099839d152875e5d9"} Nov 02 21:53:41.749322 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:41.749298 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vcx54" event={"ID":"649dd5b0-1649-4f63-a148-40fd3f3e07f4","Type":"ContainerStarted","Data":"b0c219fda0631bb6714472549c903682de2294233158f20ef03eb3fd1a222da4"} Nov 02 21:53:41.753947 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:41.753927 2569 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:43.714926 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:43.714344 2569 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:43.714926 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:43.714391 2569 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:43.721168 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:43.721141 2569 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:43.780867 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:43.780831 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"646bc644-a377-48b5-bd3b-1562b53e93eb","Type":"ContainerStarted","Data":"a6b778bd10fca1d6914481751f929468997c44d9d7d0d5b6ba9ea62e7fefd537"} Nov 02 21:53:43.781300 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:43.781278 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"646bc644-a377-48b5-bd3b-1562b53e93eb","Type":"ContainerStarted","Data":"3e11aaf421ec33d0ae48bb2859868654890a42e2635ad23ef8d0d6393567fb39"} Nov 02 21:53:43.781702 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:43.781684 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"646bc644-a377-48b5-bd3b-1562b53e93eb","Type":"ContainerStarted","Data":"ad8531d2561f22bda8b1cd923aeca751cce0aa99f23652e49ed48ca64b10ab9b"} Nov 02 21:53:43.782370 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:43.782356 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"646bc644-a377-48b5-bd3b-1562b53e93eb","Type":"ContainerStarted","Data":"68fc175a79d05c447feb16ecda46d779005fd852e615f9114dbb856c46fab41a"} Nov 02 21:53:43.783884 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:43.783865 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gzkfr" event={"ID":"84467c9f-0161-4e44-9420-dcc224215f05","Type":"ContainerStarted","Data":"03c825dfd4a0e8222e5a0e0134b6c4438d2011cb8c91f8db606a12cf8eb23e16"} Nov 02 21:53:43.783991 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:43.783981 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gzkfr" event={"ID":"84467c9f-0161-4e44-9420-dcc224215f05","Type":"ContainerStarted","Data":"3adbc36c25b8d1a1aaaa9918c138d47a95f112ad478dac2e65ad2c9cc954e37a"} Nov 02 21:53:43.790843 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:43.790823 2569 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:43.806750 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:43.806695 2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gzkfr" podStartSLOduration=66.597733786 podStartE2EDuration="1m7.806677529s" totalImagesPullingTime="1.208943743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 21:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:53:43.805051035 +0000 UTC m=+69.135634358" watchObservedRunningTime="2026-11-02 21:53:43.806677529 +0000 UTC m=+69.137260842" Nov 02 21:53:43.860381 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:43.860066 2569 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d6f59494d-bzp74"] Nov 02 21:53:44.792701 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:44.791862 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"646bc644-a377-48b5-bd3b-1562b53e93eb","Type":"ContainerStarted","Data":"7980bd990e5b6a833ade5df5cd3d4c10ce2e910ceaebf2844249193e2ae9769c"} Nov 02 21:53:44.792701 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:44.791943 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"646bc644-a377-48b5-bd3b-1562b53e93eb","Type":"ContainerStarted","Data":"5a6e1638c722142ccf66a57de8d015e4503c0ea07f05702a3126733122cdd466"} Nov 02 21:53:44.832122 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:44.832073 2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.215331682 podStartE2EDuration="6.832057881s" totalImagesPullingTime="3.60059486s" totalInitContainerRuntime="16.131339ms" isStatefulPod=false podCreationTimestamp="2026-11-02 21:53:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:53:44.829585913 +0000 UTC m=+70.160169271" watchObservedRunningTime="2026-11-02 21:53:44.832057881 +0000 UTC m=+70.162641203" Nov 02 21:53:45.638399 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:45.638364 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:45.749458 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:45.748435 2569 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:45.800243 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:45.800206 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:46.525006 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:46.524968 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:46.626326 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:46.626267 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:46.805362 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:46.805332 2569 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-747nn" event={"ID":"87451849-2618-4958-bc4a-114cc208434e","Type":"ContainerStarted","Data":"15177ce31b2b5e83c5407966eed36e05cf07a51fe503db809d2d5e539f719e9c"} Nov 02 21:53:46.805771 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:46.805442 2569 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:53:46.826347 ip-10-0-139-99 kubenswrapper[2569]: I1102 21:53:46.826293 2569 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-747nn" podStartSLOduration=66.325840867 podStartE2EDuration="1m10.826276655s" totalImagesPullingTime="4.500435788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 21:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:53:46.825117118 +0000 UTC m=+72.155700442" watchObservedRunningTime="2026-11-02 21:53:46.826276655 +0000 UTC m=+72.156859976" Nov 02 21:53:47.685705 ip-10-0-139-99 systemd[1]: Stopping Kubernetes Kubelet... Nov 02 21:53:47.696072 ip-10-0-139-99 systemd[1]: kubelet.service: Deactivated successfully. Nov 02 21:53:47.696241 ip-10-0-139-99 systemd[1]: Stopped Kubernetes Kubelet. Nov 02 21:53:47.696294 ip-10-0-139-99 systemd[1]: kubelet.service: Consumed 4.808s CPU time. Nov 02 21:53:47.713402 ip-10-0-139-99 systemd[1]: Starting Kubernetes Kubelet... Nov 02 21:53:47.778811 ip-10-0-139-99 kubenswrapper[5963]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 02 21:53:47.778811 ip-10-0-139-99 kubenswrapper[5963]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Nov 02 21:53:47.778811 ip-10-0-139-99 kubenswrapper[5963]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 02 21:53:47.778811 ip-10-0-139-99 kubenswrapper[5963]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 02 21:53:47.782059 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.781951 5963 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 02 21:53:47.782059 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782054 5963 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 02 21:53:47.782059 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782059 5963 feature_gate.go:386] unrecognized feature gate: Example2 Nov 02 21:53:47.782059 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782062 5963 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 02 21:53:47.782059 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782065 5963 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 02 21:53:47.782059 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782067 5963 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 02 21:53:47.782059 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782070 5963 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 02 21:53:47.782341 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782073 5963 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 02 21:53:47.782341 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782076 5963 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 02 21:53:47.782341 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782079 5963 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 02 21:53:47.782341 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782081 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 02 21:53:47.782341 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782084 5963 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 02 21:53:47.782341 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782086 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 02 21:53:47.782341 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782089 5963 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 02 21:53:47.782341 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782091 5963 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 02 21:53:47.782341 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782094 5963 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 02 21:53:47.782341 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782097 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 02 21:53:47.782341 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782099 5963 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 02 21:53:47.782341 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782102 5963 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 02 21:53:47.782341 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782105 5963 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 02 21:53:47.782341 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782108 5963 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 02 21:53:47.782341 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782110 5963 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 02 21:53:47.782341 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782113 5963 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 02 21:53:47.782341 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782115 5963 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 02 21:53:47.782341 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782118 5963 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 02 21:53:47.782341 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782120 5963 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 02 21:53:47.782804 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782123 5963 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 02 21:53:47.782804 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782125 5963 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 02 21:53:47.782804 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782128 5963 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 02 21:53:47.782804 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782130 5963 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 02 21:53:47.782804 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782133 5963 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 02 21:53:47.782804 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782136 5963 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 02 21:53:47.782804 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782139 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 02 21:53:47.782804 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782141 5963 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 02 21:53:47.782804 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782144 5963 feature_gate.go:386] unrecognized feature gate: EVPN Nov 02 21:53:47.782804 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782149 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 02 21:53:47.782804 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782152 5963 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 02 21:53:47.782804 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782156 5963 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 02 21:53:47.782804 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782158 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 02 21:53:47.782804 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782161 5963 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 02 21:53:47.782804 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782164 5963 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 02 21:53:47.782804 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782166 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 02 21:53:47.782804 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782169 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 02 21:53:47.782804 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782172 5963 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 02 21:53:47.782804 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782174 5963 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 02 21:53:47.782804 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782176 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 02 21:53:47.783270 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782179 5963 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 02 21:53:47.783270 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782181 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 02 21:53:47.783270 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782184 5963 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 02 21:53:47.783270 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782186 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 02 21:53:47.783270 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782196 5963 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 02 21:53:47.783270 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782199 5963 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 02 21:53:47.783270 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782201 5963 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 02 21:53:47.783270 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782204 5963 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 02 21:53:47.783270 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782208 5963 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 02 21:53:47.783270 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782212 5963 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 02 21:53:47.783270 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782215 5963 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 02 21:53:47.783270 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782217 5963 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 02 21:53:47.783270 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782220 5963 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 02 21:53:47.783270 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782222 5963 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 02 21:53:47.783270 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782225 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 02 21:53:47.783270 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782227 5963 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 02 21:53:47.783270 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782229 5963 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 02 21:53:47.783270 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782232 5963 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 02 21:53:47.783270 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782234 5963 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 02 21:53:47.783730 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782237 5963 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 02 21:53:47.783730 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782239 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 02 21:53:47.783730 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782244 5963 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 02 21:53:47.783730 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782246 5963 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 02 21:53:47.783730 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782249 5963 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 02 21:53:47.783730 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782252 5963 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 02 21:53:47.783730 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782254 5963 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 02 21:53:47.783730 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782257 5963 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 02 21:53:47.783730 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782260 5963 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 02 21:53:47.783730 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782263 5963 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 02 21:53:47.783730 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782265 5963 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 02 21:53:47.783730 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782268 5963 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 02 21:53:47.783730 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782270 5963 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 02 21:53:47.783730 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782274 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 02 21:53:47.783730 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782276 5963 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 02 21:53:47.783730 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782279 5963 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 02 21:53:47.783730 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782281 5963 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 02 21:53:47.783730 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782284 5963 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 02 21:53:47.783730 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782294 5963 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 02 21:53:47.783730 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782296 5963 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 02 21:53:47.784196 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782299 5963 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 02 21:53:47.784196 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782302 5963 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 02 21:53:47.784196 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782304 5963 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 02 21:53:47.784196 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782306 5963 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 02 21:53:47.784196 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782311 5963 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 02 21:53:47.784196 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782315 5963 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 02 21:53:47.784196 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782318 5963 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 02 21:53:47.784196 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782321 5963 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 02 21:53:47.784196 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782323 5963 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 02 21:53:47.784196 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782326 5963 feature_gate.go:386] unrecognized feature gate: Example Nov 02 21:53:47.784196 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782328 5963 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 02 21:53:47.784196 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782330 5963 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 02 21:53:47.784196 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782333 5963 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 02 21:53:47.784196 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782336 5963 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 02 21:53:47.784196 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782339 5963 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 02 21:53:47.784196 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782342 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 02 21:53:47.784196 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782345 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 02 21:53:47.784196 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782347 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 02 21:53:47.784196 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782350 5963 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 02 21:53:47.784693 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782353 5963 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 02 21:53:47.784693 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.782356 5963 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 02 21:53:47.784693 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783184 5963 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 02 21:53:47.784693 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783191 5963 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 02 21:53:47.784693 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783194 5963 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 02 21:53:47.784693 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783197 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 02 21:53:47.784693 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783200 5963 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 02 21:53:47.784693 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783203 5963 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 02 21:53:47.784693 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783205 5963 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 02 21:53:47.784693 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783208 5963 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 02 21:53:47.784693 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783210 5963 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 02 21:53:47.784693 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783213 5963 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 02 21:53:47.784693 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783221 5963 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 02 21:53:47.784693 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783223 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 02 21:53:47.784693 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783226 5963 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 02 21:53:47.784693 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783229 5963 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 02 21:53:47.784693 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783232 5963 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 02 21:53:47.784693 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783235 5963 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 02 21:53:47.784693 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783237 5963 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 02 21:53:47.784693 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783240 5963 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 02 21:53:47.785225 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783243 5963 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 02 21:53:47.785225 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783245 5963 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 02 21:53:47.785225 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783248 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 02 21:53:47.785225 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783251 5963 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 02 21:53:47.785225 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783253 5963 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 02 21:53:47.785225 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783256 5963 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 02 21:53:47.785225 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783259 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 02 21:53:47.785225 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783262 5963 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 02 21:53:47.785225 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783264 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 02 21:53:47.785225 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783267 5963 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 02 21:53:47.785225 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783270 5963 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 02 21:53:47.785225 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783272 5963 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 02 21:53:47.785225 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783275 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 02 21:53:47.785225 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783278 5963 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 02 21:53:47.785225 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783280 5963 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 02 21:53:47.785225 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783283 5963 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 02 21:53:47.785225 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783285 5963 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 02 21:53:47.785225 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783297 5963 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 02 21:53:47.785225 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783301 5963 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 02 21:53:47.785696 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783305 5963 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 02 21:53:47.785696 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783308 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 02 21:53:47.785696 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783311 5963 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 02 21:53:47.785696 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783313 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 02 21:53:47.785696 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783315 5963 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 02 21:53:47.785696 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783318 5963 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 02 21:53:47.785696 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783328 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 02 21:53:47.785696 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783331 5963 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 02 21:53:47.785696 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783335 5963 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 02 21:53:47.785696 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783338 5963 feature_gate.go:386] unrecognized feature gate: Example Nov 02 21:53:47.785696 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783343 5963 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 02 21:53:47.785696 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783346 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 02 21:53:47.785696 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783348 5963 feature_gate.go:386] unrecognized feature gate: EVPN Nov 02 21:53:47.785696 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783351 5963 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 02 21:53:47.785696 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783353 5963 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 02 21:53:47.785696 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783356 5963 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 02 21:53:47.785696 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783359 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 02 21:53:47.785696 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783362 5963 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 02 21:53:47.785696 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783364 5963 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 02 21:53:47.786141 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783367 5963 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 02 21:53:47.786141 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783369 5963 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 02 21:53:47.786141 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783372 5963 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 02 21:53:47.786141 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783375 5963 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 02 21:53:47.786141 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783377 5963 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 02 21:53:47.786141 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783380 5963 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 02 21:53:47.786141 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783382 5963 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 02 21:53:47.786141 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783385 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 02 21:53:47.786141 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783387 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 02 21:53:47.786141 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783390 5963 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 02 21:53:47.786141 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783393 5963 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 02 21:53:47.786141 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783395 5963 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 02 21:53:47.786141 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783398 5963 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 02 21:53:47.786141 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783400 5963 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 02 21:53:47.786141 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783403 5963 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 02 21:53:47.786141 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783405 5963 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 02 21:53:47.786141 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783407 5963 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 02 21:53:47.786141 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783410 5963 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 02 21:53:47.786141 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783412 5963 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 02 21:53:47.786141 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783415 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 02 21:53:47.786622 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783423 5963 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 02 21:53:47.786622 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783427 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 02 21:53:47.786622 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783430 5963 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 02 21:53:47.786622 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783432 5963 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 02 21:53:47.786622 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783434 5963 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 02 21:53:47.786622 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783437 5963 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 02 21:53:47.786622 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783440 5963 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 02 21:53:47.786622 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783442 5963 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 02 21:53:47.786622 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783445 5963 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 02 21:53:47.786622 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783447 5963 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 02 21:53:47.786622 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783450 5963 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 02 21:53:47.786622 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783452 5963 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 02 21:53:47.786622 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783455 5963 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 02 21:53:47.786622 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783457 5963 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 02 21:53:47.786622 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783460 5963 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 02 21:53:47.786622 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783462 5963 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 02 21:53:47.786622 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783465 5963 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 02 21:53:47.786622 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783467 5963 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 02 21:53:47.786622 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783470 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 02 21:53:47.786622 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783472 5963 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 02 21:53:47.787111 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783475 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 02 21:53:47.787111 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783477 5963 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 02 21:53:47.787111 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783480 5963 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 02 21:53:47.787111 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783482 5963 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 02 21:53:47.787111 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783485 5963 feature_gate.go:386] unrecognized feature gate: Example2 Nov 02 21:53:47.787111 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783487 5963 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 02 21:53:47.787111 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783489 5963 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 02 21:53:47.787111 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783492 5963 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 02 21:53:47.787111 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783495 5963 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 02 21:53:47.787111 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.783498 5963 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 02 21:53:47.787111 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784105 5963 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 02 21:53:47.787111 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784111 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 02 21:53:47.787111 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784122 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 02 21:53:47.787111 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784126 5963 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 02 21:53:47.787111 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784129 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 02 21:53:47.787111 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784134 5963 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 02 21:53:47.787111 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784137 5963 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 02 21:53:47.787111 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784140 5963 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 02 21:53:47.787111 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784142 5963 feature_gate.go:386] unrecognized feature gate: EVPN Nov 02 21:53:47.787111 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784145 5963 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 02 21:53:47.787584 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784147 5963 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 02 21:53:47.787584 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784150 5963 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 02 21:53:47.787584 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784152 5963 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 02 21:53:47.787584 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784155 5963 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 02 21:53:47.787584 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784158 5963 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 02 21:53:47.787584 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784160 5963 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 02 21:53:47.787584 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784163 5963 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 02 21:53:47.787584 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784165 5963 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 02 21:53:47.787584 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784168 5963 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 02 21:53:47.787584 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784170 5963 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 02 21:53:47.787584 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784172 5963 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 02 21:53:47.787584 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784175 5963 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 02 21:53:47.787584 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784179 5963 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 02 21:53:47.787584 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784182 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 02 21:53:47.787584 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784185 5963 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 02 21:53:47.787584 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784187 5963 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 02 21:53:47.787584 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784190 5963 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 02 21:53:47.787584 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784193 5963 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 02 21:53:47.787584 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784197 5963 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 02 21:53:47.788063 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784200 5963 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 02 21:53:47.788063 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784203 5963 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 02 21:53:47.788063 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784206 5963 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 02 21:53:47.788063 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784209 5963 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 02 21:53:47.788063 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784211 5963 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 02 21:53:47.788063 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784214 5963 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 02 21:53:47.788063 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784222 5963 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 02 21:53:47.788063 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784225 5963 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 02 21:53:47.788063 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784228 5963 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 02 21:53:47.788063 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784231 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 02 21:53:47.788063 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784233 5963 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 02 21:53:47.788063 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784236 5963 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 02 21:53:47.788063 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784238 5963 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 02 21:53:47.788063 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784240 5963 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 02 21:53:47.788063 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784243 5963 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 02 21:53:47.788063 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784245 5963 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 02 21:53:47.788063 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784248 5963 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 02 21:53:47.788063 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784251 5963 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 02 21:53:47.788063 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784254 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 02 21:53:47.788063 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784256 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 02 21:53:47.788556 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784259 5963 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 02 21:53:47.788556 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784261 5963 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 02 21:53:47.788556 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784264 5963 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 02 21:53:47.788556 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784266 5963 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 02 21:53:47.788556 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784269 5963 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 02 21:53:47.788556 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784274 5963 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 02 21:53:47.788556 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784278 5963 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 02 21:53:47.788556 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784281 5963 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 02 21:53:47.788556 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784284 5963 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 02 21:53:47.788556 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784286 5963 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 02 21:53:47.788556 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784289 5963 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 02 21:53:47.788556 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784292 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 02 21:53:47.788556 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784294 5963 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 02 21:53:47.788556 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784297 5963 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 02 21:53:47.788556 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784299 5963 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 02 21:53:47.788556 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784302 5963 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 02 21:53:47.788556 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784304 5963 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 02 21:53:47.788556 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784307 5963 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 02 21:53:47.788556 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784309 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 02 21:53:47.789031 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784317 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 02 21:53:47.789031 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784321 5963 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 02 21:53:47.789031 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784323 5963 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 02 21:53:47.789031 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784326 5963 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 02 21:53:47.789031 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784328 5963 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 02 21:53:47.789031 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784330 5963 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 02 21:53:47.789031 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784333 5963 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 02 21:53:47.789031 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784336 5963 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 02 21:53:47.789031 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784339 5963 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 02 21:53:47.789031 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784341 5963 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 02 21:53:47.789031 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784344 5963 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 02 21:53:47.789031 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784346 5963 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 02 21:53:47.789031 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784349 5963 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 02 21:53:47.789031 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784352 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 02 21:53:47.789031 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784354 5963 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 02 21:53:47.789031 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784356 5963 feature_gate.go:386] unrecognized feature gate: Example Nov 02 21:53:47.789031 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784359 5963 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 02 21:53:47.789031 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784361 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 02 21:53:47.789031 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784365 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 02 21:53:47.789031 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784367 5963 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 02 21:53:47.789491 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784370 5963 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 02 21:53:47.789491 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784372 5963 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 02 21:53:47.789491 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784375 5963 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 02 21:53:47.789491 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784379 5963 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 02 21:53:47.789491 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784381 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 02 21:53:47.789491 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784384 5963 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 02 21:53:47.789491 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784386 5963 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 02 21:53:47.789491 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784388 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 02 21:53:47.789491 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784391 5963 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 02 21:53:47.789491 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784393 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 02 21:53:47.789491 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784396 5963 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 02 21:53:47.789491 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784398 5963 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 02 21:53:47.789491 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784401 5963 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 02 21:53:47.789491 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784405 5963 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 02 21:53:47.789491 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784407 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 02 21:53:47.789491 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784410 5963 feature_gate.go:386] unrecognized feature gate: Example2 Nov 02 21:53:47.789491 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784412 5963 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 02 21:53:47.789491 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.784415 5963 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 02 21:53:47.789491 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784515 5963 flags.go:64] FLAG: --address="0.0.0.0" Nov 02 21:53:47.789491 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784526 5963 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Nov 02 21:53:47.789491 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784535 5963 flags.go:64] FLAG: --anonymous-auth="true" Nov 02 21:53:47.790040 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784540 5963 flags.go:64] FLAG: --application-metrics-count-limit="100" Nov 02 21:53:47.790040 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784544 5963 flags.go:64] FLAG: --authentication-token-webhook="false" Nov 02 21:53:47.790040 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784547 5963 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Nov 02 21:53:47.790040 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784552 5963 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Nov 02 21:53:47.790040 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784556 5963 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Nov 02 21:53:47.790040 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784559 5963 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Nov 02 21:53:47.790040 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784562 5963 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Nov 02 21:53:47.790040 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784565 5963 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Nov 02 21:53:47.790040 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784569 5963 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Nov 02 21:53:47.790040 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784573 5963 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Nov 02 21:53:47.790040 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784576 5963 flags.go:64] FLAG: --cgroup-root="" Nov 02 21:53:47.790040 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784579 5963 flags.go:64] FLAG: --cgroups-per-qos="true" Nov 02 21:53:47.790040 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784582 5963 flags.go:64] FLAG: --client-ca-file="" Nov 02 21:53:47.790040 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784585 5963 flags.go:64] FLAG: --cloud-provider="external" Nov 02 21:53:47.790040 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784588 5963 flags.go:64] FLAG: --cluster-dns="[]" Nov 02 21:53:47.790040 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784594 5963 flags.go:64] FLAG: --cluster-domain="" Nov 02 21:53:47.790040 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784597 5963 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Nov 02 21:53:47.790040 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784600 5963 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Nov 02 21:53:47.790040 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784603 5963 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Nov 02 21:53:47.790040 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784607 5963 flags.go:64] FLAG: --container-log-max-files="5" Nov 02 21:53:47.790040 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784615 5963 flags.go:64] FLAG: --container-log-max-size="10Mi" Nov 02 21:53:47.790040 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784619 5963 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Nov 02 21:53:47.790040 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784622 5963 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Nov 02 21:53:47.790574 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784625 5963 flags.go:64] FLAG: --containerd-namespace="k8s.io" Nov 02 21:53:47.790574 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784628 5963 flags.go:64] FLAG: --contention-profiling="false" Nov 02 21:53:47.790574 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784631 5963 flags.go:64] FLAG: --cpu-cfs-quota="true" Nov 02 21:53:47.790574 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784634 5963 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Nov 02 21:53:47.790574 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784637 5963 flags.go:64] FLAG: --cpu-manager-policy="none" Nov 02 21:53:47.790574 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784640 5963 flags.go:64] FLAG: --cpu-manager-policy-options="" Nov 02 21:53:47.790574 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784644 5963 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Nov 02 21:53:47.790574 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784647 5963 flags.go:64] FLAG: --enable-controller-attach-detach="true" Nov 02 21:53:47.790574 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784650 5963 flags.go:64] FLAG: --enable-debugging-handlers="true" Nov 02 21:53:47.790574 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784653 5963 flags.go:64] FLAG: --enable-load-reader="false" Nov 02 21:53:47.790574 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784656 5963 flags.go:64] FLAG: --enable-server="true" Nov 02 21:53:47.790574 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784674 5963 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Nov 02 21:53:47.790574 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784680 5963 flags.go:64] FLAG: --event-burst="100" Nov 02 21:53:47.790574 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784683 5963 flags.go:64] FLAG: --event-qps="50" Nov 02 21:53:47.790574 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784686 5963 flags.go:64] FLAG: --event-storage-age-limit="default=0" Nov 02 21:53:47.790574 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784688 5963 flags.go:64] FLAG: --event-storage-event-limit="default=0" Nov 02 21:53:47.790574 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784691 5963 flags.go:64] FLAG: --eviction-hard="" Nov 02 21:53:47.790574 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784696 5963 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Nov 02 21:53:47.790574 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784701 5963 flags.go:64] FLAG: --eviction-minimum-reclaim="" Nov 02 21:53:47.790574 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784704 5963 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Nov 02 21:53:47.790574 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784707 5963 flags.go:64] FLAG: --eviction-soft="" Nov 02 21:53:47.790574 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784710 5963 flags.go:64] FLAG: --eviction-soft-grace-period="" Nov 02 21:53:47.790574 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784713 5963 flags.go:64] FLAG: --exit-on-lock-contention="false" Nov 02 21:53:47.790574 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784716 5963 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Nov 02 21:53:47.790574 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784719 5963 flags.go:64] FLAG: --experimental-mounter-path="" Nov 02 21:53:47.791196 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784722 5963 flags.go:64] FLAG: --fail-cgroupv1="true" Nov 02 21:53:47.791196 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784725 5963 flags.go:64] FLAG: --fail-swap-on="true" Nov 02 21:53:47.791196 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784728 5963 flags.go:64] FLAG: --feature-gates="" Nov 02 21:53:47.791196 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784733 5963 flags.go:64] FLAG: --file-check-frequency="20s" Nov 02 21:53:47.791196 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784736 5963 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Nov 02 21:53:47.791196 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784739 5963 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Nov 02 21:53:47.791196 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784742 5963 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Nov 02 21:53:47.791196 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784745 5963 flags.go:64] FLAG: --healthz-port="10248" Nov 02 21:53:47.791196 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784748 5963 flags.go:64] FLAG: --help="false" Nov 02 21:53:47.791196 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784751 5963 flags.go:64] FLAG: --hostname-override="ip-10-0-139-99.us-east-2.compute.internal" Nov 02 21:53:47.791196 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784755 5963 flags.go:64] FLAG: --housekeeping-interval="10s" Nov 02 21:53:47.791196 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784758 5963 flags.go:64] FLAG: --http-check-frequency="20s" Nov 02 21:53:47.791196 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784761 5963 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Nov 02 21:53:47.791196 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784764 5963 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Nov 02 21:53:47.791196 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784767 5963 flags.go:64] FLAG: --image-gc-high-threshold="85" Nov 02 21:53:47.791196 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784770 5963 flags.go:64] FLAG: --image-gc-low-threshold="80" Nov 02 21:53:47.791196 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784773 5963 flags.go:64] FLAG: --image-service-endpoint="" Nov 02 21:53:47.791196 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784775 5963 flags.go:64] FLAG: --kernel-memcg-notification="false" Nov 02 21:53:47.791196 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784778 5963 flags.go:64] FLAG: --kube-api-burst="100" Nov 02 21:53:47.791196 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784781 5963 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Nov 02 21:53:47.791196 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784784 5963 flags.go:64] FLAG: --kube-api-qps="50" Nov 02 21:53:47.791196 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784787 5963 flags.go:64] FLAG: --kube-reserved="" Nov 02 21:53:47.791196 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784789 5963 flags.go:64] FLAG: --kube-reserved-cgroup="" Nov 02 21:53:47.791196 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784792 5963 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Nov 02 21:53:47.791801 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784795 5963 flags.go:64] FLAG: --kubelet-cgroups="" Nov 02 21:53:47.791801 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784801 5963 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Nov 02 21:53:47.791801 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784804 5963 flags.go:64] FLAG: --lock-file="" Nov 02 21:53:47.791801 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784807 5963 flags.go:64] FLAG: --log-cadvisor-usage="false" Nov 02 21:53:47.791801 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784810 5963 flags.go:64] FLAG: --log-flush-frequency="5s" Nov 02 21:53:47.791801 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784813 5963 flags.go:64] FLAG: --log-json-info-buffer-size="0" Nov 02 21:53:47.791801 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784818 5963 flags.go:64] FLAG: --log-json-split-stream="false" Nov 02 21:53:47.791801 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784821 5963 flags.go:64] FLAG: --log-text-info-buffer-size="0" Nov 02 21:53:47.791801 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784824 5963 flags.go:64] FLAG: --log-text-split-stream="false" Nov 02 21:53:47.791801 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784827 5963 flags.go:64] FLAG: --logging-format="text" Nov 02 21:53:47.791801 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784830 5963 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Nov 02 21:53:47.791801 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784835 5963 flags.go:64] FLAG: --make-iptables-util-chains="true" Nov 02 21:53:47.791801 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784837 5963 flags.go:64] FLAG: --manifest-url="" Nov 02 21:53:47.791801 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784840 5963 flags.go:64] FLAG: --manifest-url-header="" Nov 02 21:53:47.791801 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784845 5963 flags.go:64] FLAG: --max-housekeeping-interval="15s" Nov 02 21:53:47.791801 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784848 5963 flags.go:64] FLAG: --max-open-files="1000000" Nov 02 21:53:47.791801 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784852 5963 flags.go:64] FLAG: --max-pods="110" Nov 02 21:53:47.791801 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784855 5963 flags.go:64] FLAG: --maximum-dead-containers="-1" Nov 02 21:53:47.791801 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784858 5963 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Nov 02 21:53:47.791801 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784861 5963 flags.go:64] FLAG: --memory-manager-policy="None" Nov 02 21:53:47.791801 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784864 5963 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Nov 02 21:53:47.791801 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784867 5963 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Nov 02 21:53:47.791801 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784870 5963 flags.go:64] FLAG: --node-ip="0.0.0.0" Nov 02 21:53:47.791801 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784873 5963 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Nov 02 21:53:47.791801 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784879 5963 flags.go:64] FLAG: --node-status-max-images="50" Nov 02 21:53:47.792401 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784883 5963 flags.go:64] FLAG: --node-status-update-frequency="10s" Nov 02 21:53:47.792401 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784886 5963 flags.go:64] FLAG: --oom-score-adj="-999" Nov 02 21:53:47.792401 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784889 5963 flags.go:64] FLAG: --pod-cidr="" Nov 02 21:53:47.792401 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784891 5963 flags.go:64] FLAG: --pod-manifest-path="" Nov 02 21:53:47.792401 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784894 5963 flags.go:64] FLAG: --pod-max-pids="-1" Nov 02 21:53:47.792401 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784897 5963 flags.go:64] FLAG: --pods-per-core="0" Nov 02 21:53:47.792401 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784900 5963 flags.go:64] FLAG: --port="10250" Nov 02 21:53:47.792401 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784903 5963 flags.go:64] FLAG: --protect-kernel-defaults="false" Nov 02 21:53:47.792401 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784906 5963 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-09688befc106c82d8" Nov 02 21:53:47.792401 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784909 5963 flags.go:64] FLAG: --qos-reserved="" Nov 02 21:53:47.792401 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784912 5963 flags.go:64] FLAG: --read-only-port="10255" Nov 02 21:53:47.792401 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784915 5963 flags.go:64] FLAG: --register-node="true" Nov 02 21:53:47.792401 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784918 5963 flags.go:64] FLAG: --register-with-taints="" Nov 02 21:53:47.792401 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784922 5963 flags.go:64] FLAG: --registry-burst="10" Nov 02 21:53:47.792401 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784925 5963 flags.go:64] FLAG: --registry-qps="5" Nov 02 21:53:47.792401 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784928 5963 flags.go:64] FLAG: --reserved-cpus="" Nov 02 21:53:47.792401 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784931 5963 flags.go:64] FLAG: --reserved-memory="" Nov 02 21:53:47.792401 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784934 5963 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Nov 02 21:53:47.792401 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784939 5963 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Nov 02 21:53:47.792401 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784942 5963 flags.go:64] FLAG: --rotate-certificates="false" Nov 02 21:53:47.792401 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784945 5963 flags.go:64] FLAG: --rotate-server-certificates="false" Nov 02 21:53:47.792401 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784948 5963 flags.go:64] FLAG: --runonce="false" Nov 02 21:53:47.792401 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784951 5963 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Nov 02 21:53:47.792401 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784954 5963 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Nov 02 21:53:47.792401 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784957 5963 flags.go:64] FLAG: --seccomp-default="false" Nov 02 21:53:47.792401 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784959 5963 flags.go:64] FLAG: --serialize-image-pulls="true" Nov 02 21:53:47.793050 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784962 5963 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Nov 02 21:53:47.793050 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784967 5963 flags.go:64] FLAG: --storage-driver-db="cadvisor" Nov 02 21:53:47.793050 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784970 5963 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Nov 02 21:53:47.793050 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784973 5963 flags.go:64] FLAG: --storage-driver-password="root" Nov 02 21:53:47.793050 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784976 5963 flags.go:64] FLAG: --storage-driver-secure="false" Nov 02 21:53:47.793050 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784978 5963 flags.go:64] FLAG: --storage-driver-table="stats" Nov 02 21:53:47.793050 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784981 5963 flags.go:64] FLAG: --storage-driver-user="root" Nov 02 21:53:47.793050 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784984 5963 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Nov 02 21:53:47.793050 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784987 5963 flags.go:64] FLAG: --sync-frequency="1m0s" Nov 02 21:53:47.793050 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784990 5963 flags.go:64] FLAG: --system-cgroups="" Nov 02 21:53:47.793050 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784992 5963 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Nov 02 21:53:47.793050 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.784998 5963 flags.go:64] FLAG: --system-reserved-cgroup="" Nov 02 21:53:47.793050 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.785001 5963 flags.go:64] FLAG: --tls-cert-file="" Nov 02 21:53:47.793050 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.785003 5963 flags.go:64] FLAG: --tls-cipher-suites="[]" Nov 02 21:53:47.793050 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.785009 5963 flags.go:64] FLAG: --tls-min-version="" Nov 02 21:53:47.793050 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.785012 5963 flags.go:64] FLAG: --tls-private-key-file="" Nov 02 21:53:47.793050 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.785014 5963 flags.go:64] FLAG: --topology-manager-policy="none" Nov 02 21:53:47.793050 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.785017 5963 flags.go:64] FLAG: --topology-manager-policy-options="" Nov 02 21:53:47.793050 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.785020 5963 flags.go:64] FLAG: --topology-manager-scope="container" Nov 02 21:53:47.793050 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.785023 5963 flags.go:64] FLAG: --v="2" Nov 02 21:53:47.793050 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.785028 5963 flags.go:64] FLAG: --version="false" Nov 02 21:53:47.793050 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.785032 5963 flags.go:64] FLAG: --vmodule="" Nov 02 21:53:47.793050 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.785035 5963 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Nov 02 21:53:47.793050 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.785039 5963 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Nov 02 21:53:47.793050 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785201 5963 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 02 21:53:47.793656 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785206 5963 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 02 21:53:47.793656 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785209 5963 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 02 21:53:47.793656 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785212 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 02 21:53:47.793656 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785215 5963 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 02 21:53:47.793656 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785218 5963 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 02 21:53:47.793656 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785220 5963 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 02 21:53:47.793656 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785223 5963 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 02 21:53:47.793656 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785226 5963 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 02 21:53:47.793656 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785228 5963 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 02 21:53:47.793656 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785231 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 02 21:53:47.793656 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785236 5963 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 02 21:53:47.793656 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785240 5963 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 02 21:53:47.793656 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785244 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 02 21:53:47.793656 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785247 5963 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 02 21:53:47.793656 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785249 5963 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 02 21:53:47.793656 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785252 5963 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 02 21:53:47.793656 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785254 5963 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 02 21:53:47.793656 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785257 5963 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 02 21:53:47.793656 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785259 5963 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 02 21:53:47.794146 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785262 5963 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 02 21:53:47.794146 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785264 5963 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 02 21:53:47.794146 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785268 5963 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 02 21:53:47.794146 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785271 5963 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 02 21:53:47.794146 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785273 5963 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 02 21:53:47.794146 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785276 5963 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 02 21:53:47.794146 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785278 5963 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 02 21:53:47.794146 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785281 5963 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 02 21:53:47.794146 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785283 5963 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 02 21:53:47.794146 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785286 5963 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 02 21:53:47.794146 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785288 5963 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 02 21:53:47.794146 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785291 5963 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 02 21:53:47.794146 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785294 5963 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 02 21:53:47.794146 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785297 5963 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 02 21:53:47.794146 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785299 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 02 21:53:47.794146 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785302 5963 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 02 21:53:47.794146 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785305 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 02 21:53:47.794146 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785307 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 02 21:53:47.794146 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785309 5963 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 02 21:53:47.794146 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785312 5963 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 02 21:53:47.795110 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785314 5963 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 02 21:53:47.795110 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785317 5963 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 02 21:53:47.795110 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785319 5963 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 02 21:53:47.795110 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785322 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 02 21:53:47.795110 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785325 5963 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 02 21:53:47.795110 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785327 5963 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 02 21:53:47.795110 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785330 5963 feature_gate.go:386] unrecognized feature gate: Example Nov 02 21:53:47.795110 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785332 5963 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 02 21:53:47.795110 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785335 5963 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 02 21:53:47.795110 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785337 5963 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 02 21:53:47.795110 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785340 5963 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 02 21:53:47.795110 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785342 5963 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 02 21:53:47.795110 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785344 5963 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 02 21:53:47.795110 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785347 5963 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 02 21:53:47.795110 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785350 5963 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 02 21:53:47.795110 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785353 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 02 21:53:47.795110 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785356 5963 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 02 21:53:47.795110 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785358 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 02 21:53:47.795110 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785361 5963 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 02 21:53:47.795110 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785363 5963 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 02 21:53:47.796170 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785366 5963 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 02 21:53:47.796170 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785368 5963 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 02 21:53:47.796170 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785371 5963 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 02 21:53:47.796170 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785373 5963 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 02 21:53:47.796170 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785377 5963 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 02 21:53:47.796170 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785380 5963 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 02 21:53:47.796170 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785382 5963 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 02 21:53:47.796170 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785385 5963 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 02 21:53:47.796170 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785387 5963 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 02 21:53:47.796170 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785390 5963 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 02 21:53:47.796170 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785392 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 02 21:53:47.796170 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785395 5963 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 02 21:53:47.796170 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785398 5963 feature_gate.go:386] unrecognized feature gate: EVPN Nov 02 21:53:47.796170 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785400 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 02 21:53:47.796170 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785403 5963 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 02 21:53:47.796170 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785405 5963 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 02 21:53:47.796170 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785408 5963 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 02 21:53:47.796170 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785411 5963 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 02 21:53:47.796170 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785413 5963 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 02 21:53:47.796871 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785416 5963 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 02 21:53:47.796871 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785418 5963 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 02 21:53:47.796871 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785421 5963 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 02 21:53:47.796871 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785424 5963 feature_gate.go:386] unrecognized feature gate: Example2 Nov 02 21:53:47.796871 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785426 5963 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 02 21:53:47.796871 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785429 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 02 21:53:47.796871 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785431 5963 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 02 21:53:47.796871 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785435 5963 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 02 21:53:47.796871 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785437 5963 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 02 21:53:47.796871 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785440 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 02 21:53:47.796871 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785443 5963 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 02 21:53:47.796871 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785445 5963 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 02 21:53:47.796871 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785448 5963 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 02 21:53:47.796871 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785450 5963 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 02 21:53:47.796871 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785453 5963 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 02 21:53:47.796871 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785455 5963 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 02 21:53:47.796871 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785457 5963 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 02 21:53:47.796871 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785461 5963 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 02 21:53:47.796871 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785464 5963 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 02 21:53:47.797345 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785467 5963 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 02 21:53:47.797345 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785469 5963 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 02 21:53:47.797345 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785472 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 02 21:53:47.797345 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785474 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 02 21:53:47.797345 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785478 5963 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 02 21:53:47.797345 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785482 5963 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 02 21:53:47.797345 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785485 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 02 21:53:47.797345 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785488 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 02 21:53:47.797345 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.785514 5963 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 02 21:53:47.797345 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785566 5963 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 02 21:53:47.797345 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785571 5963 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 02 21:53:47.797345 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785575 5963 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 02 21:53:47.797345 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785578 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 02 21:53:47.797345 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785580 5963 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 02 21:53:47.797345 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785583 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 02 21:53:47.797879 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785585 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 02 21:53:47.797879 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785588 5963 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 02 21:53:47.797879 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785590 5963 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 02 21:53:47.797879 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785593 5963 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 02 21:53:47.797879 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785595 5963 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 02 21:53:47.797879 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785598 5963 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 02 21:53:47.797879 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785602 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 02 21:53:47.797879 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785605 5963 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 02 21:53:47.797879 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785607 5963 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 02 21:53:47.797879 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785610 5963 feature_gate.go:386] unrecognized feature gate: Example Nov 02 21:53:47.797879 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785612 5963 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 02 21:53:47.797879 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785615 5963 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 02 21:53:47.797879 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785617 5963 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 02 21:53:47.797879 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785620 5963 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 02 21:53:47.797879 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785622 5963 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 02 21:53:47.797879 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785626 5963 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 02 21:53:47.797879 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785629 5963 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 02 21:53:47.797879 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785632 5963 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 02 21:53:47.797879 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785634 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 02 21:53:47.797879 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785636 5963 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 02 21:53:47.798340 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785639 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 02 21:53:47.798340 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785642 5963 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 02 21:53:47.798340 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785644 5963 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 02 21:53:47.798340 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785647 5963 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 02 21:53:47.798340 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785649 5963 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 02 21:53:47.798340 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785652 5963 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 02 21:53:47.798340 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785654 5963 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 02 21:53:47.798340 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785657 5963 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 02 21:53:47.798340 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785676 5963 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 02 21:53:47.798340 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785680 5963 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 02 21:53:47.798340 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785684 5963 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 02 21:53:47.798340 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785687 5963 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 02 21:53:47.798340 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785690 5963 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 02 21:53:47.798340 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785692 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 02 21:53:47.798340 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785695 5963 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 02 21:53:47.798340 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785698 5963 feature_gate.go:386] unrecognized feature gate: EVPN Nov 02 21:53:47.798340 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785700 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 02 21:53:47.798340 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785703 5963 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 02 21:53:47.798340 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785707 5963 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 02 21:53:47.798810 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785710 5963 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 02 21:53:47.798810 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785712 5963 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 02 21:53:47.798810 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785715 5963 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 02 21:53:47.798810 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785717 5963 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 02 21:53:47.798810 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785720 5963 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 02 21:53:47.798810 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785722 5963 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 02 21:53:47.798810 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785725 5963 feature_gate.go:386] unrecognized feature gate: Example2 Nov 02 21:53:47.798810 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785728 5963 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 02 21:53:47.798810 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785732 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 02 21:53:47.798810 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785735 5963 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 02 21:53:47.798810 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785737 5963 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 02 21:53:47.798810 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785740 5963 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 02 21:53:47.798810 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785742 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 02 21:53:47.798810 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785744 5963 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 02 21:53:47.798810 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785747 5963 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 02 21:53:47.798810 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785749 5963 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 02 21:53:47.798810 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785752 5963 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 02 21:53:47.798810 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785754 5963 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 02 21:53:47.798810 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785756 5963 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 02 21:53:47.798810 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785759 5963 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 02 21:53:47.799322 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785761 5963 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 02 21:53:47.799322 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785764 5963 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 02 21:53:47.799322 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785767 5963 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 02 21:53:47.799322 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785770 5963 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 02 21:53:47.799322 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785773 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 02 21:53:47.799322 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785776 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 02 21:53:47.799322 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785780 5963 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 02 21:53:47.799322 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785783 5963 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 02 21:53:47.799322 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785786 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 02 21:53:47.799322 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785789 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 02 21:53:47.799322 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785792 5963 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 02 21:53:47.799322 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785795 5963 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 02 21:53:47.799322 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785798 5963 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 02 21:53:47.799322 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785800 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 02 21:53:47.799322 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785803 5963 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 02 21:53:47.799322 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785805 5963 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 02 21:53:47.799322 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785807 5963 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 02 21:53:47.799322 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785810 5963 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 02 21:53:47.799322 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785812 5963 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 02 21:53:47.799988 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785815 5963 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 02 21:53:47.799988 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785819 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 02 21:53:47.799988 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785823 5963 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 02 21:53:47.799988 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785826 5963 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 02 21:53:47.799988 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785829 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 02 21:53:47.799988 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785832 5963 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 02 21:53:47.799988 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785835 5963 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 02 21:53:47.799988 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785837 5963 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 02 21:53:47.799988 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785840 5963 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 02 21:53:47.799988 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785843 5963 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 02 21:53:47.799988 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785846 5963 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 02 21:53:47.799988 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785849 5963 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 02 21:53:47.799988 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785851 5963 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 02 21:53:47.799988 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785853 5963 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 02 21:53:47.799988 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785856 5963 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 02 21:53:47.799988 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785858 5963 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 02 21:53:47.799988 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785861 5963 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 02 21:53:47.799988 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785863 5963 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 02 21:53:47.799988 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785866 5963 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 02 21:53:47.800742 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785868 5963 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 02 21:53:47.800742 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785871 5963 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 02 21:53:47.800742 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.785874 5963 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 02 21:53:47.800742 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.789922 5963 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Nov 02 21:53:47.800742 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.789942 5963 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Nov 02 21:53:47.800742 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.789962 5963 watchdog_linux.go:95] "Systemd watchdog is not enabled" Nov 02 21:53:47.800742 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.789967 5963 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Nov 02 21:53:47.800742 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790041 5963 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 02 21:53:47.800742 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790047 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 02 21:53:47.800742 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790050 5963 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 02 21:53:47.800742 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790054 5963 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 02 21:53:47.800742 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790057 5963 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 02 21:53:47.800742 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790060 5963 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 02 21:53:47.800742 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790063 5963 feature_gate.go:386] unrecognized feature gate: Example2 Nov 02 21:53:47.800742 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790065 5963 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 02 21:53:47.800742 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790068 5963 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 02 21:53:47.800742 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790071 5963 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 02 21:53:47.800742 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790073 5963 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 02 21:53:47.800742 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790076 5963 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 02 21:53:47.800742 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790079 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 02 21:53:47.801226 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790081 5963 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 02 21:53:47.801226 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790084 5963 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 02 21:53:47.801226 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790086 5963 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 02 21:53:47.801226 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790089 5963 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 02 21:53:47.801226 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790091 5963 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 02 21:53:47.801226 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790094 5963 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 02 21:53:47.801226 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790096 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 02 21:53:47.801226 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790099 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 02 21:53:47.801226 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790101 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 02 21:53:47.801226 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790104 5963 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 02 21:53:47.801226 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790106 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 02 21:53:47.801226 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790109 5963 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 02 21:53:47.801226 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790112 5963 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 02 21:53:47.801226 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790115 5963 feature_gate.go:386] unrecognized feature gate: EVPN Nov 02 21:53:47.801226 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790117 5963 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 02 21:53:47.801226 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790120 5963 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 02 21:53:47.801226 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790124 5963 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 02 21:53:47.801226 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790127 5963 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 02 21:53:47.801226 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790129 5963 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 02 21:53:47.801226 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790131 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 02 21:53:47.801716 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790134 5963 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 02 21:53:47.801716 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790136 5963 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 02 21:53:47.801716 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790139 5963 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 02 21:53:47.801716 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790142 5963 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 02 21:53:47.801716 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790145 5963 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 02 21:53:47.801716 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790147 5963 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 02 21:53:47.801716 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790150 5963 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 02 21:53:47.801716 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790152 5963 feature_gate.go:386] unrecognized feature gate: Example Nov 02 21:53:47.801716 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790155 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 02 21:53:47.801716 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790158 5963 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 02 21:53:47.801716 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790161 5963 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 02 21:53:47.801716 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790163 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 02 21:53:47.801716 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790166 5963 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 02 21:53:47.801716 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790168 5963 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 02 21:53:47.801716 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790171 5963 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 02 21:53:47.801716 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790173 5963 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 02 21:53:47.801716 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790176 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 02 21:53:47.801716 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790178 5963 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 02 21:53:47.801716 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790181 5963 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 02 21:53:47.802210 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790183 5963 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 02 21:53:47.802210 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790186 5963 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 02 21:53:47.802210 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790189 5963 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 02 21:53:47.802210 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790192 5963 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 02 21:53:47.802210 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790194 5963 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 02 21:53:47.802210 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790197 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 02 21:53:47.802210 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790199 5963 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 02 21:53:47.802210 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790202 5963 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 02 21:53:47.802210 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790205 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 02 21:53:47.802210 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790207 5963 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 02 21:53:47.802210 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790211 5963 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 02 21:53:47.802210 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790214 5963 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 02 21:53:47.802210 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790216 5963 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 02 21:53:47.802210 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790219 5963 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 02 21:53:47.802210 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790222 5963 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 02 21:53:47.802210 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790224 5963 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 02 21:53:47.802210 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790227 5963 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 02 21:53:47.802210 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790229 5963 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 02 21:53:47.802210 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790231 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 02 21:53:47.802210 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790234 5963 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 02 21:53:47.802707 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790237 5963 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 02 21:53:47.802707 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790239 5963 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 02 21:53:47.802707 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790243 5963 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 02 21:53:47.802707 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790246 5963 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 02 21:53:47.802707 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790249 5963 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 02 21:53:47.802707 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790251 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 02 21:53:47.802707 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790254 5963 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 02 21:53:47.802707 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790256 5963 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 02 21:53:47.802707 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790259 5963 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 02 21:53:47.802707 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790262 5963 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 02 21:53:47.802707 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790265 5963 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 02 21:53:47.802707 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790267 5963 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 02 21:53:47.802707 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790270 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 02 21:53:47.802707 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790273 5963 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 02 21:53:47.802707 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790275 5963 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 02 21:53:47.802707 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790278 5963 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 02 21:53:47.802707 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790280 5963 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 02 21:53:47.802707 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790283 5963 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 02 21:53:47.802707 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790286 5963 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 02 21:53:47.803177 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790288 5963 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 02 21:53:47.803177 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790291 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 02 21:53:47.803177 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790294 5963 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 02 21:53:47.803177 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790297 5963 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 02 21:53:47.803177 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790300 5963 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 02 21:53:47.803177 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790303 5963 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 02 21:53:47.803177 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790307 5963 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 02 21:53:47.803177 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790311 5963 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 02 21:53:47.803177 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790313 5963 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 02 21:53:47.803177 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790316 5963 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 02 21:53:47.803177 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790319 5963 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 02 21:53:47.803177 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790321 5963 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 02 21:53:47.803177 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790324 5963 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 02 21:53:47.803177 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790326 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 02 21:53:47.803177 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790329 5963 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 02 21:53:47.803177 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.790357 5963 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 02 21:53:47.803617 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790510 5963 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 02 21:53:47.803617 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790516 5963 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 02 21:53:47.803617 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790519 5963 feature_gate.go:386] unrecognized feature gate: Example2 Nov 02 21:53:47.803617 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790522 5963 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 02 21:53:47.803617 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790524 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 02 21:53:47.803617 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790527 5963 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 02 21:53:47.803617 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790530 5963 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 02 21:53:47.803617 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790532 5963 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 02 21:53:47.803617 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790535 5963 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 02 21:53:47.803617 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790538 5963 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 02 21:53:47.803617 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790541 5963 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 02 21:53:47.803617 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790543 5963 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 02 21:53:47.803617 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790546 5963 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 02 21:53:47.803617 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790549 5963 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 02 21:53:47.803617 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790551 5963 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 02 21:53:47.803617 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790553 5963 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 02 21:53:47.803617 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790556 5963 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 02 21:53:47.803617 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790559 5963 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 02 21:53:47.803617 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790561 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 02 21:53:47.803617 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790564 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 02 21:53:47.804144 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790566 5963 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 02 21:53:47.804144 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790570 5963 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 02 21:53:47.804144 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790572 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 02 21:53:47.804144 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790575 5963 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 02 21:53:47.804144 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790577 5963 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 02 21:53:47.804144 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790580 5963 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 02 21:53:47.804144 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790583 5963 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 02 21:53:47.804144 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790585 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 02 21:53:47.804144 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790588 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 02 21:53:47.804144 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790590 5963 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 02 21:53:47.804144 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790593 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 02 21:53:47.804144 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790596 5963 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 02 21:53:47.804144 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790598 5963 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 02 21:53:47.804144 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790601 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 02 21:53:47.804144 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790603 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 02 21:53:47.804144 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790606 5963 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 02 21:53:47.804144 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790608 5963 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 02 21:53:47.804144 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790611 5963 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 02 21:53:47.804144 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790613 5963 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 02 21:53:47.804593 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790616 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 02 21:53:47.804593 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790619 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 02 21:53:47.804593 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790621 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 02 21:53:47.804593 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790624 5963 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 02 21:53:47.804593 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790627 5963 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 02 21:53:47.804593 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790629 5963 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 02 21:53:47.804593 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790632 5963 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 02 21:53:47.804593 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790635 5963 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 02 21:53:47.804593 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790637 5963 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 02 21:53:47.804593 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790639 5963 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 02 21:53:47.804593 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790642 5963 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 02 21:53:47.804593 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790645 5963 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 02 21:53:47.804593 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790647 5963 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 02 21:53:47.804593 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790650 5963 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 02 21:53:47.804593 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790653 5963 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 02 21:53:47.804593 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790656 5963 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 02 21:53:47.804593 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790682 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 02 21:53:47.804593 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790685 5963 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 02 21:53:47.804593 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790688 5963 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 02 21:53:47.805103 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790691 5963 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 02 21:53:47.805103 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790693 5963 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 02 21:53:47.805103 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790696 5963 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 02 21:53:47.805103 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790698 5963 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 02 21:53:47.805103 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790701 5963 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 02 21:53:47.805103 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790703 5963 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 02 21:53:47.805103 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790706 5963 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 02 21:53:47.805103 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790708 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 02 21:53:47.805103 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790711 5963 feature_gate.go:386] unrecognized feature gate: Example Nov 02 21:53:47.805103 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790713 5963 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 02 21:53:47.805103 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790716 5963 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 02 21:53:47.805103 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790719 5963 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 02 21:53:47.805103 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790722 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 02 21:53:47.805103 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790724 5963 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 02 21:53:47.805103 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790727 5963 feature_gate.go:386] unrecognized feature gate: EVPN Nov 02 21:53:47.805103 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790729 5963 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 02 21:53:47.805103 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790732 5963 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 02 21:53:47.805103 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790734 5963 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 02 21:53:47.805103 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790738 5963 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 02 21:53:47.805563 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790742 5963 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 02 21:53:47.805563 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790745 5963 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 02 21:53:47.805563 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790748 5963 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 02 21:53:47.805563 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790751 5963 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 02 21:53:47.805563 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790754 5963 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 02 21:53:47.805563 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790756 5963 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 02 21:53:47.805563 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790759 5963 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 02 21:53:47.805563 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790764 5963 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 02 21:53:47.805563 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790767 5963 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 02 21:53:47.805563 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790769 5963 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 02 21:53:47.805563 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790772 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 02 21:53:47.805563 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790775 5963 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 02 21:53:47.805563 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790778 5963 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 02 21:53:47.805563 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790780 5963 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 02 21:53:47.805563 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790783 5963 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 02 21:53:47.805563 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790786 5963 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 02 21:53:47.805563 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790790 5963 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 02 21:53:47.805563 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790793 5963 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 02 21:53:47.805563 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790796 5963 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 02 21:53:47.805563 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790799 5963 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 02 21:53:47.806097 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790803 5963 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 02 21:53:47.806097 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790806 5963 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 02 21:53:47.806097 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790809 5963 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 02 21:53:47.806097 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790812 5963 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 02 21:53:47.806097 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790815 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 02 21:53:47.806097 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790818 5963 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 02 21:53:47.806097 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790821 5963 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 02 21:53:47.806097 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790823 5963 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 02 21:53:47.806097 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790826 5963 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 02 21:53:47.806097 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.790852 5963 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 02 21:53:47.806097 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790884 5963 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 02 21:53:47.806097 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790888 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 02 21:53:47.806097 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790892 5963 feature_gate.go:386] unrecognized feature gate: Example Nov 02 21:53:47.806097 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790895 5963 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 02 21:53:47.806097 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790898 5963 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 02 21:53:47.806097 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790900 5963 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 02 21:53:47.806484 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790903 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 02 21:53:47.806484 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790906 5963 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 02 21:53:47.806484 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790908 5963 feature_gate.go:386] unrecognized feature gate: EVPN Nov 02 21:53:47.806484 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790911 5963 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 02 21:53:47.806484 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790915 5963 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 02 21:53:47.806484 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790918 5963 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 02 21:53:47.806484 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790922 5963 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 02 21:53:47.806484 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790928 5963 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 02 21:53:47.806484 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790931 5963 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 02 21:53:47.806484 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790934 5963 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 02 21:53:47.806484 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790936 5963 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 02 21:53:47.806484 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790939 5963 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 02 21:53:47.806484 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790942 5963 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 02 21:53:47.806484 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790944 5963 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 02 21:53:47.806484 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790947 5963 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 02 21:53:47.806484 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790950 5963 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 02 21:53:47.806484 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790952 5963 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 02 21:53:47.806484 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790955 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 02 21:53:47.806484 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790957 5963 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 02 21:53:47.807003 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790960 5963 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 02 21:53:47.807003 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790963 5963 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 02 21:53:47.807003 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790966 5963 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 02 21:53:47.807003 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790968 5963 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 02 21:53:47.807003 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790972 5963 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 02 21:53:47.807003 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790975 5963 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 02 21:53:47.807003 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790978 5963 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 02 21:53:47.807003 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790982 5963 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 02 21:53:47.807003 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790985 5963 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 02 21:53:47.807003 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790988 5963 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 02 21:53:47.807003 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790991 5963 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 02 21:53:47.807003 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790993 5963 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 02 21:53:47.807003 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790996 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 02 21:53:47.807003 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.790998 5963 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 02 21:53:47.807003 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791001 5963 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 02 21:53:47.807003 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791003 5963 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 02 21:53:47.807003 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791006 5963 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 02 21:53:47.807003 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791009 5963 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 02 21:53:47.807003 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791012 5963 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 02 21:53:47.807003 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791015 5963 feature_gate.go:386] unrecognized feature gate: Example2 Nov 02 21:53:47.807489 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791017 5963 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 02 21:53:47.807489 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791020 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 02 21:53:47.807489 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791023 5963 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 02 21:53:47.807489 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791025 5963 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 02 21:53:47.807489 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791028 5963 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 02 21:53:47.807489 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791030 5963 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 02 21:53:47.807489 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791033 5963 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 02 21:53:47.807489 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791035 5963 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 02 21:53:47.807489 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791038 5963 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 02 21:53:47.807489 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791041 5963 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 02 21:53:47.807489 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791043 5963 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 02 21:53:47.807489 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791046 5963 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 02 21:53:47.807489 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791048 5963 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 02 21:53:47.807489 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791051 5963 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 02 21:53:47.807489 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791053 5963 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 02 21:53:47.807489 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791056 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 02 21:53:47.807489 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791058 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 02 21:53:47.807489 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791061 5963 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 02 21:53:47.807489 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791064 5963 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 02 21:53:47.807489 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791066 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 02 21:53:47.807991 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791069 5963 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 02 21:53:47.807991 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791071 5963 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 02 21:53:47.807991 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791073 5963 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 02 21:53:47.807991 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791076 5963 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 02 21:53:47.807991 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791078 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 02 21:53:47.807991 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791081 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 02 21:53:47.807991 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791083 5963 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 02 21:53:47.807991 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791086 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 02 21:53:47.807991 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791089 5963 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 02 21:53:47.807991 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791092 5963 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 02 21:53:47.807991 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791095 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 02 21:53:47.807991 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791097 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 02 21:53:47.807991 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791100 5963 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 02 21:53:47.807991 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791102 5963 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 02 21:53:47.807991 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791105 5963 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 02 21:53:47.807991 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791108 5963 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 02 21:53:47.807991 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791111 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 02 21:53:47.807991 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791113 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 02 21:53:47.807991 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791116 5963 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 02 21:53:47.808480 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791118 5963 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 02 21:53:47.808480 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791121 5963 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 02 21:53:47.808480 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791123 5963 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 02 21:53:47.808480 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791127 5963 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 02 21:53:47.808480 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791131 5963 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 02 21:53:47.808480 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791133 5963 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 02 21:53:47.808480 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791136 5963 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 02 21:53:47.808480 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791139 5963 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 02 21:53:47.808480 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791141 5963 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 02 21:53:47.808480 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791143 5963 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 02 21:53:47.808480 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791146 5963 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 02 21:53:47.808480 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791148 5963 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 02 21:53:47.808480 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791151 5963 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 02 21:53:47.808480 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791154 5963 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 02 21:53:47.808480 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791156 5963 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 02 21:53:47.808480 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791158 5963 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 02 21:53:47.808480 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791161 5963 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 02 21:53:47.808480 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791164 5963 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 02 21:53:47.808480 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791166 5963 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 02 21:53:47.808955 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791169 5963 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 02 21:53:47.808955 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791171 5963 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 02 21:53:47.808955 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:53:47.791174 5963 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 02 21:53:47.808955 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.791238 5963 server.go:957] "Client rotation is on, will bootstrap in background" Nov 02 21:53:47.808955 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.792258 5963 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Nov 02 21:53:47.808955 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.792333 5963 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Nov 02 21:53:47.808955 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.792518 5963 server.go:1014] "Starting client certificate rotation" Nov 02 21:53:47.808955 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.792673 5963 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 02 21:53:47.808955 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.792712 5963 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-01 21:47:35 +0000 UTC" deadline="2028-06-28 04:41:15.476782331 +0000 UTC" Nov 02 21:53:47.808955 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.792747 5963 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14478h47m27.684037309s" Nov 02 21:53:47.808955 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.793016 5963 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 02 21:53:47.808955 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.794185 5963 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 02 21:53:47.808955 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.797144 5963 log.go:25] "Validated CRI v1 runtime API" Nov 02 21:53:47.808955 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.799162 5963 log.go:25] "Validated CRI v1 image API" Nov 02 21:53:47.808955 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.799982 5963 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Nov 02 21:53:47.809318 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.802500 5963 fs.go:135] Filesystem UUIDs: map[6f462860-7eb3-42f1-b75e-03bf5933ff47:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8cd2655e-ae16-4489-a8d3-3f163cceab06:/dev/nvme0n1p3] Nov 02 21:53:47.809371 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.802518 5963 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/10a4536550cb2ed604ba15845641ceea53f12f3dbaf83459cff986f4581ce981/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/10a4536550cb2ed604ba15845641ceea53f12f3dbaf83459cff986f4581ce981/userdata/shm major:0 minor:205 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1a280937337ffdfc84a36b3b3fca9664c8a362c5736abc011890fec2672f283d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1a280937337ffdfc84a36b3b3fca9664c8a362c5736abc011890fec2672f283d/userdata/shm major:0 minor:89 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/20dee4bad545e8a356d919537c0f80d5a45ac3647ec5912cf8aa83ad05285258/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/20dee4bad545e8a356d919537c0f80d5a45ac3647ec5912cf8aa83ad05285258/userdata/shm major:0 minor:317 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/217f56323a79c3e1ca3bfb72dfbcbd780ca055ccb1e4f40df66d0a9825a7ccc3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/217f56323a79c3e1ca3bfb72dfbcbd780ca055ccb1e4f40df66d0a9825a7ccc3/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/249a9856013b47fb204ab861d32e3068bf3bb7d9a25cf8e8f901dfcb7321c0ed/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/249a9856013b47fb204ab861d32e3068bf3bb7d9a25cf8e8f901dfcb7321c0ed/userdata/shm major:0 minor:456 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/29088fd048caacb1e145426d5dd67dcd393ec5082be519d12dd8752559bbd3a1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/29088fd048caacb1e145426d5dd67dcd393ec5082be519d12dd8752559bbd3a1/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2d4621d091343a0a22e1a151ddbd2410b10d122e6853e90a486d28f69f97525d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2d4621d091343a0a22e1a151ddbd2410b10d122e6853e90a486d28f69f97525d/userdata/shm major:0 minor:207 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/32287d5eeb399a84296014918149d6f84f76c23abb32ef0a53092c34a1148076/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/32287d5eeb399a84296014918149d6f84f76c23abb32ef0a53092c34a1148076/userdata/shm major:0 minor:286 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/433c1bd296c4593fbeb70e1cde9d7d2c13ba40fc285ca4b1ad4251dddec2e8ba/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/433c1bd296c4593fbeb70e1cde9d7d2c13ba40fc285ca4b1ad4251dddec2e8ba/userdata/shm major:0 minor:383 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/558b386bac0a04c1c81fa904b658128a1530a435a226d307b63c4b9611cee112/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/558b386bac0a04c1c81fa904b658128a1530a435a226d307b63c4b9611cee112/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/677ad3e7f4a3f85fe674245da968f88dcf453ef09002af72d9e89c9314b4e283/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/677ad3e7f4a3f85fe674245da968f88dcf453ef09002af72d9e89c9314b4e283/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/68ca63f9ce49f69740516bf93e90c055daa61df0fcaeada739b8405ef1e5a6bb/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/68ca63f9ce49f69740516bf93e90c055daa61df0fcaeada739b8405ef1e5a6bb/userdata/shm major:0 minor:290 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6dfcc9201bb49276554033ae87390e30f9bf55f79b51e5115f0d11b528a8affd/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6dfcc9201bb49276554033ae87390e30f9bf55f79b51e5115f0d11b528a8affd/userdata/shm major:0 minor:284 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/78514c09bd915527d36f698947763edb10e4fc561c0df91d2d3aff429eb006b3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/78514c09bd915527d36f698947763edb10e4fc561c0df91d2d3aff429eb006b3/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7aef818a8d6fb609cd74e4d5049534a199a24e35cbed217de7b76ba4649a9546/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7aef818a8d6fb609cd74e4d5049534a199a24e35cbed217de7b76ba4649a9546/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8d2d30386797ac9b69c9c8d947700e2e4f8a7d33abdde1e3021c9147623865bd/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8d2d30386797ac9b69c9c8d947700e2e4f8a7d33abdde1e3021c9147623865bd/userdata/shm major:0 minor:340 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/917b680b6a8034f28d5adcd0a2daad9f2899a4d72cdb931b4f044ef6e0000732/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/917b680b6a8034f28d5adcd0a2daad9f2899a4d72cdb931b4f044ef6e0000732/userdata/shm major:0 minor:75 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/999df1dddddc5ec92ae1e4b7737620325724e656c49d382a324e842d76d58a10/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/999df1dddddc5ec92ae1e4b7737620325724e656c49d382a324e842d76d58a10/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b0c219fda0631bb6714472549c903682de2294233158f20ef03eb3fd1a222da4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b0c219fda0631bb6714472549c903682de2294233158f20ef03eb3fd1a222da4/userdata/shm major:0 minor:477 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b32881df604a3e3309316929c6e7485ad735c819a5dbedfe2c87ccf1b6bccdf8/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b32881df604a3e3309316929c6e7485ad735c819a5dbedfe2c87ccf1b6bccdf8/userdata/shm major:0 minor:324 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c226e31ec99116e0934c2bef84809cbf3754c952d373ee11f2e5763a8f62c26c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c226e31ec99116e0934c2bef84809cbf3754c952d373ee11f2e5763a8f62c26c/userdata/shm major:0 minor:271 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d651d8300829fdc4f2ebf2387f9c67fbcd7e48bf36f859e83047c8beb6eadb41/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d651d8300829fdc4f2ebf2387f9c67fbcd7e48bf36f859e83047c8beb6eadb41/userdata/shm major:0 minor:480 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e029b38ceaada5030743e14f1ba271133d056ff593954ef7c3bee0fed84c8611/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e029b38ceaada5030743e14f1ba271133d056ff593954ef7c3bee0fed84c8611/userdata/shm major:0 minor:209 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e5dec6adfc8820000948b72af6828f2bc38ea8f4cc32dd8941bb9978578ce98b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e5dec6adfc8820000948b72af6828f2bc38ea8f4cc32dd8941bb9978578ce98b/userdata/shm major:0 minor:244 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e78d22ae35cb9c03e20ab4919fc73603d098e08b2144390099839d152875e5d9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e78d22ae35cb9c03e20ab4919fc73603d098e08b2144390099839d152875e5d9/userdata/shm major:0 minor:479 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ea5fccd4474977471ef68389849a0ebd56b1ad2e99e79b8f4f49d651ef6af6f6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ea5fccd4474977471ef68389849a0ebd56b1ad2e99e79b8f4f49d651ef6af6f6/userdata/shm major:0 minor:81 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/15a806bb-6e90-479d-8f94-d9915b47cbde/volumes/kubernetes.io~projected/kube-api-access-t8kx7:{mountpoint:/var/lib/kubelet/pods/15a806bb-6e90-479d-8f94-d9915b47cbde/volumes/kubernetes.io~projected/kube-api-access-t8kx7 major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/15d3a384-31d9-4152-9e38-491942e6d5c5/volumes/kubernetes.io~projected/kube-api-access-mt8ph:{mountpoint:/var/lib/kubelet/pods/15d3a384-31d9-4152-9e38-491942e6d5c5/volumes/kubernetes.io~projected/kube-api-access-mt8ph major:0 minor:241 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/15d3a384-31d9-4152-9e38-491942e6d5c5/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/15d3a384-31d9-4152-9e38-491942e6d5c5/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config major:0 minor:236 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/15d3a384-31d9-4152-9e38-491942e6d5c5/volumes/kubernetes.io~secret/prometheus-operator-tls:{mountpoint:/var/lib/kubelet/pods/15d3a384-31d9-4152-9e38-491942e6d5c5/volumes/kubernetes.io~secret/prometheus-operator-tls major:0 minor:240 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2e2913f2-f166-4ce6-b93b-cea606008bba/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/2e2913f2-f166-4ce6-b93b-cea606008bba/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2e2913f2-f166-4ce6-b93b-cea606008bba/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/2e2913f2-f166-4ce6-b93b-cea606008bba/volumes/kubernetes.io~empty-dir/tmp major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2e2913f2-f166-4ce6-b93b-cea606008bba/volumes/kubernetes.io~projected/kube-api-access-55vdw:{mountpoint:/var/lib/kubelet/pods/2e2913f2-f166-4ce6-b93b-cea606008bba/volumes/kubernetes.io~projected/kube-api-access-55vdw major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2e3415b9-cef2-439e-a516-f4adc73822c4/volumes/kubernetes.io~projected/kube-api-access-j9bb7:{mountpoint:/var/lib/kubelet/pods/2e3415b9-cef2-439e-a516-f4adc73822c4/volumes/kubernetes.io~projected/kube-api-access-j9bb7 major:0 minor:339 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2e3415b9-cef2-439e-a516-f4adc73822c4/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/2e3415b9-cef2-439e-a516-f4adc73822c4/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:327 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2e3415b9-cef2-439e-a516-f4adc73822c4/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/2e3415b9-cef2-439e-a516-f4adc73822c4/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy major:0 minor:335 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2e3415b9-cef2-439e-a516-f4adc73822c4/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics:{mountpoint:/var/lib/kubelet/pods/2e3415b9-cef2-439e-a516-f4adc73822c4/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics major:0 minor:338 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2e3415b9-cef2-439e-a516-f4adc73822c4/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules:{mountpoint:/var/lib/kubelet/pods/2e3415b9-cef2-439e-a516-f4adc73822c4/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules major:0 minor:334 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2e3415b9-cef2-439e-a516-f4adc73822c4/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/2e3415b9-cef2-439e-a516-f4adc73822c4/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web major:0 minor:336 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2e3415b9-cef2-439e-a516-f4adc73822c4/volumes/kubernetes.io~secret/secret-thanos-querier-tls:{mountpoint:/var/lib/kubelet/pods/2e3415b9-cef2-439e-a516-f4adc73822c4/volumes/kubernetes.io~secret/secret-thanos-querier-tls major:0 minor:337 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/41a3e68b-3746-48ca-89c7-99347353fb8b/volumes/kubernetes.io~projected/kube-api-access-8dlhh:{mountpoint:/var/lib/kubelet/pods/41a3e68b-3746-48ca-89c7-99347353fb8b/volumes/kubernetes.io~projected/kube-api-access-8dlhh major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4e73c1ca-fa5d-4485-a439-a6f8eb19a731/volumes/kubernetes.io~projected/kube-api-access-r9hbn:{mountpoint:/var/lib/kubelet/pods/4e73c1ca-fa5d-4485-a439-a6f8eb19a731/volumes/kubernetes.io~projected/kube-api-access-r9hbn major:0 minor:281 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4e73c1ca-fa5d-4485-a439-a6f8eb19a731/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/4e73c1ca-fa5d-4485-a439-a6f8eb19a731/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config major:0 minor:280 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4e73c1ca-fa5d-4485-a439-a6f8eb19a731/volumes/kubernetes.io~secret/openshift-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/4e73c1ca-fa5d-4485-a439-a6f8eb19a731/volumes/kubernetes.io~secret/openshift-state-metrics-tls major:0 minor:279 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/52ac610d-a729-4e9f-b70b-700d30dbf64a/volumes/kubernetes.io~projected/kube-api-access-dqb44:{mountpoint:/var/lib/kubelet/pods/52ac610d-a729-4e9f-b70b-700d30dbf64a/volumes/kubernetes.io~projected/kube-api-access-dqb44 major:0 minor:283 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/52ac610d-a729-4e9f-b70b-700d30dbf64a/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/52ac610d-a729-4e9f-b70b-700d30dbf64a/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config major:0 minor:275 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/52ac610d-a729-4e9f-b70b-700d30dbf64a/volumes/kubernetes.io~secret/kube-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/52ac610d-a729-4e9f-b70b-700d30dbf64a/volumes/kubernetes.io~secret/kube-state-metrics-tls major:0 minor:278 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volume-subpaths/web-config/config-reloader/2:{mountpoint:/var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volume-subpaths/web-config/config-reloader/2 major:0 minor:461 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volume-subpaths/web-config/init-config-reloader/2:{mountpoint:/var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volume-subpaths/web-config/init-config-reloader/2 major:0 minor:461 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volume-subpaths/web-config/prometheus/15:{mountpoint:/var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volume-subpaths/web-config/prometheus/15 major:0 minor:461 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volumes/kubernetes.io~empty-dir/config-out major:0 minor:451 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volumes/kubernetes.io~projected/kube-api-access-rr7j5:{mountpoint:/var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volumes/kubernetes.io~projected/kube-api-access-rr7j5 major:0 minor:462 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volumes/kubernetes.io~projected/tls-assets major:0 minor:459 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volumes/kubernetes.io~secret/config:{mountpoint:/var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volumes/kubernetes.io~secret/config major:0 minor:449 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:455 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volumes/kubernetes.io~secret/secret-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volumes/kubernetes.io~secret/secret-kube-rbac-proxy major:0 minor:457 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volumes/kubernetes.io~secret/secret-metrics-client-certs:{mountpoint:/var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volumes/kubernetes.io~secret/secret-metrics-client-certs major:0 minor:450 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web major:0 minor:452 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls:{mountpoint:/var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls major:0 minor:458 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls:{mountpoint:/var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls major:0 minor:453 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file:{mountpoint:/var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file major:0 minor:454 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volumes/kubernetes.io~secret/web-config major:0 minor:461 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/649dd5b0-1649-4f63-a148-40fd3f3e07f4/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/649dd5b0-1649-4f63-a148-40fd3f3e07f4/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:475 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/76322934-bb51-4c0e-a7df-37f506b6cfc4/volumes/kubernetes.io~projected/kube-api-access-lvh9s:{mountpoint:/var/lib/kubelet/pods/76322934-bb51-4c0e-a7df-37f506b6cfc4/volumes/kubernetes.io~projected/kube-api-access-lvh9s major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/76322934-bb51-4c0e-a7df-37f506b6cfc4/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/76322934-bb51-4c0e-a7df-37f506b6cfc4/volumes/kubernetes.io~secret/cert major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/84467c9f-0161-4e44-9420-dcc224215f05/volumes/kubernetes.io~projected/kube-api-access-snzkj:{mountpoint:/var/lib/kubelet/pods/84467c9f-0161-4e44-9420-dcc224215f05/volumes/kubernetes.io~projected/kube-api-access-snzkj major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/84467c9f-0161-4e44-9420-dcc224215f05/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/84467c9f-0161-4e44-9420-dcc224215f05/volumes/kubernetes.io~secret/metrics-certs major:0 minor:474 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/87451849-2618-4958-bc4a-114cc208434e/volumes/kubernetes.io~projected/kube-api-access-fsdqt:{mountpoint:/var/lib/kubelet/pods/87451849-2618-4958-bc4a-114cc208434e/volumes/kubernetes.io~projected/kube-api-access-fsdqt major:0 minor:476 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/943a1337-2968-4104-aa18-90f3cd407ea0/volumes/kubernetes.io~projected/kube-api-access-4d9ln:{mountpoint:/var/lib/kubelet/pods/943a1337-2968-4104-aa18-90f3cd407ea0/volumes/kubernetes.io~projected/kube-api-access-4d9ln major:0 minor:270 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/943a1337-2968-4104-aa18-90f3cd407ea0/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/943a1337-2968-4104-aa18-90f3cd407ea0/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:265 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/943a1337-2968-4104-aa18-90f3cd407ea0/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/943a1337-2968-4104-aa18-90f3cd407ea0/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:269 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/983b05f9-8574-4a23-b3de-951a68c553a1/volumes/kubernetes.io~projected/kube-api-access-wnhnw:{mountpoint:/var/lib/kubelet/pods/983b05f9-8574-4a23-b3de-951a68c553a1/volumes/kubernetes.io~projected/kube-api-access-wnhnw major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34/volumes/kubernetes.io~projected/kube-api-access-xxhzp:{mountpoint:/var/lib/kubelet/pods/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34/volumes/kubernetes.io~projected/kube-api-access-xxhzp major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c0fdd204-e1ad-4de8-ab18-52ab672cc3a4/volumes/kubernetes.io~projected/kube-api-access-n7ccd:{mountpoint:/var/lib/kubelet/pods/c0fdd204-e1ad-4de8-ab18-52ab672cc3a4/volumes/kubernetes.io~projected/kube-api-access-n7ccd major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cb3cdef3-ff8c-4e53-8852-81d064f58c21/volumes/kubernetes.io~projected/kube-api-access-c47fh:{mountpoint:/var/lib/kubelet/pods/cb3cdef3-ff8c-4e53-8852-81d064f58c21/volumes/kubernetes.io~projected/kube-api-access-c47fh major:0 minor:379 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cb3cdef3-ff8c-4e53-8852-81d064f58c21/volumes/kubernetes.io~secret/client-ca-bundle:{mountpoint:/var/lib/kubelet/pods/cb3cdef3-ff8c-4e53-8852-81d064f58c21/volumes/kubernetes.io~secret/client-ca-bundle major:0 minor:378 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cb3cdef3-ff8c-4e53-8852-81d064f58c21/volumes/kubernetes.io~secret/secret-metrics-server-client-certs:{mountpoint:/var/lib/kubelet/pods/cb3cdef3-ff8c-4e53-8852-81d064f58c21/volumes/kubernetes.io~secret/secret-metrics-server-client-certs major:0 minor:372 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cb3cdef3-ff8c-4e53-8852-81d064f58c21/volumes/kubernetes.io~secret/secret-metrics-server-tls:{mountpoint:/var/lib/kubelet/pods/cb3cdef3-ff8c-4e53-8852-81d064f58c21/volumes/kubernetes.io~secret/secret-metrics-server-tls major:0 minor:377 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volume-subpaths/cluster-tls-config/alertmanager/10:{mountpoint:/var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volume-subpaths/cluster-tls-config/alertmanager/10 major:0 minor:311 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volume-subpaths/web-config/alertmanager/9:{mountpoint:/var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volume-subpaths/web-config/alertmanager/9 major:0 minor:304 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volume-subpaths/web-config/config-reloader/6:{mountpoint:/var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volume-subpaths/web-config/config-reloader/6 major:0 minor:304 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volume-subpaths/web-config/init-config-reloader/6:{mountpoint:/var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volume-subpaths/web-config/init-config-reloader/6 major:0 minor:304 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volumes/kubernetes.io~empty-dir/config-out major:0 minor:315 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volumes/kubernetes.io~projected/kube-api-access-4mnfp:{mountpoint:/var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volumes/kubernetes.io~projected/kube-api-access-4mnfp major:0 minor:316 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volumes/kubernetes.io~projected/tls-assets major:0 minor:310 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volumes/kubernetes.io~secret/cluster-tls-config:{mountpoint:/var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volumes/kubernetes.io~secret/cluster-tls-config major:0 minor:311 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volumes/kubernetes.io~secret/config-volume:{mountpoint:/var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volumes/kubernetes.io~secret/config-volume major:0 minor:314 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy major:0 minor:308 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric:{mountpoint:/var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric major:0 minor:312 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web major:0 minor:313 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volumes/kubernetes.io~secret/secret-alertmanager-main-tls:{mountpoint:/var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volumes/kubernetes.io~secret/secret-alertmanager-main-tls major:0 minor:309 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volumes/kubernetes.io~secret/web-config major:0 minor:304 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e011b0d4-3387-4b79-9a3f-b3fac185c126/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/e011b0d4-3387-4b79-9a3f-b3fac185c126/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e011b0d4-3387-4b79-9a3f-b3fac185c126/volumes/kubernetes.io~projected/kube-api-access-qwdt6:{mountpoint:/var/lib/kubelet/pods/e011b0d4-3387-4b79-9a3f-b3fac185c126/volumes/kubernetes.io~projected/kube-api-access-qwdt6 major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e011b0d4-3387-4b79-9a3f-b3fac185c126/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/e011b0d4-3387-4b79-9a3f-b3fac185c126/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e2026273-f131-45c2-a443-c66a07d518ae/volumes/kubernetes.io~projected/kube-api-access-df98z:{mountpoint:/var/lib/kubelet/pods/e2026273-f131-45c2-a443-c66a07d518ae/volumes/kubernetes.io~projected/kube-api-access-df98z major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e2026273-f131-45c2-a443-c66a07d518ae/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/e2026273-f131-45c2-a443-c66a07d518ae/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e2494f67-c3dd-4cc1-9035-da81cb1c6308/volumes/kubernetes.io~projected/kube-api-access-4wfn9:{mountpoint:/var/lib/kubelet/pods/e2494f67-c3dd-4cc1-9035-da81cb1c6308/volumes/kubernetes.io~projected/kube-api-access-4wfn9 major:0 minor:321 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e2494f67-c3dd-4cc1-9035-da81cb1c6308/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/e2494f67-c3dd-4cc1-9035-da81cb1c6308/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:320 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e2494f67-c3dd-4cc1-9035-da81cb1c6308/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/e2494f67-c3dd-4cc1-9035-da81cb1c6308/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:319 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e71535c3-0a11-43fc-ad7e-4ea18213f0cf/volumes/kubernetes.io~projected/kube-api-access-4gsxn:{mountpoint:/var/lib/kubelet/pods/e71535c3-0a11-43fc-ad7e-4ea18213f0cf/volumes/kubernetes.io~projected/kube-api-access-4gsxn major:0 minor:282 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e71535c3-0a11-43fc-ad7e-4ea18213f0cf/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/e71535c3-0a11-43fc-ad7e-4ea18213f0cf/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config major:0 minor:276 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e71535c3-0a11-43fc-ad7e-4ea18213f0cf/volumes/kubernetes.io~secret/node-exporter-tls:{mountpoint:/var/lib/kubelet/pods/e71535c3-0a11-43fc-ad7e-4ea18213f0cf/volumes/kubernetes.io~secret/node-exporter-tls major:0 minor:277 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e761db17-b05a-4f51-8fb9-c2126ee35fe1/volumes/kubernetes.io~projected/kube-api-access-99wqw:{mountpoint:/var/lib/kubelet/pods/e761db17-b05a-4f51-8fb9-c2126ee35fe1/volumes/kubernetes.io~projected/kube-api-access-99wqw major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e761db17-b05a-4f51-8fb9-c2126ee35fe1/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/e761db17-b05a-4f51-8fb9-c2126ee35fe1/volumes/kubernetes.io~secret/metrics-tls major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e7658661-8ddc-4443-91d0-edeaab291256/volumes/kubernetes.io~projected/kube-api-access-p9d5c:{mountpoint:/var/lib/kubelet/pods/e7658661-8ddc-4443-91d0-edeaab291256/volumes/kubernetes.io~projected/kube-api-access-p9d5c major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fd77571d-49e8-4127-951a-f8a4412d8e43/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/fd77571d-49e8-4127-951a-f8a4412d8e43/volumes/kubernetes.io~secret/agent-certs major:0 minor:64 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/0e4810756f734643e43a341db1638203d8e789808df619c2c8ad826455ff30f6/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/ae4aa1b36db3bf27cacafeecb55039530da0d1ebf4544e98660ec99b726a957b/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/21cdcc4e25c4b4e3fc0f5d6ca3d27d19ffc47a2889f1377c4255d2654ea86f55/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/fc9b07925f768fcf04de3a91a513d36f591b87a75bc75f965df1e4377d5e0347/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-111:{mountpoint:/var/lib/containers/storage/overlay/9f335d0e0ab019870a104ef7dd622d74e1cddbbfa386a3bb12e934cdb61aea0f/merged major:0 minor:111 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/26eb573000c3a60f050c74a2561288bbb87c9ee436f1177e01fccedd173aa757/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/854076abfa8df818a3f7cc3fb229b7a0dbcf656f033eb48616f6830262bed0c1/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/7b0a32e014ff5ba3fdb456ef1063b2cc106b0b46c0616bb37ce9fab976684de3/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/38ba42cde7df537f014e6ab8474ebb4c8cfeddd1d2ae05d4078425448a6162a4/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-134:{mountpoint:/var/lib/containers/storage/overlay/054c76d16396824ddbe9f2587dbaa81e08db3bb7772ca0b69700e1d54ccc7d44/merged major:0 minor:134 fsType:overlay blockSize:0} overlay_0-142:{mountpoint:/var/lib/containers/storage/overlay/3ec111828b4c45977278dbc66ef0c34cd55247d62ad7d7be601227facf09ddf7/merged major:0 minor:142 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/1249d212f929921352f4270524c37e399c5edbd916cb0e75a761fd5501de5d05/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/95ced23cffdd4b3b80098dc7bc63a4c7166b35a9ab2c93ba59c437dc70cf26c7/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/82c0c63cb1cba32a53d9391d3f88dabee72da75feeb69e0939368caecddf4c7d/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-159:{mountpoint:/var/lib/containers/storage/overlay/0574442ed43dcac612817f9c9b09eb3717733ec4fe508bdd1021b034a5ac2582/merged major:0 minor:159 fsType:overlay blockSize:0} overlay_0-164:{mountpoint:/var/lib/containers/storage/overlay/da908f462d6fe7d0942ee6eae8379879701b98f7539d402727d96e3728775910/merged major:0 minor:164 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/0634ef0556a8229161f5545cf01a742461751d42910dc52f34cdd5ccfc3eaba7/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/e93a4d730a44eaa517cfcb98373130c751ab34848abc673dea173434bd5923b3/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/a69cb5cb9557550daea0036ba6417bc7ca85707a8c816cdf484253171cdf0aca/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/def78cca810ceca64b13f450f3cff5601941205f0530fdd5c7ec8ecce585b5a1/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/eaa3e786359dc3038e08066aa80752c2d907681c7a96855a851f01c63f48b72b/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-211:{mountpoint:/var/lib/containers/storage/overlay/5edd38f1773d99d84e9bb2fe54ac4fc22bd4817a9f38873111fce7d693c2f365/merged major:0 minor:211 fsType:overlay blockSize:0} overlay_0-213:{mountpoint:/var/lib/containers/storage/overlay/2dc0a9dd4dc187b6601c81db81417328c144df831071ef183f5bc32861ac35dd/merged major:0 minor:213 fsType:overlay blockSize:0} overlay_0-215:{mountpoint:/var/lib/containers/storage/overlay/70d93cd88816749390b409fb2546b42caa1319ae5975e7777d884e0339359fda/merged major:0 minor:215 fsType:overlay blockSize:0} overlay_0-217:{mountpoint:/var/lib/containers/storage/overlay/bc87cbf58d7209a118b51cf3a92700d6cc8ab0969e58aaf44244ae0d4fd63493/merged major:0 minor:217 fsType:overlay blockSize:0} overlay_0-218:{mountpoint:/var/lib/containers/storage/overlay/9b8d6302e4f006e52ab9c5ba6e7269ca5c90ec8ee163a4f38e62214959338939/merged major:0 minor:218 fsType:overlay blockSize:0} overlay_0-225:{mountpoint:/var/lib/containers/storage/overlay/6714caa551f6ff571dd5fd62095fdaa536742823a307a44646b47aaa6836e0b7/merged major:0 minor:225 fsType:overlay blockSize:0} overlay_0-230:{mountpoint:/var/lib/containers/storage/overlay/183be7f31f28cb917fc3312d7780f2e86835bf68419cc8e9d280bfae4e1c0acc/merged major:0 minor:230 fsType:overlay blockSize:0} overlay_0-242:{mountpoint:/var/lib/containers/storage/overlay/15e5c2826bcb9e6c09617265a9cd72d5bc5bb3f39070a043207099247fdfb736/merged major:0 minor:242 fsType:overlay blockSize:0} overlay_0-249:{mountpoint:/var/lib/containers/storage/overlay/e74b3c124b9abe43c724100e6418290b57b39983b319d6a2d9db4f27f04427f4/merged major:0 minor:249 fsType:overlay blockSize:0} overlay_0-251:{mountpoint:/var/lib/containers/storage/overlay/4f48e5d27856c483354bdf7c9633069b6c5ec06b748d0778f8ba3cefe1cf7530/merged major:0 minor:251 fsType:overlay blockSize:0} overlay_0-257:{mountpoint:/var/lib/containers/storage/overlay/2e2a36669167faae3f9d265fa616632f58cb6b8ebfa2fe4d33d9e8f0ca11071d/merged major:0 minor:257 fsType:overlay blockSize:0} overlay_0-259:{mountpoint:/var/lib/containers/storage/overlay/74c762c8b62238da549368ea100cf9ce0b9f637ee1a350b5544e51524a834103/merged major:0 minor:259 fsType:overlay blockSize:0} overlay_0-273:{mountpoint:/var/lib/containers/storage/overlay/aa0c522d4201343d1cf208e44932c811b683bcd2b51c639187793e9b2f6ec25d/merged major:0 minor:273 fsType:overlay blockSize:0} overlay_0-288:{mountpoint:/var/lib/containers/storage/overlay/c03b8fd16a353e1c1bbcbde08a04947dc05dfbb858da26b8945bb4c2fe6225a2/merged major:0 minor:288 fsType:overlay blockSize:0} overlay_0-292:{mountpoint:/var/lib/containers/storage/overlay/58cf3350aca38e3a6b50256e3858d8f599c1bc6b73d967d2a5e32fe38e3c48e2/merged major:0 minor:292 fsType:overlay blockSize:0} overlay_0-294:{mountpoint:/var/lib/containers/storage/overlay/fd70b28c5a3dd90cca31738766f94eb6206c9f7c8e38606c2dbfe1d856e84af0/merged major:0 minor:294 fsType:overlay blockSize:0} overlay_0-296:{mountpoint:/var/lib/containers/storage/overlay/084c0f52cc24b5070ea3bff3102cd83ab5400d61208a84034f89a3d38e68b12a/merged major:0 minor:296 fsType:overlay blockSize:0} overlay_0-298:{mountpoint:/var/lib/containers/storage/overlay/967b901ac5b45e1591643231598e87111ee80f7eabecfd734d986cf2e5886889/merged major:0 minor:298 fsType:overlay blockSize:0} overlay_0-322:{mountpoint:/var/lib/containers/storage/overlay/075805605a25561a9f039875fbcd1974edf265dbb383c072c451d49fe2ea9a4a/merged major:0 minor:322 fsType:overlay blockSize:0} overlay_0-325:{mountpoint:/var/lib/containers/storage/overlay/ad5b902fbda864e36aad22f08813f8b548eef4aeffb5cd0c4855455a0f747e5a/merged major:0 minor:325 fsType:overlay blockSize:0} overlay_0-329:{mountpoint:/var/lib/containers/storage/overlay/646f2e87b0b0d9e173aa652dd28548dd8214bcd5399b399912d73c42e735d6e2/merged major:0 minor:329 fsType:overlay blockSize:0} overlay_0-342:{mountpoint:/var/lib/containers/storage/overlay/5a5beb1116ca8a6a52abb858ecbf724f749697ac5eaf6621cf4fe27665906b68/merged major:0 minor:342 fsType:overlay blockSize:0} overlay_0-344:{mountpoint:/var/lib/containers/storage/overlay/07e4e7cb76ad0e4ed292837b8894da3f1fab6e68d29474bdfb55ccdc26161429/merged major:0 minor:344 fsType:overlay blockSize:0} overlay_0-346:{mountpoint:/var/lib/containers/storage/overlay/9d0f5745f3fe287c4bfeeb754f706884412cad5597d9479743d99bdda87f198c/merged major:0 minor:346 fsType:overlay blockSize:0} overlay_0-355:{mountpoint:/var/lib/containers/storage/overlay/e3f2e4e0b9ace4aca9a9342abc691d9dc2fe683d2d461aa0d3cdfe34e55c1878/merged major:0 minor:355 fsType:overlay blockSize:0} overlay_0-357:{mountpoint:/var/lib/containers/storage/overlay/7eb4289245f1e9ef0edab8b195d6921185ed4f19c7b87d8c9ab20fa637475a9e/merged major:0 minor:357 fsType:overlay blockSize:0} overlay_0-359:{mountpoint:/var/lib/containers/storage/overlay/2f168fb653b4c29d4650fb80ca0e398fac0334bf58669bb7b94b6eb4e47bfb2a/merged major:0 minor:359 fsType:overlay blockSize:0} overlay_0-367:{mountpoint:/var/lib/containers/storage/overlay/9d417702ac88a504036576d38b194f0c960a52d2510adef39381bde1e5f34673/merged major:0 minor:367 fsType:overlay blockSize:0} overlay_0-380:{mountpoint:/var/lib/containers/storage/overlay/2b1004cc9a1478bd0fe097a824f18160aadd6b374e1e3664b0635d08353dc9df/merged major:0 minor:380 fsType:overlay blockSize:0} overlay_0-382:{mountpoint:/var/lib/containers/storage/overlay/60f1d6078df5d9f6bfd9353aa945e3581fc85eb4e90063eb9b51c30a1369fbe3/merged major:0 minor:382 fsType:overlay blockSize:0} overlay_0-390:{mountpoint:/var/lib/containers/storage/overlay/72f85bf63ff96cce01567bf337dec782bcda8970725c40b8e6ba12e8d17cce11/merged major:0 minor:390 fsType:overlay blockSize:0} overlay_0-392:{mountpoint:/var/lib/containers/storage/overlay/28aa6f187c9586ebcaed919472553469e1e10b5a0bb6b408be086e05cdef6f74/merged major:0 minor:392 fsType:overlay blockSize:0} overlay_0-398:{mountpoint:/var/lib/containers/storage/overlay/6a8bc5ff7de72c1ea49c19edaf8e76117298eb469774dcb4eaabe776ef06eeff/merged major:0 minor:398 fsType:overlay blockSize:0} overlay_0-403:{mountpoint:/var/lib/containers/storage/overlay/832f6e948597175455bd6344228c36955ee7723e44679575ccd3f37330e2e51c/merged major:0 minor:403 fsType:overlay blockSize:0} overlay_0-408:{mountpoint:/var/lib/containers/storage/overlay/3bf41f104fea8aa0ffbfb4f074b2b696e9be53ef2de9d6aa634676e92d712a69/merged major:0 minor:408 fsType:overlay blockSize:0} overlay_0-414:{mountpoint:/var/lib/containers/storage/overlay/6c465ea3e8a0b13a14939731df30df210dcd90e1648d61d4da8b7c51b8e2781f/merged major:0 minor:414 fsType:overlay blockSize:0} overlay_0-419:{mountpoint:/var/lib/containers/storage/overlay/3d4e70e2ae98bb4d81ad0f223f32d4bcbc677e7c3b82812bc485eb57c98c6c47/merged major:0 minor:419 fsType:overlay blockSize:0} overlay_0-424:{mountpoint:/var/lib/containers/storage/overlay/8d0073a68338a14c99601e6b33a245147cedc5fbfd9b3bdc07c25cc9dd1872bc/merged major:0 minor:424 fsType:overlay blockSize:0} overlay_0-429:{mountpoint:/var/lib/containers/storage/overlay/825cbcde33e0638d18970445833b3cd4efec1945e9c9f5d37605721d0e6f00ff/merged major:0 minor:429 fsType:overlay blockSize:0} overlay_0-434:{mountpoint:/var/lib/containers/storage/overlay/b031a5187ce77927f6c506c0d624a2cd4de2c416e662ce61507e40700df65a70/merged major:0 minor:434 fsType:overlay blockSize:0} overlay_0-438:{mountpoint:/var/lib/containers/storage/overlay/a9c0eef4f701f191b8087cd50b0c61cece20b43776acaeff29ced6bfb9b8e4d0/merged major:0 minor:438 fsType:overlay blockSize:0} overlay_0-441:{mountpoint:/var/lib/containers/storage/overlay/b8e308a0c35101e6b23e0861b14b3af0ff6c8db79bbd055cb743cf7071d93f29/merged major:0 minor:441 fsType:overlay blockSize:0} overlay_0-466:{mountpoint:/var/lib/containers/storage/overlay/1b8d3dadd937ed45f96c20dea7bbe8f4879c8e6a4427e7026fe1ebe7f0ad5dd7/merged major:0 minor:466 fsType:overlay blockSize:0} overlay_0-468:{mountpoint:/var/lib/containers/storage/overlay/43dc4f3d34188688da3517c6377434e49095eb5a65a7d6a065a9b02bc9d792e9/merged major:0 minor:468 fsType:overlay blockSize:0} overlay_0-483:{mountpoint:/var/lib/containers/storage/overlay/92c6c6623a0e33892ff36bff35771156f8330a197263103e25319afc07963e4f/merged major:0 minor:483 fsType:overlay blockSize:0} overlay_0-485:{mountpoint:/var/lib/containers/storage/overlay/485af8c10409f9b94db9d3e9ceea46ccf6e242f5ff1856e9544af6e7820177a5/merged major:0 minor:485 fsType:overlay blockSize:0} overlay_0-487:{mountpoint:/var/lib/containers/storage/overlay/9b63ae9fef075e49eccc30f11371c2c33d686de58142d0dd0b6177c6709f2eb1/merged major:0 minor:487 fsType:overlay blockSize:0} overlay_0-489:{mountpoint:/var/lib/containers/storage/overlay/d1b56fcd994874c91a68583262bf970d91fc43665da28e819a3dc164a63611b9/merged major:0 minor:489 fsType:overlay blockSize:0} overlay_0-491:{mountpoint:/var/lib/containers/storage/overlay/3d6a493fb8febcbee09fe364da7e0f9490ba98b2c2407cf5233c64832635aa48/merged major:0 minor:491 fsType:overlay blockSize:0} overlay_0-497:{mountpoint:/var/lib/containers/storage/overlay/6527f000ff1eda7a06dcd45bfb9d490990e3a52656be718f14952441250a75d7/merged major:0 minor:497 fsType:overlay blockSize:0} overlay_0-502:{mountpoint:/var/lib/containers/storage/overlay/60b46af4adbd824e9e54cde36be2079b9a5b82d3369e2c450dd11072db2a0727/merged major:0 minor:502 fsType:overlay blockSize:0} overlay_0-508:{mountpoint:/var/lib/containers/storage/overlay/360ac03cebc5f528f15383c5f02287eba3ea8c3aa2c43ce08814134db15265b2/merged major:0 minor:508 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/928c6abe0c60ae3c988f3f4a1f74bf4f6fbefde688a601fa0cd3acc317540f9c/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-513:{mountpoint:/var/lib/containers/storage/overlay/0cdb90280b65b93bd202c5fecd0a4243b632d8a3a439e16abae67cd38cb85413/merged major:0 minor:513 fsType:overlay blockSize:0} overlay_0-518:{mountpoint:/var/lib/containers/storage/overlay/dadba8e886aaaf6e7ee8eb9df3dc0ae6aec591227ee92ccef4ff9daca7a60fb9/merged major:0 minor:518 fsType:overlay blockSize:0} overlay_0-523:{mountpoint:/var/lib/containers/storage/overlay/e8b1baade9ad2a611b38717acc868d35686057c79f7fbed4532dcd9734625335/merged major:0 minor:523 fsType:overlay blockSize:0} overlay_0-528:{mountpoint:/var/lib/containers/storage/overlay/7475815ce222a055de6e4539cc1962993ac3f76fa1012af31c7e8c95b9291f3d/merged major:0 minor:528 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/7b57f97d6fa1d9beff2d75e563b89f1cc45fc071dcb118b409b9eac050b571e5/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-533:{mountpoint:/var/lib/containers/storage/overlay/834a89932d1a2455e2d02a71feb6d4b3f6f147c748e6702933ff8e5a1a272e09/merged major:0 minor:533 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/8867b857baf0fc037616b7f4304fb00c95838d48d8230b48d4f7be5a9c40c6d1/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/af17124d40e2d7cea20c8de599cbac826d24bad24ceb030bd5e5c44315a521c8/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/d52d51dbb745aea9ce05239d0fd8fc25092afe05b8057a82260103fd9b87c72c/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/edb1f2561a20511cbff3a41b2bfb57a000fee80a844c7c2f491c14f206b63396/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/f220ced229e9935fbdf53a9cf56481b94a8b7e226ef60958bf5b8534c7e94fe2/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/56f26a1b9feb72564a31962b9ec9cab1428f33997930984e3877bc6158e3cdea/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/9601c45014011a5fa4a87670bd2fa300cf71a9ef52371f28c94cce6ca6a9b1cf/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/76d8f3ffe5759fefb27c1c0bc5c9ca9c865b6a6ea48f24043a2fe48ffe84e13c/merged major:0 minor:96 fsType:overlay blockSize:0}] Nov 02 21:53:47.813241 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.812771 5963 manager.go:217] Machine: {Timestamp:2026-11-02 21:53:47.812232474 +0000 UTC m=+0.064230935 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3057049 MemoryCapacity:32812015616 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2021d99c7af77898179a17946186de SystemUUID:ec2021d9-9c7a-f778-9817-9a17946186de BootID:ad8067dd-a372-49ed-8db4-b49a7dbe7817 Filesystems:[{Device:overlay_0-508 DeviceMajor:0 DeviceMinor:508 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/84467c9f-0161-4e44-9420-dcc224215f05/volumes/kubernetes.io~projected/kube-api-access-snzkj DeviceMajor:0 DeviceMinor:61 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/10a4536550cb2ed604ba15845641ceea53f12f3dbaf83459cff986f4581ce981/userdata/shm DeviceMajor:0 DeviceMinor:205 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-273 DeviceMajor:0 DeviceMinor:273 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/32287d5eeb399a84296014918149d6f84f76c23abb32ef0a53092c34a1148076/userdata/shm DeviceMajor:0 DeviceMinor:286 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volumes/kubernetes.io~projected/kube-api-access-4mnfp DeviceMajor:0 DeviceMinor:316 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:461 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-489 DeviceMajor:0 DeviceMinor:489 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-502 DeviceMajor:0 DeviceMinor:502 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-159 DeviceMajor:0 DeviceMinor:159 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e761db17-b05a-4f51-8fb9-c2126ee35fe1/volumes/kubernetes.io~projected/kube-api-access-99wqw DeviceMajor:0 DeviceMinor:203 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-298 DeviceMajor:0 DeviceMinor:298 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2e3415b9-cef2-439e-a516-f4adc73822c4/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:327 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/cb3cdef3-ff8c-4e53-8852-81d064f58c21/volumes/kubernetes.io~secret/secret-metrics-server-client-certs DeviceMajor:0 DeviceMinor:372 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volume-subpaths/web-config/config-reloader/6 DeviceMajor:0 DeviceMinor:304 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-533 DeviceMajor:0 DeviceMinor:533 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7aef818a8d6fb609cd74e4d5049534a199a24e35cbed217de7b76ba4649a9546/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4e73c1ca-fa5d-4485-a439-a6f8eb19a731/volumes/kubernetes.io~projected/kube-api-access-r9hbn DeviceMajor:0 DeviceMinor:281 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b32881df604a3e3309316929c6e7485ad735c819a5dbedfe2c87ccf1b6bccdf8/userdata/shm DeviceMajor:0 DeviceMinor:324 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/2e3415b9-cef2-439e-a516-f4adc73822c4/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules DeviceMajor:0 DeviceMinor:334 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/15a806bb-6e90-479d-8f94-d9915b47cbde/volumes/kubernetes.io~projected/kube-api-access-t8kx7 DeviceMajor:0 DeviceMinor:62 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-134 DeviceMajor:0 DeviceMinor:134 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-215 DeviceMajor:0 DeviceMinor:215 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-249 DeviceMajor:0 DeviceMinor:249 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:313 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/cb3cdef3-ff8c-4e53-8852-81d064f58c21/volumes/kubernetes.io~secret/client-ca-bundle DeviceMajor:0 DeviceMinor:378 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file DeviceMajor:0 DeviceMinor:454 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-142 DeviceMajor:0 DeviceMinor:142 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/15d3a384-31d9-4152-9e38-491942e6d5c5/volumes/kubernetes.io~secret/prometheus-operator-tls DeviceMajor:0 DeviceMinor:240 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/943a1337-2968-4104-aa18-90f3cd407ea0/volumes/kubernetes.io~projected/kube-api-access-4d9ln DeviceMajor:0 DeviceMinor:270 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/cb3cdef3-ff8c-4e53-8852-81d064f58c21/volumes/kubernetes.io~projected/kube-api-access-c47fh DeviceMajor:0 DeviceMinor:379 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/41a3e68b-3746-48ca-89c7-99347353fb8b/volumes/kubernetes.io~projected/kube-api-access-8dlhh DeviceMajor:0 DeviceMinor:63 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/e2026273-f131-45c2-a443-c66a07d518ae/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:197 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/e761db17-b05a-4f51-8fb9-c2126ee35fe1/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:201 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-211 DeviceMajor:0 DeviceMinor:211 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-230 DeviceMajor:0 DeviceMinor:230 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2e3415b9-cef2-439e-a516-f4adc73822c4/volumes/kubernetes.io~secret/secret-thanos-querier-tls DeviceMajor:0 DeviceMinor:337 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e78d22ae35cb9c03e20ab4919fc73603d098e08b2144390099839d152875e5d9/userdata/shm DeviceMajor:0 DeviceMinor:479 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-213 DeviceMajor:0 DeviceMinor:213 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/52ac610d-a729-4e9f-b70b-700d30dbf64a/volumes/kubernetes.io~projected/kube-api-access-dqb44 DeviceMajor:0 DeviceMinor:283 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6dfcc9201bb49276554033ae87390e30f9bf55f79b51e5115f0d11b528a8affd/userdata/shm DeviceMajor:0 DeviceMinor:284 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/983b05f9-8574-4a23-b3de-951a68c553a1/volumes/kubernetes.io~projected/kube-api-access-wnhnw DeviceMajor:0 DeviceMinor:66 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/677ad3e7f4a3f85fe674245da968f88dcf453ef09002af72d9e89c9314b4e283/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2d4621d091343a0a22e1a151ddbd2410b10d122e6853e90a486d28f69f97525d/userdata/shm DeviceMajor:0 DeviceMinor:207 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/52ac610d-a729-4e9f-b70b-700d30dbf64a/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:275 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volumes/kubernetes.io~secret/cluster-tls-config DeviceMajor:0 DeviceMinor:311 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/e2494f67-c3dd-4cc1-9035-da81cb1c6308/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:319 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-218 DeviceMajor:0 DeviceMinor:218 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/943a1337-2968-4104-aa18-90f3cd407ea0/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:265 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-357 DeviceMajor:0 DeviceMinor:357 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/cb3cdef3-ff8c-4e53-8852-81d064f58c21/volumes/kubernetes.io~secret/secret-metrics-server-tls DeviceMajor:0 DeviceMinor:377 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/433c1bd296c4593fbeb70e1cde9d7d2c13ba40fc285ca4b1ad4251dddec2e8ba/userdata/shm DeviceMajor:0 DeviceMinor:383 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:459 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-259 DeviceMajor:0 DeviceMinor:259 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:304 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:452 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-528 DeviceMajor:0 DeviceMinor:528 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy DeviceMajor:0 DeviceMinor:308 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:315 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-359 DeviceMajor:0 DeviceMinor:359 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-414 DeviceMajor:0 DeviceMinor:414 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volumes/kubernetes.io~secret/secret-metrics-client-certs DeviceMajor:0 DeviceMinor:450 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-513 DeviceMajor:0 DeviceMinor:513 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e5dec6adfc8820000948b72af6828f2bc38ea8f4cc32dd8941bb9978578ce98b/userdata/shm DeviceMajor:0 DeviceMinor:244 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-251 DeviceMajor:0 DeviceMinor:251 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2e2913f2-f166-4ce6-b93b-cea606008bba/volumes/kubernetes.io~projected/kube-api-access-55vdw DeviceMajor:0 DeviceMinor:59 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-294 DeviceMajor:0 DeviceMinor:294 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-367 DeviceMajor:0 DeviceMinor:367 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-403 DeviceMajor:0 DeviceMinor:403 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-429 DeviceMajor:0 DeviceMinor:429 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls DeviceMajor:0 DeviceMinor:453 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-466 DeviceMajor:0 DeviceMinor:466 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e7658661-8ddc-4443-91d0-edeaab291256/volumes/kubernetes.io~projected/kube-api-access-p9d5c DeviceMajor:0 DeviceMinor:65 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/558b386bac0a04c1c81fa904b658128a1530a435a226d307b63c4b9611cee112/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/15d3a384-31d9-4152-9e38-491942e6d5c5/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:236 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/e71535c3-0a11-43fc-ad7e-4ea18213f0cf/volumes/kubernetes.io~projected/kube-api-access-4gsxn DeviceMajor:0 DeviceMinor:282 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/2e3415b9-cef2-439e-a516-f4adc73822c4/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy DeviceMajor:0 DeviceMinor:335 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/917b680b6a8034f28d5adcd0a2daad9f2899a4d72cdb931b4f044ef6e0000732/userdata/shm DeviceMajor:0 DeviceMinor:75 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e029b38ceaada5030743e14f1ba271133d056ff593954ef7c3bee0fed84c8611/userdata/shm DeviceMajor:0 DeviceMinor:209 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-225 DeviceMajor:0 DeviceMinor:225 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/15d3a384-31d9-4152-9e38-491942e6d5c5/volumes/kubernetes.io~projected/kube-api-access-mt8ph DeviceMajor:0 DeviceMinor:241 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:310 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-408 DeviceMajor:0 DeviceMinor:408 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-424 DeviceMajor:0 DeviceMinor:424 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/68ca63f9ce49f69740516bf93e90c055daa61df0fcaeada739b8405ef1e5a6bb/userdata/shm DeviceMajor:0 DeviceMinor:290 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volumes/kubernetes.io~secret/config-volume DeviceMajor:0 DeviceMinor:314 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/2e3415b9-cef2-439e-a516-f4adc73822c4/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:336 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/2e3415b9-cef2-439e-a516-f4adc73822c4/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics DeviceMajor:0 DeviceMinor:338 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volume-subpaths/web-config/init-config-reloader/2 DeviceMajor:0 DeviceMinor:461 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-257 DeviceMajor:0 DeviceMinor:257 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4e73c1ca-fa5d-4485-a439-a6f8eb19a731/volumes/kubernetes.io~secret/openshift-state-metrics-tls DeviceMajor:0 DeviceMinor:279 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-325 DeviceMajor:0 DeviceMinor:325 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-344 DeviceMajor:0 DeviceMinor:344 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/249a9856013b47fb204ab861d32e3068bf3bb7d9a25cf8e8f901dfcb7321c0ed/userdata/shm DeviceMajor:0 DeviceMinor:456 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/649dd5b0-1649-4f63-a148-40fd3f3e07f4/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:475 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/2e2913f2-f166-4ce6-b93b-cea606008bba/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:56 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volume-subpaths/web-config/prometheus/15 DeviceMajor:0 DeviceMinor:461 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/c0fdd204-e1ad-4de8-ab18-52ab672cc3a4/volumes/kubernetes.io~projected/kube-api-access-n7ccd DeviceMajor:0 DeviceMinor:67 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-217 DeviceMajor:0 DeviceMinor:217 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:455 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-518 DeviceMajor:0 DeviceMinor:518 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/76322934-bb51-4c0e-a7df-37f506b6cfc4/volumes/kubernetes.io~projected/kube-api-access-lvh9s DeviceMajor:0 DeviceMinor:202 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/e71535c3-0a11-43fc-ad7e-4ea18213f0cf/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:276 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-296 DeviceMajor:0 DeviceMinor:296 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volumes/kubernetes.io~secret/secret-alertmanager-main-tls DeviceMajor:0 DeviceMinor:309 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-355 DeviceMajor:0 DeviceMinor:355 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b0c219fda0631bb6714472549c903682de2294233158f20ef03eb3fd1a222da4/userdata/shm DeviceMajor:0 DeviceMinor:477 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volume-subpaths/web-config/config-reloader/2 DeviceMajor:0 DeviceMinor:461 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/e011b0d4-3387-4b79-9a3f-b3fac185c126/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:55 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ea5fccd4474977471ef68389849a0ebd56b1ad2e99e79b8f4f49d651ef6af6f6/userdata/shm DeviceMajor:0 DeviceMinor:81 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-288 DeviceMajor:0 DeviceMinor:288 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volume-subpaths/web-config/init-config-reloader/6 DeviceMajor:0 DeviceMinor:304 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volume-subpaths/web-config/alertmanager/9 DeviceMajor:0 DeviceMinor:304 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volume-subpaths/cluster-tls-config/alertmanager/10 DeviceMajor:0 DeviceMinor:311 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-438 DeviceMajor:0 DeviceMinor:438 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/78514c09bd915527d36f698947763edb10e4fc561c0df91d2d3aff429eb006b3/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/29088fd048caacb1e145426d5dd67dcd393ec5082be519d12dd8752559bbd3a1/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c226e31ec99116e0934c2bef84809cbf3754c952d373ee11f2e5763a8f62c26c/userdata/shm DeviceMajor:0 DeviceMinor:271 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-342 DeviceMajor:0 DeviceMinor:342 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:451 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/217f56323a79c3e1ca3bfb72dfbcbd780ca055ccb1e4f40df66d0a9825a7ccc3/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4e73c1ca-fa5d-4485-a439-a6f8eb19a731/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:280 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-390 DeviceMajor:0 DeviceMinor:390 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volumes/kubernetes.io~projected/kube-api-access-rr7j5 DeviceMajor:0 DeviceMinor:462 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d651d8300829fdc4f2ebf2387f9c67fbcd7e48bf36f859e83047c8beb6eadb41/userdata/shm DeviceMajor:0 DeviceMinor:480 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-523 DeviceMajor:0 DeviceMinor:523 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/52ac610d-a729-4e9f-b70b-700d30dbf64a/volumes/kubernetes.io~secret/kube-state-metrics-tls DeviceMajor:0 DeviceMinor:278 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-292 DeviceMajor:0 DeviceMinor:292 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2e3415b9-cef2-439e-a516-f4adc73822c4/volumes/kubernetes.io~projected/kube-api-access-j9bb7 DeviceMajor:0 DeviceMinor:339 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volumes/kubernetes.io~secret/secret-kube-rbac-proxy DeviceMajor:0 DeviceMinor:457 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406007808 Type:vfs Inodes:1048576 HasInodes:true} {Device:/run/containers/storage/overlay-containers/999df1dddddc5ec92ae1e4b7737620325724e656c49d382a324e842d76d58a10/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/e2026273-f131-45c2-a443-c66a07d518ae/volumes/kubernetes.io~projected/kube-api-access-df98z DeviceMajor:0 DeviceMinor:204 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/e011b0d4-3387-4b79-9a3f-b3fac185c126/volumes/kubernetes.io~projected/kube-api-access-qwdt6 DeviceMajor:0 DeviceMinor:60 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-164 DeviceMajor:0 DeviceMinor:164 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/76322934-bb51-4c0e-a7df-37f506b6cfc4/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:45 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/e2494f67-c3dd-4cc1-9035-da81cb1c6308/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:320 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-419 DeviceMajor:0 DeviceMinor:419 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/84467c9f-0161-4e44-9420-dcc224215f05/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:474 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34/volumes/kubernetes.io~projected/kube-api-access-xxhzp DeviceMajor:0 DeviceMinor:58 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-242 DeviceMajor:0 DeviceMinor:242 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/943a1337-2968-4104-aa18-90f3cd407ea0/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:269 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/e2494f67-c3dd-4cc1-9035-da81cb1c6308/volumes/kubernetes.io~projected/kube-api-access-4wfn9 DeviceMajor:0 DeviceMinor:321 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8d2d30386797ac9b69c9c8d947700e2e4f8a7d33abdde1e3021c9147623865bd/userdata/shm DeviceMajor:0 DeviceMinor:340 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-382 DeviceMajor:0 DeviceMinor:382 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:overlay_0-111 DeviceMajor:0 DeviceMinor:111 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e71535c3-0a11-43fc-ad7e-4ea18213f0cf/volumes/kubernetes.io~secret/node-exporter-tls DeviceMajor:0 DeviceMinor:277 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric DeviceMajor:0 DeviceMinor:312 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-329 DeviceMajor:0 DeviceMinor:329 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-322 DeviceMajor:0 DeviceMinor:322 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-346 DeviceMajor:0 DeviceMinor:346 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-398 DeviceMajor:0 DeviceMinor:398 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-434 DeviceMajor:0 DeviceMinor:434 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-441 DeviceMajor:0 DeviceMinor:441 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-491 DeviceMajor:0 DeviceMinor:491 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e011b0d4-3387-4b79-9a3f-b3fac185c126/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volumes/kubernetes.io~secret/config DeviceMajor:0 DeviceMinor:449 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-485 DeviceMajor:0 DeviceMinor:485 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fd77571d-49e8-4127-951a-f8a4412d8e43/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:64 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls DeviceMajor:0 DeviceMinor:458 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-468 DeviceMajor:0 DeviceMinor:468 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/87451849-2618-4958-bc4a-114cc208434e/volumes/kubernetes.io~projected/kube-api-access-fsdqt DeviceMajor:0 DeviceMinor:476 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-483 DeviceMajor:0 DeviceMinor:483 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-487 DeviceMajor:0 DeviceMinor:487 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2e2913f2-f166-4ce6-b93b-cea606008bba/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:57 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1a280937337ffdfc84a36b3b3fca9664c8a362c5736abc011890fec2672f283d/userdata/shm DeviceMajor:0 DeviceMinor:89 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/20dee4bad545e8a356d919537c0f80d5a45ac3647ec5912cf8aa83ad05285258/userdata/shm DeviceMajor:0 DeviceMinor:317 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-380 DeviceMajor:0 DeviceMinor:380 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-392 DeviceMajor:0 DeviceMinor:392 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-497 DeviceMajor:0 DeviceMinor:497 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:10a4536550cb2ed MacAddress:3e:5f:9d:bf:6e:96 Speed:10000 Mtu:8901} {Name:20dee4bad545e8a MacAddress:7e:64:82:52:19:0f Speed:10000 Mtu:8901} {Name:249a9856013b47f MacAddress:4a:83:ff:f2:c0:5a Speed:10000 Mtu:8901} {Name:2d4621d091343a0 MacAddress:12:a5:d3:c5:fc:0e Speed:10000 Mtu:8901} {Name:433c1bd296c4593 MacAddress:32:22:0e:15:50:a9 Speed:10000 Mtu:8901} {Name:68ca63f9ce49f69 MacAddress:de:52:81:03:df:42 Speed:10000 Mtu:8901} {Name:6dfcc9201bb4927 MacAddress:4e:6a:e7:25:bd:37 Speed:10000 Mtu:8901} {Name:8d2d30386797ac9 MacAddress:52:90:cb:72:b8:5c Speed:10000 Mtu:8901} {Name:b0c219fda0631bb MacAddress:ee:8f:02:ba:69:ec Speed:10000 Mtu:8901} {Name:b32881df604a3e3 MacAddress:a2:41:be:e8:8b:40 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:d8:ff:04:57 Speed:0 Mtu:9001} {Name:br-int MacAddress:2a:e6:d2:24:01:de Speed:0 Mtu:8901} {Name:c226e31ec99116e MacAddress:16:99:7d:84:55:91 Speed:10000 Mtu:8901} {Name:d651d8300829fdc MacAddress:02:78:91:cd:6b:6f Speed:10000 Mtu:8901} {Name:e029b38ceaada50 MacAddress:22:d6:f0:bc:55:8e Speed:10000 Mtu:8901} {Name:e5dec6adfc88200 MacAddress:c2:0e:08:93:21:ae Speed:10000 Mtu:8901} {Name:e78d22ae35cb9c0 MacAddress:26:9d:f8:4d:4e:f5 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:d8:ff:04:57 Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:66:36:77:6f:c7:1f Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:86:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:ee:84:11:91:c9:b3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812015616 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Nov 02 21:53:47.813241 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.813247 5963 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Nov 02 21:53:47.813554 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.813297 5963 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Nov 02 21:53:47.813625 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.813601 5963 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Nov 02 21:53:47.813800 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.813626 5963 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-99.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Nov 02 21:53:47.813850 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.813803 5963 topology_manager.go:143] "Creating topology manager with none policy" Nov 02 21:53:47.813850 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.813811 5963 container_manager_linux.go:311] "Creating device plugin manager" Nov 02 21:53:47.813850 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.813821 5963 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 02 21:53:47.813850 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.813841 5963 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 02 21:53:47.813955 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.813944 5963 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Nov 02 21:53:47.814149 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.814139 5963 state_mem.go:41] "Initialized" logger="CPUManager state memory" Nov 02 21:53:47.814274 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.814265 5963 server.go:1235] "Using root directory" path="/var/lib/kubelet" Nov 02 21:53:47.814312 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.814304 5963 kubelet.go:493] "Attempting to sync node with API server" Nov 02 21:53:47.814341 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.814320 5963 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Nov 02 21:53:47.814341 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.814331 5963 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Nov 02 21:53:47.814341 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.814341 5963 kubelet.go:405] "Adding apiserver pod source" Nov 02 21:53:47.814424 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.814350 5963 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Nov 02 21:53:47.815114 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.815095 5963 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Nov 02 21:53:47.815114 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.815109 5963 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 02 21:53:47.816065 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.816046 5963 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Nov 02 21:53:47.819976 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.819955 5963 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Nov 02 21:53:47.819976 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.819974 5963 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 02 21:53:47.820124 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.820103 5963 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem" Nov 02 21:53:47.820340 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.820323 5963 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Nov 02 21:53:47.820405 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.820366 5963 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Nov 02 21:53:47.820500 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.820489 5963 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Nov 02 21:53:47.820567 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.820509 5963 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Nov 02 21:53:47.820567 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.820520 5963 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Nov 02 21:53:47.820567 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.820528 5963 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Nov 02 21:53:47.820567 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.820537 5963 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Nov 02 21:53:47.820567 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.820546 5963 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Nov 02 21:53:47.820567 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.820555 5963 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Nov 02 21:53:47.820567 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.820564 5963 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Nov 02 21:53:47.820907 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.820575 5963 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Nov 02 21:53:47.820907 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.820585 5963 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Nov 02 21:53:47.820907 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.820599 5963 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Nov 02 21:53:47.820907 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.820612 5963 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Nov 02 21:53:47.820907 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.820646 5963 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Nov 02 21:53:47.820907 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.820656 5963 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Nov 02 21:53:47.824235 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.824219 5963 server.go:1263] "Started kubelet" Nov 02 21:53:47.824313 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.824282 5963 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Nov 02 21:53:47.824751 ip-10-0-139-99 systemd[1]: Started Kubernetes Kubelet. Nov 02 21:53:47.825014 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.824695 5963 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Nov 02 21:53:47.825014 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.824850 5963 server_v1.go:49] "podresources" method="list" useActivePods=true Nov 02 21:53:47.825639 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.825624 5963 server.go:317] "Adding debug handlers to kubelet server" Nov 02 21:53:47.825755 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.825642 5963 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Nov 02 21:53:47.828968 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.828951 5963 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Nov 02 21:53:47.829367 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.829104 5963 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Nov 02 21:53:47.829367 ip-10-0-139-99 kubenswrapper[5963]: E1102 21:53:47.829154 5963 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-99.us-east-2.compute.internal\" not found" Nov 02 21:53:47.829367 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.829162 5963 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-01 21:47:38 +0000 UTC" deadline="2028-08-05 22:26:54.785106372 +0000 UTC" Nov 02 21:53:47.829367 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.829199 5963 volume_manager.go:309] "The desired_state_of_world populator starts" Nov 02 21:53:47.829367 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.829204 5963 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15408h33m6.955905116s" Nov 02 21:53:47.829367 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.829208 5963 volume_manager.go:311] "Starting Kubelet Volume Manager" Nov 02 21:53:47.829367 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.829221 5963 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Nov 02 21:53:47.836094 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.835129 5963 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Nov 02 21:53:47.836094 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.835147 5963 factory.go:55] Registering systemd factory Nov 02 21:53:47.836094 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.835154 5963 factory.go:223] Registration of the systemd container factory successfully Nov 02 21:53:47.836094 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.835369 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="41a3e68b-3746-48ca-89c7-99347353fb8b" volumeName="kubernetes.io/projected/41a3e68b-3746-48ca-89c7-99347353fb8b-kube-api-access-8dlhh" seLinuxMountContext="" Nov 02 21:53:47.836094 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.835414 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cb3cdef3-ff8c-4e53-8852-81d064f58c21" volumeName="kubernetes.io/configmap/cb3cdef3-ff8c-4e53-8852-81d064f58c21-configmap-kubelet-serving-ca-bundle" seLinuxMountContext="" Nov 02 21:53:47.836094 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.835429 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" volumeName="kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-main-tls" seLinuxMountContext="" Nov 02 21:53:47.836094 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.835446 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" volumeName="kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-kube-rbac-proxy-web" seLinuxMountContext="" Nov 02 21:53:47.836094 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.835460 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="15d3a384-31d9-4152-9e38-491942e6d5c5" volumeName="kubernetes.io/projected/15d3a384-31d9-4152-9e38-491942e6d5c5-kube-api-access-mt8ph" seLinuxMountContext="" Nov 02 21:53:47.836094 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.835473 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="943a1337-2968-4104-aa18-90f3cd407ea0" volumeName="kubernetes.io/secret/943a1337-2968-4104-aa18-90f3cd407ea0-console-serving-cert" seLinuxMountContext="" Nov 02 21:53:47.836094 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.835489 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e71535c3-0a11-43fc-ad7e-4ea18213f0cf" volumeName="kubernetes.io/projected/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-kube-api-access-4gsxn" seLinuxMountContext="" Nov 02 21:53:47.836094 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.835561 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="15a806bb-6e90-479d-8f94-d9915b47cbde" volumeName="kubernetes.io/projected/15a806bb-6e90-479d-8f94-d9915b47cbde-kube-api-access-t8kx7" seLinuxMountContext="" Nov 02 21:53:47.836094 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.835582 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="646bc644-a377-48b5-bd3b-1562b53e93eb" volumeName="kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-config" seLinuxMountContext="" Nov 02 21:53:47.836094 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.835596 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e011b0d4-3387-4b79-9a3f-b3fac185c126" volumeName="kubernetes.io/secret/e011b0d4-3387-4b79-9a3f-b3fac185c126-ovn-node-metrics-cert" seLinuxMountContext="" Nov 02 21:53:47.836094 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.835614 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e71535c3-0a11-43fc-ad7e-4ea18213f0cf" volumeName="kubernetes.io/empty-dir/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-node-exporter-textfile" seLinuxMountContext="" Nov 02 21:53:47.836094 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.835628 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" volumeName="kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-cluster-tls-config" seLinuxMountContext="" Nov 02 21:53:47.836094 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.835640 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e71535c3-0a11-43fc-ad7e-4ea18213f0cf" volumeName="kubernetes.io/configmap/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-metrics-client-ca" seLinuxMountContext="" Nov 02 21:53:47.836094 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.835657 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2e3415b9-cef2-439e-a516-f4adc73822c4" volumeName="kubernetes.io/projected/2e3415b9-cef2-439e-a516-f4adc73822c4-kube-api-access-j9bb7" seLinuxMountContext="" Nov 02 21:53:47.836094 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.835719 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2e3415b9-cef2-439e-a516-f4adc73822c4" volumeName="kubernetes.io/secret/2e3415b9-cef2-439e-a516-f4adc73822c4-secret-thanos-querier-kube-rbac-proxy-metrics" seLinuxMountContext="" Nov 02 21:53:47.836094 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.835731 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2e3415b9-cef2-439e-a516-f4adc73822c4" volumeName="kubernetes.io/secret/2e3415b9-cef2-439e-a516-f4adc73822c4-secret-thanos-querier-kube-rbac-proxy" seLinuxMountContext="" Nov 02 21:53:47.836094 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.835743 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c0fdd204-e1ad-4de8-ab18-52ab672cc3a4" volumeName="kubernetes.io/configmap/c0fdd204-e1ad-4de8-ab18-52ab672cc3a4-serviceca" seLinuxMountContext="" Nov 02 21:53:47.836094 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.835759 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4e73c1ca-fa5d-4485-a439-a6f8eb19a731" volumeName="kubernetes.io/secret/4e73c1ca-fa5d-4485-a439-a6f8eb19a731-openshift-state-metrics-tls" seLinuxMountContext="" Nov 02 21:53:47.836094 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.835805 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cb3cdef3-ff8c-4e53-8852-81d064f58c21" volumeName="kubernetes.io/secret/cb3cdef3-ff8c-4e53-8852-81d064f58c21-secret-metrics-server-tls" seLinuxMountContext="" Nov 02 21:53:47.836094 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.835848 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" volumeName="kubernetes.io/configmap/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-alertmanager-trusted-ca-bundle" seLinuxMountContext="" Nov 02 21:53:47.837321 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.836984 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="52ac610d-a729-4e9f-b70b-700d30dbf64a" volumeName="kubernetes.io/secret/52ac610d-a729-4e9f-b70b-700d30dbf64a-kube-state-metrics-kube-rbac-proxy-config" seLinuxMountContext="" Nov 02 21:53:47.837321 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837015 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="943a1337-2968-4104-aa18-90f3cd407ea0" volumeName="kubernetes.io/secret/943a1337-2968-4104-aa18-90f3cd407ea0-console-oauth-config" seLinuxMountContext="" Nov 02 21:53:47.837321 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837029 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="646bc644-a377-48b5-bd3b-1562b53e93eb" volumeName="kubernetes.io/empty-dir/646bc644-a377-48b5-bd3b-1562b53e93eb-config-out" seLinuxMountContext="" Nov 02 21:53:47.837321 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837035 5963 factory.go:153] Registering CRI-O factory Nov 02 21:53:47.837321 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837041 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="943a1337-2968-4104-aa18-90f3cd407ea0" volumeName="kubernetes.io/empty-dir/943a1337-2968-4104-aa18-90f3cd407ea0-tmp" seLinuxMountContext="" Nov 02 21:53:47.837321 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837049 5963 factory.go:223] Registration of the crio container factory successfully Nov 02 21:53:47.837321 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837055 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" volumeName="kubernetes.io/empty-dir/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-config-out" seLinuxMountContext="" Nov 02 21:53:47.837321 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837067 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e2494f67-c3dd-4cc1-9035-da81cb1c6308" volumeName="kubernetes.io/secret/e2494f67-c3dd-4cc1-9035-da81cb1c6308-console-serving-cert" seLinuxMountContext="" Nov 02 21:53:47.837321 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837079 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="52ac610d-a729-4e9f-b70b-700d30dbf64a" volumeName="kubernetes.io/empty-dir/52ac610d-a729-4e9f-b70b-700d30dbf64a-volume-directive-shadow" seLinuxMountContext="" Nov 02 21:53:47.837321 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837092 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="646bc644-a377-48b5-bd3b-1562b53e93eb" volumeName="kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-trusted-ca-bundle" seLinuxMountContext="" Nov 02 21:53:47.837321 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837102 5963 factory.go:103] Registering Raw factory Nov 02 21:53:47.837321 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837111 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="646bc644-a377-48b5-bd3b-1562b53e93eb" volumeName="kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-configmap-kubelet-serving-ca-bundle" seLinuxMountContext="" Nov 02 21:53:47.837321 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837117 5963 manager.go:1199] Started watching for new ooms in manager Nov 02 21:53:47.837321 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837125 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="646bc644-a377-48b5-bd3b-1562b53e93eb" volumeName="kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-prometheus-k8s-kube-rbac-proxy-web" seLinuxMountContext="" Nov 02 21:53:47.837321 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837138 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="84467c9f-0161-4e44-9420-dcc224215f05" volumeName="kubernetes.io/projected/84467c9f-0161-4e44-9420-dcc224215f05-kube-api-access-snzkj" seLinuxMountContext="" Nov 02 21:53:47.837321 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837163 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="943a1337-2968-4104-aa18-90f3cd407ea0" volumeName="kubernetes.io/projected/943a1337-2968-4104-aa18-90f3cd407ea0-kube-api-access-4d9ln" seLinuxMountContext="" Nov 02 21:53:47.837321 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837175 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" volumeName="kubernetes.io/configmap/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-metrics-client-ca" seLinuxMountContext="" Nov 02 21:53:47.837321 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837206 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e2026273-f131-45c2-a443-c66a07d518ae" volumeName="kubernetes.io/configmap/e2026273-f131-45c2-a443-c66a07d518ae-kube-rbac-proxy-cm" seLinuxMountContext="" Nov 02 21:53:47.837321 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837218 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e2026273-f131-45c2-a443-c66a07d518ae" volumeName="kubernetes.io/empty-dir/e2026273-f131-45c2-a443-c66a07d518ae-data-volume" seLinuxMountContext="" Nov 02 21:53:47.837321 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837230 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e2494f67-c3dd-4cc1-9035-da81cb1c6308" volumeName="kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-console-config" seLinuxMountContext="" Nov 02 21:53:47.837321 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837243 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e2494f67-c3dd-4cc1-9035-da81cb1c6308" volumeName="kubernetes.io/projected/e2494f67-c3dd-4cc1-9035-da81cb1c6308-kube-api-access-4wfn9" seLinuxMountContext="" Nov 02 21:53:47.837321 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837258 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="15d3a384-31d9-4152-9e38-491942e6d5c5" volumeName="kubernetes.io/configmap/15d3a384-31d9-4152-9e38-491942e6d5c5-metrics-client-ca" seLinuxMountContext="" Nov 02 21:53:47.837321 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837269 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" volumeName="kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-kube-rbac-proxy-metric" seLinuxMountContext="" Nov 02 21:53:47.837321 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837280 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e2494f67-c3dd-4cc1-9035-da81cb1c6308" volumeName="kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-trusted-ca-bundle" seLinuxMountContext="" Nov 02 21:53:47.837321 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837291 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e7658661-8ddc-4443-91d0-edeaab291256" volumeName="kubernetes.io/projected/e7658661-8ddc-4443-91d0-edeaab291256-kube-api-access-p9d5c" seLinuxMountContext="" Nov 02 21:53:47.837321 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837303 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="52ac610d-a729-4e9f-b70b-700d30dbf64a" volumeName="kubernetes.io/projected/52ac610d-a729-4e9f-b70b-700d30dbf64a-kube-api-access-dqb44" seLinuxMountContext="" Nov 02 21:53:47.837321 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837315 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="646bc644-a377-48b5-bd3b-1562b53e93eb" volumeName="kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-configmap-serving-certs-ca-bundle" seLinuxMountContext="" Nov 02 21:53:47.837321 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837331 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="646bc644-a377-48b5-bd3b-1562b53e93eb" volumeName="kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-web-config" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837343 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="943a1337-2968-4104-aa18-90f3cd407ea0" volumeName="kubernetes.io/configmap/943a1337-2968-4104-aa18-90f3cd407ea0-oauth-serving-cert" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837357 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" volumeName="kubernetes.io/projected/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-kube-api-access-4mnfp" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837369 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e011b0d4-3387-4b79-9a3f-b3fac185c126" volumeName="kubernetes.io/projected/e011b0d4-3387-4b79-9a3f-b3fac185c126-kube-api-access-qwdt6" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837383 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="15d3a384-31d9-4152-9e38-491942e6d5c5" volumeName="kubernetes.io/secret/15d3a384-31d9-4152-9e38-491942e6d5c5-prometheus-operator-kube-rbac-proxy-config" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837396 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2e3415b9-cef2-439e-a516-f4adc73822c4" volumeName="kubernetes.io/configmap/2e3415b9-cef2-439e-a516-f4adc73822c4-metrics-client-ca" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837412 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2e3415b9-cef2-439e-a516-f4adc73822c4" volumeName="kubernetes.io/secret/2e3415b9-cef2-439e-a516-f4adc73822c4-secret-thanos-querier-kube-rbac-proxy-web" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837426 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e2026273-f131-45c2-a443-c66a07d518ae" volumeName="kubernetes.io/projected/e2026273-f131-45c2-a443-c66a07d518ae-kube-api-access-df98z" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837439 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e011b0d4-3387-4b79-9a3f-b3fac185c126" volumeName="kubernetes.io/configmap/e011b0d4-3387-4b79-9a3f-b3fac185c126-ovnkube-config" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837453 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e2494f67-c3dd-4cc1-9035-da81cb1c6308" volumeName="kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-oauth-serving-cert" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837467 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="646bc644-a377-48b5-bd3b-1562b53e93eb" volumeName="kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-configmap-metrics-client-ca" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837480 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="646bc644-a377-48b5-bd3b-1562b53e93eb" volumeName="kubernetes.io/empty-dir/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-db" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837494 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="646bc644-a377-48b5-bd3b-1562b53e93eb" volumeName="kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-thanos-prometheus-http-client-file" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837520 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="983b05f9-8574-4a23-b3de-951a68c553a1" volumeName="kubernetes.io/empty-dir/983b05f9-8574-4a23-b3de-951a68c553a1-tmp-dir" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837535 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34" volumeName="kubernetes.io/configmap/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-cni-binary-copy" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837546 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" volumeName="kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-config-volume" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837558 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="646bc644-a377-48b5-bd3b-1562b53e93eb" volumeName="kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-prometheus-k8s-tls" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837570 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="649dd5b0-1649-4f63-a148-40fd3f3e07f4" volumeName="kubernetes.io/secret/649dd5b0-1649-4f63-a148-40fd3f3e07f4-original-pull-secret" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837583 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34" volumeName="kubernetes.io/configmap/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-multus-daemon-config" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837594 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e011b0d4-3387-4b79-9a3f-b3fac185c126" volumeName="kubernetes.io/configmap/e011b0d4-3387-4b79-9a3f-b3fac185c126-env-overrides" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837606 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fd77571d-49e8-4127-951a-f8a4412d8e43" volumeName="kubernetes.io/configmap/fd77571d-49e8-4127-951a-f8a4412d8e43-konnectivity-ca" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837620 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e2494f67-c3dd-4cc1-9035-da81cb1c6308" volumeName="kubernetes.io/secret/e2494f67-c3dd-4cc1-9035-da81cb1c6308-console-oauth-config" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837631 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e71535c3-0a11-43fc-ad7e-4ea18213f0cf" volumeName="kubernetes.io/configmap/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-node-exporter-accelerators-collector-config" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837641 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="52ac610d-a729-4e9f-b70b-700d30dbf64a" volumeName="kubernetes.io/configmap/52ac610d-a729-4e9f-b70b-700d30dbf64a-kube-state-metrics-custom-resource-state-configmap" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837655 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="84467c9f-0161-4e44-9420-dcc224215f05" volumeName="kubernetes.io/secret/84467c9f-0161-4e44-9420-dcc224215f05-metrics-certs" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837716 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e761db17-b05a-4f51-8fb9-c2126ee35fe1" volumeName="kubernetes.io/empty-dir/e761db17-b05a-4f51-8fb9-c2126ee35fe1-tmp-dir" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837727 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="15a806bb-6e90-479d-8f94-d9915b47cbde" volumeName="kubernetes.io/configmap/15a806bb-6e90-479d-8f94-d9915b47cbde-whereabouts-flatfile-configmap" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837738 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2e2913f2-f166-4ce6-b93b-cea606008bba" volumeName="kubernetes.io/empty-dir/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-tuned" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837750 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="646bc644-a377-48b5-bd3b-1562b53e93eb" volumeName="kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-kube-rbac-proxy" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837763 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cb3cdef3-ff8c-4e53-8852-81d064f58c21" volumeName="kubernetes.io/configmap/cb3cdef3-ff8c-4e53-8852-81d064f58c21-metrics-server-audit-profiles" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837777 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2e3415b9-cef2-439e-a516-f4adc73822c4" volumeName="kubernetes.io/secret/2e3415b9-cef2-439e-a516-f4adc73822c4-secret-thanos-querier-kube-rbac-proxy-rules" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837788 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2e3415b9-cef2-439e-a516-f4adc73822c4" volumeName="kubernetes.io/secret/2e3415b9-cef2-439e-a516-f4adc73822c4-secret-grpc-tls" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837800 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2e3415b9-cef2-439e-a516-f4adc73822c4" volumeName="kubernetes.io/secret/2e3415b9-cef2-439e-a516-f4adc73822c4-secret-thanos-querier-tls" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837810 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="646bc644-a377-48b5-bd3b-1562b53e93eb" volumeName="kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-metrics-client-certs" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837822 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2e2913f2-f166-4ce6-b93b-cea606008bba" volumeName="kubernetes.io/empty-dir/2e2913f2-f166-4ce6-b93b-cea606008bba-tmp" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837833 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2e3415b9-cef2-439e-a516-f4adc73822c4" volumeName="kubernetes.io/empty-dir/2e3415b9-cef2-439e-a516-f4adc73822c4-tmp" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837846 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" volumeName="kubernetes.io/empty-dir/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-alertmanager-main-db" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837858 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" volumeName="kubernetes.io/projected/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-tls-assets" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837870 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e71535c3-0a11-43fc-ad7e-4ea18213f0cf" volumeName="kubernetes.io/secret/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-node-exporter-tls" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837881 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e71535c3-0a11-43fc-ad7e-4ea18213f0cf" volumeName="kubernetes.io/secret/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-node-exporter-kube-rbac-proxy-config" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837892 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e761db17-b05a-4f51-8fb9-c2126ee35fe1" volumeName="kubernetes.io/secret/e761db17-b05a-4f51-8fb9-c2126ee35fe1-metrics-tls" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837905 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="646bc644-a377-48b5-bd3b-1562b53e93eb" volumeName="kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-prometheus-k8s-thanos-sidecar-tls" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837925 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e011b0d4-3387-4b79-9a3f-b3fac185c126" volumeName="kubernetes.io/configmap/e011b0d4-3387-4b79-9a3f-b3fac185c126-ovnkube-script-lib" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837937 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2e2913f2-f166-4ce6-b93b-cea606008bba" volumeName="kubernetes.io/projected/2e2913f2-f166-4ce6-b93b-cea606008bba-kube-api-access-55vdw" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837950 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="41a3e68b-3746-48ca-89c7-99347353fb8b" volumeName="kubernetes.io/configmap/41a3e68b-3746-48ca-89c7-99347353fb8b-iptables-alerter-script" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837963 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="76322934-bb51-4c0e-a7df-37f506b6cfc4" volumeName="kubernetes.io/secret/76322934-bb51-4c0e-a7df-37f506b6cfc4-cert" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837975 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="646bc644-a377-48b5-bd3b-1562b53e93eb" volumeName="kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-rulefiles-2" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837987 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="943a1337-2968-4104-aa18-90f3cd407ea0" volumeName="kubernetes.io/configmap/943a1337-2968-4104-aa18-90f3cd407ea0-console-config" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.838002 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4e73c1ca-fa5d-4485-a439-a6f8eb19a731" volumeName="kubernetes.io/secret/4e73c1ca-fa5d-4485-a439-a6f8eb19a731-openshift-state-metrics-kube-rbac-proxy-config" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.838015 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="646bc644-a377-48b5-bd3b-1562b53e93eb" volumeName="kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-rulefiles-1" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.838036 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="646bc644-a377-48b5-bd3b-1562b53e93eb" volumeName="kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-rulefiles-0" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.838050 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="646bc644-a377-48b5-bd3b-1562b53e93eb" volumeName="kubernetes.io/projected/646bc644-a377-48b5-bd3b-1562b53e93eb-tls-assets" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.838062 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="646bc644-a377-48b5-bd3b-1562b53e93eb" volumeName="kubernetes.io/projected/646bc644-a377-48b5-bd3b-1562b53e93eb-kube-api-access-rr7j5" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.838076 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c0fdd204-e1ad-4de8-ab18-52ab672cc3a4" volumeName="kubernetes.io/projected/c0fdd204-e1ad-4de8-ab18-52ab672cc3a4-kube-api-access-n7ccd" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.838090 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cb3cdef3-ff8c-4e53-8852-81d064f58c21" volumeName="kubernetes.io/empty-dir/cb3cdef3-ff8c-4e53-8852-81d064f58c21-audit-log" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.838104 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" volumeName="kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-web-config" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.838117 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="646bc644-a377-48b5-bd3b-1562b53e93eb" volumeName="kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-grpc-tls" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.838131 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34" volumeName="kubernetes.io/projected/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-kube-api-access-xxhzp" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.838145 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cb3cdef3-ff8c-4e53-8852-81d064f58c21" volumeName="kubernetes.io/secret/cb3cdef3-ff8c-4e53-8852-81d064f58c21-secret-metrics-server-client-certs" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.838159 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e2494f67-c3dd-4cc1-9035-da81cb1c6308" volumeName="kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-service-ca" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.838173 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fd77571d-49e8-4127-951a-f8a4412d8e43" volumeName="kubernetes.io/secret/fd77571d-49e8-4127-951a-f8a4412d8e43-agent-certs" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.838185 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="52ac610d-a729-4e9f-b70b-700d30dbf64a" volumeName="kubernetes.io/configmap/52ac610d-a729-4e9f-b70b-700d30dbf64a-metrics-client-ca" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.838202 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e761db17-b05a-4f51-8fb9-c2126ee35fe1" volumeName="kubernetes.io/configmap/e761db17-b05a-4f51-8fb9-c2126ee35fe1-config-volume" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.838216 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4e73c1ca-fa5d-4485-a439-a6f8eb19a731" volumeName="kubernetes.io/projected/4e73c1ca-fa5d-4485-a439-a6f8eb19a731-kube-api-access-r9hbn" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.838229 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="943a1337-2968-4104-aa18-90f3cd407ea0" volumeName="kubernetes.io/configmap/943a1337-2968-4104-aa18-90f3cd407ea0-service-ca" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.838242 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cb3cdef3-ff8c-4e53-8852-81d064f58c21" volumeName="kubernetes.io/secret/cb3cdef3-ff8c-4e53-8852-81d064f58c21-client-ca-bundle" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.838256 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e2494f67-c3dd-4cc1-9035-da81cb1c6308" volumeName="kubernetes.io/empty-dir/e2494f67-c3dd-4cc1-9035-da81cb1c6308-tmp" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.838268 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e761db17-b05a-4f51-8fb9-c2126ee35fe1" volumeName="kubernetes.io/projected/e761db17-b05a-4f51-8fb9-c2126ee35fe1-kube-api-access-99wqw" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.838280 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="15a806bb-6e90-479d-8f94-d9915b47cbde" volumeName="kubernetes.io/configmap/15a806bb-6e90-479d-8f94-d9915b47cbde-cni-binary-copy" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.838309 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="15d3a384-31d9-4152-9e38-491942e6d5c5" volumeName="kubernetes.io/secret/15d3a384-31d9-4152-9e38-491942e6d5c5-prometheus-operator-tls" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.838322 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4e73c1ca-fa5d-4485-a439-a6f8eb19a731" volumeName="kubernetes.io/configmap/4e73c1ca-fa5d-4485-a439-a6f8eb19a731-metrics-client-ca" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.838334 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="76322934-bb51-4c0e-a7df-37f506b6cfc4" volumeName="kubernetes.io/projected/76322934-bb51-4c0e-a7df-37f506b6cfc4-kube-api-access-lvh9s" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.838346 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cb3cdef3-ff8c-4e53-8852-81d064f58c21" volumeName="kubernetes.io/projected/cb3cdef3-ff8c-4e53-8852-81d064f58c21-kube-api-access-c47fh" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.838359 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="15a806bb-6e90-479d-8f94-d9915b47cbde" volumeName="kubernetes.io/configmap/15a806bb-6e90-479d-8f94-d9915b47cbde-cni-sysctl-allowlist" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.838373 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="52ac610d-a729-4e9f-b70b-700d30dbf64a" volumeName="kubernetes.io/secret/52ac610d-a729-4e9f-b70b-700d30dbf64a-kube-state-metrics-tls" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.838384 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="87451849-2618-4958-bc4a-114cc208434e" volumeName="kubernetes.io/projected/87451849-2618-4958-bc4a-114cc208434e-kube-api-access-fsdqt" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.838395 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="983b05f9-8574-4a23-b3de-951a68c553a1" volumeName="kubernetes.io/projected/983b05f9-8574-4a23-b3de-951a68c553a1-kube-api-access-wnhnw" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.838407 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" volumeName="kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-kube-rbac-proxy" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.838419 5963 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e2026273-f131-45c2-a443-c66a07d518ae" volumeName="kubernetes.io/secret/e2026273-f131-45c2-a443-c66a07d518ae-insights-runtime-extractor-tls" seLinuxMountContext="" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.838432 5963 reconstruct.go:97] "Volume reconstruction finished" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.838441 5963 reconciler.go:29] "Reconciler: start to sync state" Nov 02 21:53:47.838582 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.837549 5963 manager.go:319] Starting recovery of all containers Nov 02 21:53:47.842833 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.839744 5963 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Nov 02 21:53:47.842833 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.840943 5963 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Nov 02 21:53:47.843935 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.843910 5963 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Nov 02 21:53:47.844939 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.844906 5963 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Nov 02 21:53:47.855617 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.855378 5963 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Nov 02 21:53:47.857959 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.857928 5963 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Nov 02 21:53:47.857959 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.857958 5963 status_manager.go:249] "Starting to sync pod status with apiserver" Nov 02 21:53:47.858152 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.857980 5963 kubelet.go:2521] "Starting kubelet main sync loop" Nov 02 21:53:47.858152 ip-10-0-139-99 kubenswrapper[5963]: E1102 21:53:47.858031 5963 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Nov 02 21:53:47.862321 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.862288 5963 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 02 21:53:47.881371 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.881323 5963 generic.go:356] "Generic (PLEG): container finished" podID="15a806bb-6e90-479d-8f94-d9915b47cbde" containerID="ef5c0fdc2fd95673d5891ddd6f3771285b345fd0b9c66514390bdd2ae877377a" exitCode=0 Nov 02 21:53:47.881371 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.881366 5963 generic.go:356] "Generic (PLEG): container finished" podID="15a806bb-6e90-479d-8f94-d9915b47cbde" containerID="0fb064cd2d465eb0ffdedfd1adfa4cd712eabbf3f8957358719ce41d22ac47a1" exitCode=0 Nov 02 21:53:47.881371 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.881374 5963 generic.go:356] "Generic (PLEG): container finished" podID="15a806bb-6e90-479d-8f94-d9915b47cbde" containerID="0628aaf5748970e05c44be500eb803c60e839c16d7ca689575375e456fa65b17" exitCode=0 Nov 02 21:53:47.881623 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.881382 5963 generic.go:356] "Generic (PLEG): container finished" podID="15a806bb-6e90-479d-8f94-d9915b47cbde" containerID="2c7f42e3f3cda59d741914494c40405cb35f01d75556e0dec9e2c4d53fe5a0dc" exitCode=0 Nov 02 21:53:47.881623 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.881390 5963 generic.go:356] "Generic (PLEG): container finished" podID="15a806bb-6e90-479d-8f94-d9915b47cbde" containerID="e8d94e9522964293492cf1fd2d3b73a3fcd74b5717c04aba938b53f2c910fa09" exitCode=0 Nov 02 21:53:47.881623 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.881397 5963 generic.go:356] "Generic (PLEG): container finished" podID="15a806bb-6e90-479d-8f94-d9915b47cbde" containerID="f1936ef66fc0e02512f75c5ac76104a3087d5d43146f05a8ae7c01dbad5644d7" exitCode=0 Nov 02 21:53:47.891241 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.891209 5963 generic.go:356] "Generic (PLEG): container finished" podID="646bc644-a377-48b5-bd3b-1562b53e93eb" containerID="daa4ae9e23bc55b5e728ec658b4b361f8e847c756f967d68b8464ec4cf23b58a" exitCode=0 Nov 02 21:53:47.905757 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.905725 5963 generic.go:356] "Generic (PLEG): container finished" podID="495aa330bd161682551682a6af54a40f" containerID="8308e43645ec4ef17fa489b26333631c47f55c9ec5ebe660f195c8b2c4a5fc55" exitCode=0 Nov 02 21:53:47.922355 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.922319 5963 generic.go:356] "Generic (PLEG): container finished" podID="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" containerID="a83d6a4a581be30b30f501dbc4934ec6538832baf6b39177932118adddb1d5b0" exitCode=0 Nov 02 21:53:47.927385 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.927346 5963 generic.go:356] "Generic (PLEG): container finished" podID="e71535c3-0a11-43fc-ad7e-4ea18213f0cf" containerID="2d4148081faad2c22bfacd1f54f350c7646a3674f98a191693cc1105d312075d" exitCode=0 Nov 02 21:53:47.958192 ip-10-0-139-99 kubenswrapper[5963]: E1102 21:53:47.958125 5963 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet" Nov 02 21:53:47.962004 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.961983 5963 manager.go:324] Recovery completed Nov 02 21:53:47.989035 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.989011 5963 cpu_manager.go:226] "Starting" policy="none" Nov 02 21:53:47.989035 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.989028 5963 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Nov 02 21:53:47.989035 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.989046 5963 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Nov 02 21:53:47.989305 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.989169 5963 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet="" Nov 02 21:53:47.989305 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.989180 5963 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={} Nov 02 21:53:47.989305 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.989197 5963 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint" Nov 02 21:53:47.989305 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.989203 5963 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet="" Nov 02 21:53:47.989305 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.989208 5963 policy_none.go:50] "Start" Nov 02 21:53:47.989305 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.989216 5963 memory_manager.go:187] "Starting memorymanager" policy="None" Nov 02 21:53:47.989305 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.989224 5963 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Nov 02 21:53:47.989505 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.989347 5963 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint" Nov 02 21:53:47.989505 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.989354 5963 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint" Nov 02 21:53:47.989505 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.989359 5963 policy_none.go:44] "Start" Nov 02 21:53:47.994327 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.994298 5963 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Nov 02 21:53:47.997389 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.997374 5963 manager.go:341] "Starting Device Plugin manager" Nov 02 21:53:47.997885 ip-10-0-139-99 kubenswrapper[5963]: E1102 21:53:47.997403 5963 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Nov 02 21:53:47.997885 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.997886 5963 server.go:87] "Starting device plugin registration server" Nov 02 21:53:47.998158 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.998148 5963 eviction_manager.go:194] "Eviction manager: starting control loop" Nov 02 21:53:47.998192 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.998159 5963 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Nov 02 21:53:47.998285 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.998266 5963 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Nov 02 21:53:47.998413 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.998370 5963 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Nov 02 21:53:47.998413 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.998411 5963 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Nov 02 21:53:47.998527 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.998417 5963 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Nov 02 21:53:47.998567 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.998469 5963 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-02T21:53:47.998399047Z","UUID":"ac608520-9638-4b00-9ce5-5f6c13e69338","Handler":null,"Name":"","Endpoint":""} Nov 02 21:53:48.000012 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:47.999991 5963 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Nov 02 21:53:48.000099 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.000023 5963 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Nov 02 21:53:48.000299 ip-10-0-139-99 kubenswrapper[5963]: E1102 21:53:48.000279 5963 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Nov 02 21:53:48.098738 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.098701 5963 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 02 21:53:48.100833 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.100813 5963 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-99.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 02 21:53:48.100916 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.100848 5963 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-99.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 02 21:53:48.100916 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.100864 5963 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-99.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 02 21:53:48.101017 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.100929 5963 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-139-99.us-east-2.compute.internal" Nov 02 21:53:48.116349 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.116327 5963 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-139-99.us-east-2.compute.internal" Nov 02 21:53:48.116418 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.116409 5963 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-139-99.us-east-2.compute.internal" Nov 02 21:53:48.159229 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.159165 5963 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-99.us-east-2.compute.internal"] Nov 02 21:53:48.159908 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.159870 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-99.us-east-2.compute.internal" event={"ID":"de883a853e4817557c8c217fade4c52e","Type":"ContainerStarted","Data":"f18eb8305c9dfdcdda725077094b31a7069c058898dc938c3691c18b521fa0ec"} Nov 02 21:53:48.159908 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.159907 5963 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal" Nov 02 21:53:48.160095 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.159915 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-99.us-east-2.compute.internal" event={"ID":"de883a853e4817557c8c217fade4c52e","Type":"ContainerStarted","Data":"29088fd048caacb1e145426d5dd67dcd393ec5082be519d12dd8752559bbd3a1"} Nov 02 21:53:48.160095 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.159975 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal" event={"ID":"495aa330bd161682551682a6af54a40f","Type":"ContainerStarted","Data":"81fb46ab95eb53abe25a0bfed13a0233e2b5c72d5970ac90d6592bca82e49865"} Nov 02 21:53:48.160095 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.159998 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal" event={"ID":"495aa330bd161682551682a6af54a40f","Type":"ContainerDied","Data":"8308e43645ec4ef17fa489b26333631c47f55c9ec5ebe660f195c8b2c4a5fc55"} Nov 02 21:53:48.160095 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.160015 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal" event={"ID":"495aa330bd161682551682a6af54a40f","Type":"ContainerStarted","Data":"78514c09bd915527d36f698947763edb10e4fc561c0df91d2d3aff429eb006b3"} Nov 02 21:53:48.160258 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.160141 5963 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-99.us-east-2.compute.internal" Nov 02 21:53:48.180730 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.180706 5963 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 02 21:53:48.180818 ip-10-0-139-99 kubenswrapper[5963]: E1102 21:53:48.180756 5963 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-139-99.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-99.us-east-2.compute.internal" Nov 02 21:53:48.183522 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.183508 5963 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 02 21:53:48.183630 ip-10-0-139-99 kubenswrapper[5963]: E1102 21:53:48.183542 5963 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal" Nov 02 21:53:48.246726 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.246614 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/495aa330bd161682551682a6af54a40f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal\" (UID: \"495aa330bd161682551682a6af54a40f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal" Nov 02 21:53:48.246726 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.246691 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/495aa330bd161682551682a6af54a40f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal\" (UID: \"495aa330bd161682551682a6af54a40f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal" Nov 02 21:53:48.246726 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.246716 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/de883a853e4817557c8c217fade4c52e-config\") pod \"kube-apiserver-proxy-ip-10-0-139-99.us-east-2.compute.internal\" (UID: \"de883a853e4817557c8c217fade4c52e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-99.us-east-2.compute.internal" Nov 02 21:53:48.347072 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.347030 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/495aa330bd161682551682a6af54a40f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal\" (UID: \"495aa330bd161682551682a6af54a40f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal" Nov 02 21:53:48.347072 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.347069 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/495aa330bd161682551682a6af54a40f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal\" (UID: \"495aa330bd161682551682a6af54a40f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal" Nov 02 21:53:48.347286 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.347097 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/de883a853e4817557c8c217fade4c52e-config\") pod \"kube-apiserver-proxy-ip-10-0-139-99.us-east-2.compute.internal\" (UID: \"de883a853e4817557c8c217fade4c52e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-99.us-east-2.compute.internal" Nov 02 21:53:48.347286 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.347147 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/de883a853e4817557c8c217fade4c52e-config\") pod \"kube-apiserver-proxy-ip-10-0-139-99.us-east-2.compute.internal\" (UID: \"de883a853e4817557c8c217fade4c52e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-99.us-east-2.compute.internal" Nov 02 21:53:48.347286 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.347147 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/495aa330bd161682551682a6af54a40f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal\" (UID: \"495aa330bd161682551682a6af54a40f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal" Nov 02 21:53:48.347286 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.347177 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/495aa330bd161682551682a6af54a40f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal\" (UID: \"495aa330bd161682551682a6af54a40f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal" Nov 02 21:53:48.815104 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.815066 5963 apiserver.go:52] "Watching apiserver" Nov 02 21:53:48.825811 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.825782 5963 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Nov 02 21:53:48.826702 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.826682 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-5mtfp","openshift-console/console-7d6f59494d-bzp74","openshift-multus/network-metrics-daemon-gzkfr","openshift-network-operator/iptables-alerter-kwr6l","openshift-monitoring/prometheus-operator-9cd89b74c-ltszg","openshift-network-diagnostics/network-check-target-747nn","openshift-multus/multus-kbrwm","openshift-cluster-node-tuning-operator/tuned-ff4h2","openshift-dns/node-resolver-ck8br","openshift-image-registry/node-ca-bjwd8","openshift-monitoring/prometheus-k8s-0","kube-system/konnectivity-agent-km4nc","openshift-monitoring/alertmanager-main-0","openshift-dns/dns-default-ntgwx","openshift-insights/insights-runtime-extractor-nltff","openshift-ovn-kubernetes/ovnkube-node-g996m","kube-system/global-pull-secret-syncer-vcx54","openshift-monitoring/node-exporter-lzs7z","openshift-ingress-canary/ingress-canary-m95sf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal","openshift-monitoring/metrics-server-76cf56f7bc-r5j6d","openshift-monitoring/thanos-querier-74977cc9f9-qzn9x","kube-system/kube-apiserver-proxy-ip-10-0-139-99.us-east-2.compute.internal","openshift-console/console-6bfc5dd8c9-24hxz","openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq","openshift-monitoring/openshift-state-metrics-7bd7489957-jffwq"] Nov 02 21:53:48.832979 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.831261 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-hfjlh\"" Nov 02 21:53:48.832979 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.831435 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-t9kl2\"" Nov 02 21:53:48.832979 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.832701 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Nov 02 21:53:48.832979 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.832785 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Nov 02 21:53:48.832979 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.832821 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Nov 02 21:53:48.832979 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.832893 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t9jzj\"" Nov 02 21:53:48.832979 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.832968 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-plhfq\"" Nov 02 21:53:48.833518 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.833027 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Nov 02 21:53:48.833518 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.833068 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Nov 02 21:53:48.833518 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.833108 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Nov 02 21:53:48.833518 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.833128 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Nov 02 21:53:48.833518 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.833252 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Nov 02 21:53:48.833518 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.833317 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kdpcq\"" Nov 02 21:53:48.833518 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.833447 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Nov 02 21:53:48.833932 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.833902 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Nov 02 21:53:48.834012 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.833965 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Nov 02 21:53:48.834186 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.834145 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Nov 02 21:53:48.834631 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.834609 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Nov 02 21:53:48.834736 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.834692 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Nov 02 21:53:48.834804 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.834756 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Nov 02 21:53:48.834892 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.834875 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Nov 02 21:53:48.835771 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.835753 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Nov 02 21:53:48.836338 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.836317 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Nov 02 21:53:48.836512 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.836497 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7jc6l\"" Nov 02 21:53:48.836557 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.836522 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Nov 02 21:53:48.836557 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.836529 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Nov 02 21:53:48.836635 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.836584 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-g5nbb\"" Nov 02 21:53:48.837075 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.837056 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Nov 02 21:53:48.837150 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.837099 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Nov 02 21:53:48.837317 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.837301 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sktbt\"" Nov 02 21:53:48.837923 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.837901 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Nov 02 21:53:48.838174 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.838161 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Nov 02 21:53:48.838568 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.838546 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dwp2s\"" Nov 02 21:53:48.838651 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.838575 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Nov 02 21:53:48.838749 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.838728 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dx6x8\"" Nov 02 21:53:48.838749 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.838743 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Nov 02 21:53:48.838897 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.838748 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Nov 02 21:53:48.838897 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.838768 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-k7pz9\"" Nov 02 21:53:48.839006 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.838901 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Nov 02 21:53:48.839091 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.839077 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Nov 02 21:53:48.839464 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.839446 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-9vfns\"" Nov 02 21:53:48.839538 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.839527 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Nov 02 21:53:48.839598 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.839587 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Nov 02 21:53:48.840399 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.840367 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Nov 02 21:53:48.840501 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.840400 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Nov 02 21:53:48.840571 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.840528 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Nov 02 21:53:48.840628 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.840576 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Nov 02 21:53:48.840628 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.840582 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Nov 02 21:53:48.840628 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.840579 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-n89v9\"" Nov 02 21:53:48.840855 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.840836 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dlndp\"" Nov 02 21:53:48.840926 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.840897 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Nov 02 21:53:48.841023 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.841006 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Nov 02 21:53:48.841555 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.841535 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Nov 02 21:53:48.841897 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.841876 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pv8v8\"" Nov 02 21:53:48.841968 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.841912 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Nov 02 21:53:48.842019 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.841974 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Nov 02 21:53:48.842065 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.842018 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Nov 02 21:53:48.842194 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.842174 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-krx6b\"" Nov 02 21:53:48.842294 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.842249 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Nov 02 21:53:48.842294 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.842265 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Nov 02 21:53:48.842294 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.842288 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Nov 02 21:53:48.843318 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.843288 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Nov 02 21:53:48.843399 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.843338 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Nov 02 21:53:48.843800 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.843768 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-h8996\"" Nov 02 21:53:48.847769 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.847752 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Nov 02 21:53:48.848846 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.848832 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-host-run-k8s-cni-cncf-io\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.848893 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.848860 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55vdw\" (UniqueName: \"kubernetes.io/projected/2e2913f2-f166-4ce6-b93b-cea606008bba-kube-api-access-55vdw\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:53:48.848893 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.848880 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-slash\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.848956 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.848904 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-log-socket\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.848956 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.848938 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e011b0d4-3387-4b79-9a3f-b3fac185c126-ovnkube-config\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.849092 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.849018 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsdqt\" (UniqueName: \"kubernetes.io/projected/87451849-2618-4958-bc4a-114cc208434e-kube-api-access-fsdqt\") pod \"network-check-target-747nn\" (UID: \"87451849-2618-4958-bc4a-114cc208434e\") " pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:53:48.849092 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.849076 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-hostroot\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.849186 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.849143 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e011b0d4-3387-4b79-9a3f-b3fac185c126-ovnkube-config\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.849244 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.849186 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-host-run-multus-certs\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.849244 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.849228 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-sys\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:53:48.849369 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.849260 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/41a3e68b-3746-48ca-89c7-99347353fb8b-iptables-alerter-script\") pod \"iptables-alerter-kwr6l\" (UID: \"41a3e68b-3746-48ca-89c7-99347353fb8b\") " pod="openshift-network-operator/iptables-alerter-kwr6l" Nov 02 21:53:48.849369 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.849287 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dlhh\" (UniqueName: \"kubernetes.io/projected/41a3e68b-3746-48ca-89c7-99347353fb8b-kube-api-access-8dlhh\") pod \"iptables-alerter-kwr6l\" (UID: \"41a3e68b-3746-48ca-89c7-99347353fb8b\") " pod="openshift-network-operator/iptables-alerter-kwr6l" Nov 02 21:53:48.849369 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.849330 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-run-netns\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.849512 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.849389 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-run-ovn\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.849512 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.849433 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxhzp\" (UniqueName: \"kubernetes.io/projected/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-kube-api-access-xxhzp\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.849512 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.849449 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/41a3e68b-3746-48ca-89c7-99347353fb8b-iptables-alerter-script\") pod \"iptables-alerter-kwr6l\" (UID: \"41a3e68b-3746-48ca-89c7-99347353fb8b\") " pod="openshift-network-operator/iptables-alerter-kwr6l" Nov 02 21:53:48.849512 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.849472 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-etc-openvswitch\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.849512 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.849501 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-cni-binary-copy\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.849512 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.849534 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e2913f2-f166-4ce6-b93b-cea606008bba-tmp\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:53:48.849894 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.849562 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-kubelet\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.849894 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.849593 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-cnibin\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.849894 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.849634 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-kubernetes\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:53:48.849894 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.849678 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-systemd\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:53:48.849894 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.849681 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e2913f2-f166-4ce6-b93b-cea606008bba-tmp\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:53:48.849894 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.849705 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.849894 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.849737 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e011b0d4-3387-4b79-9a3f-b3fac185c126-ovnkube-script-lib\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.849894 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.849763 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-multus-conf-dir\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.849894 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.849785 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-sysctl-conf\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:53:48.849894 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.849786 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-cni-binary-copy\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.849894 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.849824 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-var-lib-kubelet\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:53:48.849894 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.849854 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-host\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:53:48.849894 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.849881 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-cni-netd\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.850565 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.849916 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwdt6\" (UniqueName: \"kubernetes.io/projected/e011b0d4-3387-4b79-9a3f-b3fac185c126-kube-api-access-qwdt6\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.850565 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.849944 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-multus-socket-dir-parent\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.850565 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.849972 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Nov 02 21:53:48.850565 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.849988 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84467c9f-0161-4e44-9420-dcc224215f05-metrics-certs\") pod \"network-metrics-daemon-gzkfr\" (UID: \"84467c9f-0161-4e44-9420-dcc224215f05\") " pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:53:48.850565 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.850013 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-run-systemd\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.850565 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.850028 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Nov 02 21:53:48.850565 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.850034 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e011b0d4-3387-4b79-9a3f-b3fac185c126-ovnkube-script-lib\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.850565 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.850039 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-system-cni-dir\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.850565 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.850106 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snzkj\" (UniqueName: \"kubernetes.io/projected/84467c9f-0161-4e44-9420-dcc224215f05-kube-api-access-snzkj\") pod \"network-metrics-daemon-gzkfr\" (UID: \"84467c9f-0161-4e44-9420-dcc224215f05\") " pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:53:48.850565 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.850134 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-run-openvswitch\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.850565 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.850261 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Nov 02 21:53:48.850565 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.850316 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Nov 02 21:53:48.850565 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.850326 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Nov 02 21:53:48.850565 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.850334 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84467c9f-0161-4e44-9420-dcc224215f05-metrics-certs\") pod \"network-metrics-daemon-gzkfr\" (UID: \"84467c9f-0161-4e44-9420-dcc224215f05\") " pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:53:48.850565 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.850407 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-sysctl-d\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:53:48.850565 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.850445 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-host-var-lib-kubelet\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.850565 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.850476 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-multus-daemon-config\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.850565 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.850530 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-modprobe-d\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:53:48.851470 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.850555 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-node-log\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.851470 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.850928 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Nov 02 21:53:48.851470 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.850931 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-host-var-lib-cni-multus\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.851470 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.851144 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-p5gzk\"" Nov 02 21:53:48.851470 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.851248 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-7lqsboarsmul0\"" Nov 02 21:53:48.851470 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.851345 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-298jd\"" Nov 02 21:53:48.851470 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.851375 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Nov 02 21:53:48.851470 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.851469 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Nov 02 21:53:48.852001 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.851592 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-clfxr\"" Nov 02 21:53:48.852001 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.851701 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Nov 02 21:53:48.852001 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.851906 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Nov 02 21:53:48.852001 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.851989 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Nov 02 21:53:48.852172 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.852157 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Nov 02 21:53:48.852274 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.852257 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Nov 02 21:53:48.852349 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.852273 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Nov 02 21:53:48.852523 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.852507 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Nov 02 21:53:48.852610 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.852570 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-d7nj2\"" Nov 02 21:53:48.852692 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.852619 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Nov 02 21:53:48.852692 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.852629 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-2me9mfojb6mr\"" Nov 02 21:53:48.852872 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.852854 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Nov 02 21:53:48.852959 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.852944 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Nov 02 21:53:48.853098 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.853082 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rfcf5\"" Nov 02 21:53:48.853156 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.853115 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-multus-daemon-config\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.853284 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.853268 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Nov 02 21:53:48.853360 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.853290 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Nov 02 21:53:48.853407 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.853395 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Nov 02 21:53:48.853450 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.852629 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-sysconfig\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:53:48.853450 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.853430 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Nov 02 21:53:48.853450 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.853442 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Nov 02 21:53:48.853588 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.853455 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/41a3e68b-3746-48ca-89c7-99347353fb8b-host-slash\") pod \"iptables-alerter-kwr6l\" (UID: \"41a3e68b-3746-48ca-89c7-99347353fb8b\") " pod="openshift-network-operator/iptables-alerter-kwr6l" Nov 02 21:53:48.853588 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.853490 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e011b0d4-3387-4b79-9a3f-b3fac185c126-ovn-node-metrics-cert\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.853588 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.853514 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-host-var-lib-cni-bin\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.853588 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.853545 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-tuned\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:53:48.853588 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.853575 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-run-ovn-kubernetes\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.853881 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.853603 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-cni-bin\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.853881 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.853655 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Nov 02 21:53:48.853881 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.853085 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Nov 02 21:53:48.853881 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.853774 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-409jhd5jfe14t\"" Nov 02 21:53:48.853881 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.853780 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Nov 02 21:53:48.853881 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.853694 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-host-run-netns\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.853881 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.853832 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-var-lib-openvswitch\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.853881 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.853861 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-multus-cni-dir\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.854264 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.853896 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-run\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:53:48.854264 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.853923 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-systemd-units\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.854264 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.853958 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e011b0d4-3387-4b79-9a3f-b3fac185c126-env-overrides\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.854264 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.853985 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Nov 02 21:53:48.854264 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.854039 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-etc-kubernetes\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.854264 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.854154 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-q5wrl\"" Nov 02 21:53:48.854264 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.853492 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Nov 02 21:53:48.854589 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.854321 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-lib-modules\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:53:48.854589 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.854341 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Nov 02 21:53:48.854589 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.854524 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e011b0d4-3387-4b79-9a3f-b3fac185c126-env-overrides\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.854765 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.854626 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-tuned\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:53:48.854765 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.854751 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jnk9t\"" Nov 02 21:53:48.854853 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.854771 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e011b0d4-3387-4b79-9a3f-b3fac185c126-ovn-node-metrics-cert\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.863518 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.863487 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dlhh\" (UniqueName: \"kubernetes.io/projected/41a3e68b-3746-48ca-89c7-99347353fb8b-kube-api-access-8dlhh\") pod \"iptables-alerter-kwr6l\" (UID: \"41a3e68b-3746-48ca-89c7-99347353fb8b\") " pod="openshift-network-operator/iptables-alerter-kwr6l" Nov 02 21:53:48.863686 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.863641 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsdqt\" (UniqueName: \"kubernetes.io/projected/87451849-2618-4958-bc4a-114cc208434e-kube-api-access-fsdqt\") pod \"network-check-target-747nn\" (UID: \"87451849-2618-4958-bc4a-114cc208434e\") " pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:53:48.863769 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.863752 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55vdw\" (UniqueName: \"kubernetes.io/projected/2e2913f2-f166-4ce6-b93b-cea606008bba-kube-api-access-55vdw\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:53:48.863876 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.863858 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwdt6\" (UniqueName: \"kubernetes.io/projected/e011b0d4-3387-4b79-9a3f-b3fac185c126-kube-api-access-qwdt6\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.863944 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.863881 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snzkj\" (UniqueName: \"kubernetes.io/projected/84467c9f-0161-4e44-9420-dcc224215f05-kube-api-access-snzkj\") pod \"network-metrics-daemon-gzkfr\" (UID: \"84467c9f-0161-4e44-9420-dcc224215f05\") " pod="openshift-multus/network-metrics-daemon-gzkfr" Nov 02 21:53:48.863944 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.863860 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxhzp\" (UniqueName: \"kubernetes.io/projected/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-kube-api-access-xxhzp\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.932047 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.932017 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Nov 02 21:53:48.932210 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.932112 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Nov 02 21:53:48.932210 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.932123 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Nov 02 21:53:48.932210 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.932127 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Nov 02 21:53:48.932464 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.932448 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Nov 02 21:53:48.932746 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.932647 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Nov 02 21:53:48.932865 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.932657 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Nov 02 21:53:48.932865 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.932691 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Nov 02 21:53:48.933031 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.932701 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Nov 02 21:53:48.933031 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.932721 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Nov 02 21:53:48.933031 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.932904 5963 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Nov 02 21:53:48.933031 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.932832 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Nov 02 21:53:48.935301 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.935278 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Nov 02 21:53:48.937747 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.937730 5963 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal" Nov 02 21:53:48.943367 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.943350 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Nov 02 21:53:48.943461 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.943366 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Nov 02 21:53:48.943529 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.943466 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Nov 02 21:53:48.943608 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.943569 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Nov 02 21:53:48.952422 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.952376 5963 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 02 21:53:48.952525 ip-10-0-139-99 kubenswrapper[5963]: E1102 21:53:48.952443 5963 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-99.us-east-2.compute.internal" Nov 02 21:53:48.955122 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.955088 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-node-exporter-tls\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:48.955219 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.955175 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/15d3a384-31d9-4152-9e38-491942e6d5c5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-ltszg\" (UID: \"15d3a384-31d9-4152-9e38-491942e6d5c5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-ltszg" Nov 02 21:53:48.955219 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.955213 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-host-run-netns\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.955608 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.955247 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.955608 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.955283 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-var-lib-openvswitch\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.955608 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.955322 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52ac610d-a729-4e9f-b70b-700d30dbf64a-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-w8nqg\" (UID: \"52ac610d-a729-4e9f-b70b-700d30dbf64a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg" Nov 02 21:53:48.955608 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.955353 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/943a1337-2968-4104-aa18-90f3cd407ea0-service-ca\") pod \"console-7d6f59494d-bzp74\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:48.955608 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.955383 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e73c1ca-fa5d-4485-a439-a6f8eb19a731-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-jffwq\" (UID: \"4e73c1ca-fa5d-4485-a439-a6f8eb19a731\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-jffwq" Nov 02 21:53:48.955608 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.955418 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-node-exporter-textfile\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:48.955608 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.955447 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-systemd-units\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.955608 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.955472 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9d5c\" (UniqueName: \"kubernetes.io/projected/e7658661-8ddc-4443-91d0-edeaab291256-kube-api-access-p9d5c\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:53:48.955608 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.955500 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2e3415b9-cef2-439e-a516-f4adc73822c4-secret-thanos-querier-tls\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:48.955608 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.955537 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:48.955608 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.955568 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e761db17-b05a-4f51-8fb9-c2126ee35fe1-config-volume\") pod \"dns-default-ntgwx\" (UID: \"e761db17-b05a-4f51-8fb9-c2126ee35fe1\") " pod="openshift-dns/dns-default-ntgwx" Nov 02 21:53:48.955608 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.955591 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-lib-modules\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:53:48.956170 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.955620 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.956170 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.955649 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c47fh\" (UniqueName: \"kubernetes.io/projected/cb3cdef3-ff8c-4e53-8852-81d064f58c21-kube-api-access-c47fh\") pod \"metrics-server-76cf56f7bc-r5j6d\" (UID: \"cb3cdef3-ff8c-4e53-8852-81d064f58c21\") " pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:53:48.956170 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.955703 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/15d3a384-31d9-4152-9e38-491942e6d5c5-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-ltszg\" (UID: \"15d3a384-31d9-4152-9e38-491942e6d5c5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-ltszg" Nov 02 21:53:48.956170 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.955734 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-slash\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.956170 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.955757 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-log-socket\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.956170 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.955812 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-host-run-multus-certs\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.956170 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.955841 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.956170 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.955869 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9bb7\" (UniqueName: \"kubernetes.io/projected/2e3415b9-cef2-439e-a516-f4adc73822c4-kube-api-access-j9bb7\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:48.956170 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.955896 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-run-ovn\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.956170 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.956122 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/943a1337-2968-4104-aa18-90f3cd407ea0-service-ca\") pod \"console-7d6f59494d-bzp74\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:48.956610 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.956217 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-node-exporter-tls\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:48.956610 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.956289 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-var-lib-openvswitch\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.956610 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.956503 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52ac610d-a729-4e9f-b70b-700d30dbf64a-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-w8nqg\" (UID: \"52ac610d-a729-4e9f-b70b-700d30dbf64a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg" Nov 02 21:53:48.956610 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.956493 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.956610 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.956593 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-host-run-netns\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.957437 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.956733 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/15d3a384-31d9-4152-9e38-491942e6d5c5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-ltszg\" (UID: \"15d3a384-31d9-4152-9e38-491942e6d5c5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-ltszg" Nov 02 21:53:48.957437 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.956796 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-log-socket\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.957437 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.956860 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.957437 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.957251 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e73c1ca-fa5d-4485-a439-a6f8eb19a731-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-jffwq\" (UID: \"4e73c1ca-fa5d-4485-a439-a6f8eb19a731\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-jffwq" Nov 02 21:53:48.957437 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.957296 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/15d3a384-31d9-4152-9e38-491942e6d5c5-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-ltszg\" (UID: \"15d3a384-31d9-4152-9e38-491942e6d5c5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-ltszg" Nov 02 21:53:48.957437 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.957345 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-slash\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.957437 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.957439 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-node-exporter-textfile\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:48.957768 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.957539 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:48.957768 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.957741 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/646bc644-a377-48b5-bd3b-1562b53e93eb-config-out\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.957866 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.957789 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.957866 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.957805 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-lib-modules\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:53:48.957866 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.957825 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e7658661-8ddc-4443-91d0-edeaab291256-device-dir\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:53:48.957866 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.957809 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2e3415b9-cef2-439e-a516-f4adc73822c4-secret-thanos-querier-tls\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:48.957866 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.957851 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-node-exporter-wtmp\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:48.958123 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.957886 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.958123 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.957923 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e7658661-8ddc-4443-91d0-edeaab291256-registration-dir\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:53:48.958123 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.957932 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-host-run-multus-certs\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.958123 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.957936 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e761db17-b05a-4f51-8fb9-c2126ee35fe1-config-volume\") pod \"dns-default-ntgwx\" (UID: \"e761db17-b05a-4f51-8fb9-c2126ee35fe1\") " pod="openshift-dns/dns-default-ntgwx" Nov 02 21:53:48.958123 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.957956 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-trusted-ca-bundle\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:48.958123 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.957992 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wfn9\" (UniqueName: \"kubernetes.io/projected/e2494f67-c3dd-4cc1-9035-da81cb1c6308-kube-api-access-4wfn9\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:48.958123 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.957885 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-systemd-units\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.958123 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.958114 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-config-out\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:48.958469 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.958149 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-web-config\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:48.958469 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.958183 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/cb3cdef3-ff8c-4e53-8852-81d064f58c21-secret-metrics-server-client-certs\") pod \"metrics-server-76cf56f7bc-r5j6d\" (UID: \"cb3cdef3-ff8c-4e53-8852-81d064f58c21\") " pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:53:48.958469 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.958226 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15a806bb-6e90-479d-8f94-d9915b47cbde-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5mtfp\" (UID: \"15a806bb-6e90-479d-8f94-d9915b47cbde\") " pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:53:48.958469 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.958258 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr7j5\" (UniqueName: \"kubernetes.io/projected/646bc644-a377-48b5-bd3b-1562b53e93eb-kube-api-access-rr7j5\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.958469 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.958290 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/943a1337-2968-4104-aa18-90f3cd407ea0-tmp\") pod \"console-7d6f59494d-bzp74\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:48.958821 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.958507 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-run-ovn\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.958821 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.958782 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.958900 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.958829 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/646bc644-a377-48b5-bd3b-1562b53e93eb-config-out\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.958949 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.958920 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/943a1337-2968-4104-aa18-90f3cd407ea0-tmp\") pod \"console-7d6f59494d-bzp74\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:48.958997 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.958974 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e73c1ca-fa5d-4485-a439-a6f8eb19a731-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-jffwq\" (UID: \"4e73c1ca-fa5d-4485-a439-a6f8eb19a731\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-jffwq" Nov 02 21:53:48.959146 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.958986 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-trusted-ca-bundle\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:48.959146 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.959011 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:48.959146 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.959026 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.959146 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.959069 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd77571d-49e8-4127-951a-f8a4412d8e43-agent-certs\") pod \"konnectivity-agent-km4nc\" (UID: \"fd77571d-49e8-4127-951a-f8a4412d8e43\") " pod="kube-system/konnectivity-agent-km4nc" Nov 02 21:53:48.959146 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.959118 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.959430 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.959184 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-kubelet\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.959430 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.959236 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-kubelet\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.959430 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.959273 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-cnibin\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.959430 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.959269 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-web-config\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:48.959430 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.959273 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e73c1ca-fa5d-4485-a439-a6f8eb19a731-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-jffwq\" (UID: \"4e73c1ca-fa5d-4485-a439-a6f8eb19a731\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-jffwq" Nov 02 21:53:48.959430 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.959350 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnhnw\" (UniqueName: \"kubernetes.io/projected/983b05f9-8574-4a23-b3de-951a68c553a1-kube-api-access-wnhnw\") pod \"node-resolver-ck8br\" (UID: \"983b05f9-8574-4a23-b3de-951a68c553a1\") " pod="openshift-dns/node-resolver-ck8br" Nov 02 21:53:48.959722 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.959428 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-config-out\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:48.959722 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.959481 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2e3415b9-cef2-439e-a516-f4adc73822c4-secret-grpc-tls\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:48.959722 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.959547 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:48.959722 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.959612 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:48.959722 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.959631 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-cnibin\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.959722 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.959692 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15a806bb-6e90-479d-8f94-d9915b47cbde-cnibin\") pod \"multus-additional-cni-plugins-5mtfp\" (UID: \"15a806bb-6e90-479d-8f94-d9915b47cbde\") " pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:53:48.959999 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.959781 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/15a806bb-6e90-479d-8f94-d9915b47cbde-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5mtfp\" (UID: \"15a806bb-6e90-479d-8f94-d9915b47cbde\") " pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:53:48.959999 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.959807 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/cb3cdef3-ff8c-4e53-8852-81d064f58c21-secret-metrics-server-client-certs\") pod \"metrics-server-76cf56f7bc-r5j6d\" (UID: \"cb3cdef3-ff8c-4e53-8852-81d064f58c21\") " pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:53:48.959999 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.959827 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-kubernetes\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:53:48.959999 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.959864 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-systemd\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:53:48.959999 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.959887 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd77571d-49e8-4127-951a-f8a4412d8e43-agent-certs\") pod \"konnectivity-agent-km4nc\" (UID: \"fd77571d-49e8-4127-951a-f8a4412d8e43\") " pod="kube-system/konnectivity-agent-km4nc" Nov 02 21:53:48.959999 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.959898 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-multus-conf-dir\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.959999 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.959956 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-systemd\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:53:48.959999 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.959988 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/646bc644-a377-48b5-bd3b-1562b53e93eb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.960342 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.960054 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-multus-conf-dir\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.960342 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.960080 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:48.960342 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.960088 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2e3415b9-cef2-439e-a516-f4adc73822c4-secret-grpc-tls\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:48.960342 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.960112 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-kubernetes\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:53:48.960342 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.960136 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvh9s\" (UniqueName: \"kubernetes.io/projected/76322934-bb51-4c0e-a7df-37f506b6cfc4-kube-api-access-lvh9s\") pod \"ingress-canary-m95sf\" (UID: \"76322934-bb51-4c0e-a7df-37f506b6cfc4\") " pod="openshift-ingress-canary/ingress-canary-m95sf" Nov 02 21:53:48.960342 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.960186 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8kx7\" (UniqueName: \"kubernetes.io/projected/15a806bb-6e90-479d-8f94-d9915b47cbde-kube-api-access-t8kx7\") pod \"multus-additional-cni-plugins-5mtfp\" (UID: \"15a806bb-6e90-479d-8f94-d9915b47cbde\") " pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:53:48.960342 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.960188 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/15a806bb-6e90-479d-8f94-d9915b47cbde-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5mtfp\" (UID: \"15a806bb-6e90-479d-8f94-d9915b47cbde\") " pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:53:48.960342 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.960240 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/646bc644-a377-48b5-bd3b-1562b53e93eb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.960342 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.960265 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e2026273-f131-45c2-a443-c66a07d518ae-crio-socket\") pod \"insights-runtime-extractor-nltff\" (UID: \"e2026273-f131-45c2-a443-c66a07d518ae\") " pod="openshift-insights/insights-runtime-extractor-nltff" Nov 02 21:53:48.960342 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.960310 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.960779 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.960347 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.960779 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.960379 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9hbn\" (UniqueName: \"kubernetes.io/projected/4e73c1ca-fa5d-4485-a439-a6f8eb19a731-kube-api-access-r9hbn\") pod \"openshift-state-metrics-7bd7489957-jffwq\" (UID: \"4e73c1ca-fa5d-4485-a439-a6f8eb19a731\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-jffwq" Nov 02 21:53:48.960779 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.960415 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-config-volume\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:48.960779 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.960450 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df98z\" (UniqueName: \"kubernetes.io/projected/e2026273-f131-45c2-a443-c66a07d518ae-kube-api-access-df98z\") pod \"insights-runtime-extractor-nltff\" (UID: \"e2026273-f131-45c2-a443-c66a07d518ae\") " pod="openshift-insights/insights-runtime-extractor-nltff" Nov 02 21:53:48.960779 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.960489 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mt8ph\" (UniqueName: \"kubernetes.io/projected/15d3a384-31d9-4152-9e38-491942e6d5c5-kube-api-access-mt8ph\") pod \"prometheus-operator-9cd89b74c-ltszg\" (UID: \"15d3a384-31d9-4152-9e38-491942e6d5c5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-ltszg" Nov 02 21:53:48.960779 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.960492 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.960779 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.960632 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-system-cni-dir\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.960779 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.960599 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-system-cni-dir\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.960779 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.960724 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2e3415b9-cef2-439e-a516-f4adc73822c4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:48.961201 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.960787 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/943a1337-2968-4104-aa18-90f3cd407ea0-oauth-serving-cert\") pod \"console-7d6f59494d-bzp74\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:48.961201 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.960812 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-config-volume\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:48.961201 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.960835 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-run-openvswitch\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.961201 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.960875 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.961201 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.960946 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-run-openvswitch\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.961201 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.960975 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/52ac610d-a729-4e9f-b70b-700d30dbf64a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-w8nqg\" (UID: \"52ac610d-a729-4e9f-b70b-700d30dbf64a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg" Nov 02 21:53:48.961201 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.961014 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb3cdef3-ff8c-4e53-8852-81d064f58c21-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-76cf56f7bc-r5j6d\" (UID: \"cb3cdef3-ff8c-4e53-8852-81d064f58c21\") " pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:53:48.961201 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.961075 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2e3415b9-cef2-439e-a516-f4adc73822c4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:48.961201 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.961092 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15a806bb-6e90-479d-8f94-d9915b47cbde-cni-binary-copy\") pod \"multus-additional-cni-plugins-5mtfp\" (UID: \"15a806bb-6e90-479d-8f94-d9915b47cbde\") " pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:53:48.961201 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.961158 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.961201 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.961185 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/943a1337-2968-4104-aa18-90f3cd407ea0-oauth-serving-cert\") pod \"console-7d6f59494d-bzp74\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:48.961735 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.961244 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.961735 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.961312 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52ac610d-a729-4e9f-b70b-700d30dbf64a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-w8nqg\" (UID: \"52ac610d-a729-4e9f-b70b-700d30dbf64a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg" Nov 02 21:53:48.961735 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.961344 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb3cdef3-ff8c-4e53-8852-81d064f58c21-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-76cf56f7bc-r5j6d\" (UID: \"cb3cdef3-ff8c-4e53-8852-81d064f58c21\") " pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:53:48.961735 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.961355 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15a806bb-6e90-479d-8f94-d9915b47cbde-cni-binary-copy\") pod \"multus-additional-cni-plugins-5mtfp\" (UID: \"15a806bb-6e90-479d-8f94-d9915b47cbde\") " pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:53:48.961735 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.961361 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/52ac610d-a729-4e9f-b70b-700d30dbf64a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-w8nqg\" (UID: \"52ac610d-a729-4e9f-b70b-700d30dbf64a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg" Nov 02 21:53:48.961735 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.961409 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.961735 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.961408 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e73c1ca-fa5d-4485-a439-a6f8eb19a731-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-jffwq\" (UID: \"4e73c1ca-fa5d-4485-a439-a6f8eb19a731\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-jffwq" Nov 02 21:53:48.961735 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.961461 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/cb3cdef3-ff8c-4e53-8852-81d064f58c21-secret-metrics-server-tls\") pod \"metrics-server-76cf56f7bc-r5j6d\" (UID: \"cb3cdef3-ff8c-4e53-8852-81d064f58c21\") " pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:53:48.961735 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.961496 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/cb3cdef3-ff8c-4e53-8852-81d064f58c21-metrics-server-audit-profiles\") pod \"metrics-server-76cf56f7bc-r5j6d\" (UID: \"cb3cdef3-ff8c-4e53-8852-81d064f58c21\") " pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:53:48.961735 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.961529 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e761db17-b05a-4f51-8fb9-c2126ee35fe1-metrics-tls\") pod \"dns-default-ntgwx\" (UID: \"e761db17-b05a-4f51-8fb9-c2126ee35fe1\") " pod="openshift-dns/dns-default-ntgwx" Nov 02 21:53:48.961735 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.961488 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.961735 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.961592 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52ac610d-a729-4e9f-b70b-700d30dbf64a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-w8nqg\" (UID: \"52ac610d-a729-4e9f-b70b-700d30dbf64a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg" Nov 02 21:53:48.961735 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.961627 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e73c1ca-fa5d-4485-a439-a6f8eb19a731-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-jffwq\" (UID: \"4e73c1ca-fa5d-4485-a439-a6f8eb19a731\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-jffwq" Nov 02 21:53:48.961735 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.961645 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-modprobe-d\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:53:48.961735 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.961696 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-node-log\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.961735 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.961728 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/52ac610d-a729-4e9f-b70b-700d30dbf64a-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-w8nqg\" (UID: \"52ac610d-a729-4e9f-b70b-700d30dbf64a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg" Nov 02 21:53:48.962358 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.961746 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/cb3cdef3-ff8c-4e53-8852-81d064f58c21-secret-metrics-server-tls\") pod \"metrics-server-76cf56f7bc-r5j6d\" (UID: \"cb3cdef3-ff8c-4e53-8852-81d064f58c21\") " pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:53:48.962358 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.961759 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-node-exporter-accelerators-collector-config\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:48.962358 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.961808 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-modprobe-d\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:53:48.962358 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.961806 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e761db17-b05a-4f51-8fb9-c2126ee35fe1-metrics-tls\") pod \"dns-default-ntgwx\" (UID: \"e761db17-b05a-4f51-8fb9-c2126ee35fe1\") " pod="openshift-dns/dns-default-ntgwx" Nov 02 21:53:48.962358 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.961815 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:48.962358 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.961816 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-node-log\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.962358 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.961873 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/649dd5b0-1649-4f63-a148-40fd3f3e07f4-kubelet-config\") pod \"global-pull-secret-syncer-vcx54\" (UID: \"649dd5b0-1649-4f63-a148-40fd3f3e07f4\") " pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:53:48.962358 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.961912 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/cb3cdef3-ff8c-4e53-8852-81d064f58c21-metrics-server-audit-profiles\") pod \"metrics-server-76cf56f7bc-r5j6d\" (UID: \"cb3cdef3-ff8c-4e53-8852-81d064f58c21\") " pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:53:48.962358 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.962031 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:48.962358 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.962039 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/52ac610d-a729-4e9f-b70b-700d30dbf64a-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-w8nqg\" (UID: \"52ac610d-a729-4e9f-b70b-700d30dbf64a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg" Nov 02 21:53:48.962358 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.962040 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-sysconfig\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:53:48.962358 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.962102 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/41a3e68b-3746-48ca-89c7-99347353fb8b-host-slash\") pod \"iptables-alerter-kwr6l\" (UID: \"41a3e68b-3746-48ca-89c7-99347353fb8b\") " pod="openshift-network-operator/iptables-alerter-kwr6l" Nov 02 21:53:48.962358 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.962106 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-sysconfig\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:53:48.962358 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.962124 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/52ac610d-a729-4e9f-b70b-700d30dbf64a-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-w8nqg\" (UID: \"52ac610d-a729-4e9f-b70b-700d30dbf64a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg" Nov 02 21:53:48.962358 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.962129 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/41a3e68b-3746-48ca-89c7-99347353fb8b-host-slash\") pod \"iptables-alerter-kwr6l\" (UID: \"41a3e68b-3746-48ca-89c7-99347353fb8b\") " pod="openshift-network-operator/iptables-alerter-kwr6l" Nov 02 21:53:48.962990 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.962512 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2494f67-c3dd-4cc1-9035-da81cb1c6308-tmp\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:48.962990 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.962536 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gsxn\" (UniqueName: \"kubernetes.io/projected/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-kube-api-access-4gsxn\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:48.962990 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.962553 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e761db17-b05a-4f51-8fb9-c2126ee35fe1-tmp-dir\") pod \"dns-default-ntgwx\" (UID: \"e761db17-b05a-4f51-8fb9-c2126ee35fe1\") " pod="openshift-dns/dns-default-ntgwx" Nov 02 21:53:48.962990 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.962552 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/52ac610d-a729-4e9f-b70b-700d30dbf64a-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-w8nqg\" (UID: \"52ac610d-a729-4e9f-b70b-700d30dbf64a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg" Nov 02 21:53:48.962990 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.962618 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2494f67-c3dd-4cc1-9035-da81cb1c6308-tmp\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:48.962990 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.962622 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-node-exporter-accelerators-collector-config\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:48.962990 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.962634 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e761db17-b05a-4f51-8fb9-c2126ee35fe1-tmp-dir\") pod \"dns-default-ntgwx\" (UID: \"e761db17-b05a-4f51-8fb9-c2126ee35fe1\") " pod="openshift-dns/dns-default-ntgwx" Nov 02 21:53:48.962990 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.962687 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-run-ovn-kubernetes\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.962990 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.962715 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-cni-bin\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.962990 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.962738 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-config\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.962990 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.962735 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-run-ovn-kubernetes\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.962990 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.962763 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c0fdd204-e1ad-4de8-ab18-52ab672cc3a4-host\") pod \"node-ca-bjwd8\" (UID: \"c0fdd204-e1ad-4de8-ab18-52ab672cc3a4\") " pod="openshift-image-registry/node-ca-bjwd8" Nov 02 21:53:48.962990 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.962770 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-cni-bin\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.962990 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.962787 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd77571d-49e8-4127-951a-f8a4412d8e43-konnectivity-ca\") pod \"konnectivity-agent-km4nc\" (UID: \"fd77571d-49e8-4127-951a-f8a4412d8e43\") " pod="kube-system/konnectivity-agent-km4nc" Nov 02 21:53:48.962990 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.962824 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-multus-cni-dir\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.962990 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.962867 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e7658661-8ddc-4443-91d0-edeaab291256-etc-selinux\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:53:48.962990 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.962879 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-multus-cni-dir\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.962990 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.962899 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99wqw\" (UniqueName: \"kubernetes.io/projected/e761db17-b05a-4f51-8fb9-c2126ee35fe1-kube-api-access-99wqw\") pod \"dns-default-ntgwx\" (UID: \"e761db17-b05a-4f51-8fb9-c2126ee35fe1\") " pod="openshift-dns/dns-default-ntgwx" Nov 02 21:53:48.962990 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.962929 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-run\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:53:48.962990 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.962955 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-etc-kubernetes\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.962990 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.962979 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-run\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:53:48.962990 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.962984 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76322934-bb51-4c0e-a7df-37f506b6cfc4-cert\") pod \"ingress-canary-m95sf\" (UID: \"76322934-bb51-4c0e-a7df-37f506b6cfc4\") " pod="openshift-ingress-canary/ingress-canary-m95sf" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963007 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd77571d-49e8-4127-951a-f8a4412d8e43-konnectivity-ca\") pod \"konnectivity-agent-km4nc\" (UID: \"fd77571d-49e8-4127-951a-f8a4412d8e43\") " pod="kube-system/konnectivity-agent-km4nc" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963020 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-root\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963049 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/15a806bb-6e90-479d-8f94-d9915b47cbde-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5mtfp\" (UID: \"15a806bb-6e90-479d-8f94-d9915b47cbde\") " pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963053 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-etc-kubernetes\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963076 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2026273-f131-45c2-a443-c66a07d518ae-data-volume\") pod \"insights-runtime-extractor-nltff\" (UID: \"e2026273-f131-45c2-a443-c66a07d518ae\") " pod="openshift-insights/insights-runtime-extractor-nltff" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963103 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-host-run-k8s-cni-cncf-io\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963127 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963152 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-oauth-serving-cert\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963179 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/cb3cdef3-ff8c-4e53-8852-81d064f58c21-audit-log\") pod \"metrics-server-76cf56f7bc-r5j6d\" (UID: \"cb3cdef3-ff8c-4e53-8852-81d064f58c21\") " pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963186 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-host-run-k8s-cni-cncf-io\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963201 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76322934-bb51-4c0e-a7df-37f506b6cfc4-cert\") pod \"ingress-canary-m95sf\" (UID: \"76322934-bb51-4c0e-a7df-37f506b6cfc4\") " pod="openshift-ingress-canary/ingress-canary-m95sf" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963206 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7ccd\" (UniqueName: \"kubernetes.io/projected/c0fdd204-e1ad-4de8-ab18-52ab672cc3a4-kube-api-access-n7ccd\") pod \"node-ca-bjwd8\" (UID: \"c0fdd204-e1ad-4de8-ab18-52ab672cc3a4\") " pod="openshift-image-registry/node-ca-bjwd8" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963233 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/15a806bb-6e90-479d-8f94-d9915b47cbde-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5mtfp\" (UID: \"15a806bb-6e90-479d-8f94-d9915b47cbde\") " pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963246 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-hostroot\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963263 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2026273-f131-45c2-a443-c66a07d518ae-data-volume\") pod \"insights-runtime-extractor-nltff\" (UID: \"e2026273-f131-45c2-a443-c66a07d518ae\") " pod="openshift-insights/insights-runtime-extractor-nltff" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963273 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963309 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-config\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963341 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/cb3cdef3-ff8c-4e53-8852-81d064f58c21-audit-log\") pod \"metrics-server-76cf56f7bc-r5j6d\" (UID: \"cb3cdef3-ff8c-4e53-8852-81d064f58c21\") " pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963310 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2e3415b9-cef2-439e-a516-f4adc73822c4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963390 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-hostroot\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963390 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2e3415b9-cef2-439e-a516-f4adc73822c4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963419 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963482 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2e3415b9-cef2-439e-a516-f4adc73822c4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963515 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e3415b9-cef2-439e-a516-f4adc73822c4-metrics-client-ca\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963531 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-sys\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963547 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-run-netns\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963548 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2e3415b9-cef2-439e-a516-f4adc73822c4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963560 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e3415b9-cef2-439e-a516-f4adc73822c4-tmp\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963576 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-metrics-client-ca\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963593 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963594 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963608 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e7658661-8ddc-4443-91d0-edeaab291256-sys-fs\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963596 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-oauth-serving-cert\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963631 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e3415b9-cef2-439e-a516-f4adc73822c4-tmp\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963644 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-console-config\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963655 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-sys\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963717 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963751 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e3415b9-cef2-439e-a516-f4adc73822c4-metrics-client-ca\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963789 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/649dd5b0-1649-4f63-a148-40fd3f3e07f4-dbus\") pod \"global-pull-secret-syncer-vcx54\" (UID: \"649dd5b0-1649-4f63-a148-40fd3f3e07f4\") " pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963825 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-etc-openvswitch\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963823 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963846 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-metrics-client-ca\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963851 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-run-netns\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963867 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963869 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-etc-openvswitch\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.963973 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.964014 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb3cdef3-ff8c-4e53-8852-81d064f58c21-client-ca-bundle\") pod \"metrics-server-76cf56f7bc-r5j6d\" (UID: \"cb3cdef3-ff8c-4e53-8852-81d064f58c21\") " pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.964044 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15a806bb-6e90-479d-8f94-d9915b47cbde-system-cni-dir\") pod \"multus-additional-cni-plugins-5mtfp\" (UID: \"15a806bb-6e90-479d-8f94-d9915b47cbde\") " pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:53:48.964005 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.964045 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.964089 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15d3a384-31d9-4152-9e38-491942e6d5c5-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-ltszg\" (UID: \"15d3a384-31d9-4152-9e38-491942e6d5c5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-ltszg" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.964143 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.964202 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-sys\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.964234 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.964611 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d9ln\" (UniqueName: \"kubernetes.io/projected/943a1337-2968-4104-aa18-90f3cd407ea0-kube-api-access-4d9ln\") pod \"console-7d6f59494d-bzp74\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.964641 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2026273-f131-45c2-a443-c66a07d518ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nltff\" (UID: \"e2026273-f131-45c2-a443-c66a07d518ae\") " pod="openshift-insights/insights-runtime-extractor-nltff" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.964681 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-sysctl-conf\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.964706 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-var-lib-kubelet\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.964726 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-host\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.964747 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-cni-netd\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.964773 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-multus-socket-dir-parent\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.964796 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2494f67-c3dd-4cc1-9035-da81cb1c6308-console-oauth-config\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.964820 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/943a1337-2968-4104-aa18-90f3cd407ea0-console-oauth-config\") pod \"console-7d6f59494d-bzp74\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.964844 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-run-systemd\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.964867 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.964894 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/983b05f9-8574-4a23-b3de-951a68c553a1-tmp-dir\") pod \"node-resolver-ck8br\" (UID: \"983b05f9-8574-4a23-b3de-951a68c553a1\") " pod="openshift-dns/node-resolver-ck8br" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.964910 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.964925 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.964941 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2026273-f131-45c2-a443-c66a07d518ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nltff\" (UID: \"e2026273-f131-45c2-a443-c66a07d518ae\") " pod="openshift-insights/insights-runtime-extractor-nltff" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.964966 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.964984 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-service-ca\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.965001 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/943a1337-2968-4104-aa18-90f3cd407ea0-console-config\") pod \"console-7d6f59494d-bzp74\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.965016 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c0fdd204-e1ad-4de8-ab18-52ab672cc3a4-serviceca\") pod \"node-ca-bjwd8\" (UID: \"c0fdd204-e1ad-4de8-ab18-52ab672cc3a4\") " pod="openshift-image-registry/node-ca-bjwd8" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.965033 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-sysctl-d\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.965047 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-host-var-lib-kubelet\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.965064 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-web-config\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.965080 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.965095 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/649dd5b0-1649-4f63-a148-40fd3f3e07f4-original-pull-secret\") pod \"global-pull-secret-syncer-vcx54\" (UID: \"649dd5b0-1649-4f63-a148-40fd3f3e07f4\") " pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.965110 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-host-var-lib-cni-multus\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.965125 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.965140 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/983b05f9-8574-4a23-b3de-951a68c553a1-hosts-file\") pod \"node-resolver-ck8br\" (UID: \"983b05f9-8574-4a23-b3de-951a68c553a1\") " pod="openshift-dns/node-resolver-ck8br" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.965156 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2494f67-c3dd-4cc1-9035-da81cb1c6308-console-serving-cert\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.965172 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/943a1337-2968-4104-aa18-90f3cd407ea0-console-serving-cert\") pod \"console-7d6f59494d-bzp74\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.965187 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mnfp\" (UniqueName: \"kubernetes.io/projected/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-kube-api-access-4mnfp\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.965209 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-host-var-lib-cni-bin\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.965227 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e7658661-8ddc-4443-91d0-edeaab291256-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.965250 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e7658661-8ddc-4443-91d0-edeaab291256-socket-dir\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.965268 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqb44\" (UniqueName: \"kubernetes.io/projected/52ac610d-a729-4e9f-b70b-700d30dbf64a-kube-api-access-dqb44\") pod \"kube-state-metrics-5dc8d7d89b-w8nqg\" (UID: \"52ac610d-a729-4e9f-b70b-700d30dbf64a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.965344 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2e3415b9-cef2-439e-a516-f4adc73822c4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.965556 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2e3415b9-cef2-439e-a516-f4adc73822c4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.964260 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb3cdef3-ff8c-4e53-8852-81d064f58c21-client-ca-bundle\") pod \"metrics-server-76cf56f7bc-r5j6d\" (UID: \"cb3cdef3-ff8c-4e53-8852-81d064f58c21\") " pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.964318 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-console-config\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.965938 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2026273-f131-45c2-a443-c66a07d518ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nltff\" (UID: \"e2026273-f131-45c2-a443-c66a07d518ae\") " pod="openshift-insights/insights-runtime-extractor-nltff" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.964400 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.966066 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-sysctl-conf\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.964474 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.966104 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-var-lib-kubelet\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.964482 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15d3a384-31d9-4152-9e38-491942e6d5c5-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-ltszg\" (UID: \"15d3a384-31d9-4152-9e38-491942e6d5c5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-ltszg" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.966171 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-host\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.966203 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-host-cni-netd\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.966245 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.966235 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-multus-socket-dir-parent\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.968716 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.966365 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2494f67-c3dd-4cc1-9035-da81cb1c6308-console-oauth-config\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:48.968716 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.966479 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/943a1337-2968-4104-aa18-90f3cd407ea0-console-oauth-config\") pod \"console-7d6f59494d-bzp74\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:48.968716 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.966512 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e011b0d4-3387-4b79-9a3f-b3fac185c126-run-systemd\") pod \"ovnkube-node-g996m\" (UID: \"e011b0d4-3387-4b79-9a3f-b3fac185c126\") " pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:48.968716 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.966799 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.968716 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.966872 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/983b05f9-8574-4a23-b3de-951a68c553a1-tmp-dir\") pod \"node-resolver-ck8br\" (UID: \"983b05f9-8574-4a23-b3de-951a68c553a1\") " pod="openshift-dns/node-resolver-ck8br" Nov 02 21:53:48.968716 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.967047 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:48.968716 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.967184 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:48.968716 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.967375 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2026273-f131-45c2-a443-c66a07d518ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nltff\" (UID: \"e2026273-f131-45c2-a443-c66a07d518ae\") " pod="openshift-insights/insights-runtime-extractor-nltff" Nov 02 21:53:48.968716 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.967510 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.968716 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.967658 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-service-ca\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:48.968716 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.967748 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-host-var-lib-kubelet\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.968716 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.967898 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2494f67-c3dd-4cc1-9035-da81cb1c6308-console-serving-cert\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:48.968716 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.968099 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/943a1337-2968-4104-aa18-90f3cd407ea0-console-serving-cert\") pod \"console-7d6f59494d-bzp74\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:48.968716 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.968344 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-host-var-lib-cni-bin\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.968716 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.968459 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/943a1337-2968-4104-aa18-90f3cd407ea0-console-config\") pod \"console-7d6f59494d-bzp74\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:48.968716 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.968712 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2e2913f2-f166-4ce6-b93b-cea606008bba-etc-sysctl-d\") pod \"tuned-ff4h2\" (UID: \"2e2913f2-f166-4ce6-b93b-cea606008bba\") " pod="openshift-cluster-node-tuning-operator/tuned-ff4h2" Nov 02 21:53:48.970119 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.968892 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34-host-var-lib-cni-multus\") pod \"multus-kbrwm\" (UID: \"9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34\") " pod="openshift-multus/multus-kbrwm" Nov 02 21:53:48.970119 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.968958 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.970119 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.969041 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c0fdd204-e1ad-4de8-ab18-52ab672cc3a4-serviceca\") pod \"node-ca-bjwd8\" (UID: \"c0fdd204-e1ad-4de8-ab18-52ab672cc3a4\") " pod="openshift-image-registry/node-ca-bjwd8" Nov 02 21:53:48.970119 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.969058 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-web-config\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.970119 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.969117 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/649dd5b0-1649-4f63-a148-40fd3f3e07f4-original-pull-secret\") pod \"global-pull-secret-syncer-vcx54\" (UID: \"649dd5b0-1649-4f63-a148-40fd3f3e07f4\") " pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:53:48.971397 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.971372 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c47fh\" (UniqueName: \"kubernetes.io/projected/cb3cdef3-ff8c-4e53-8852-81d064f58c21-kube-api-access-c47fh\") pod \"metrics-server-76cf56f7bc-r5j6d\" (UID: \"cb3cdef3-ff8c-4e53-8852-81d064f58c21\") " pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:53:48.971606 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.971589 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9d5c\" (UniqueName: \"kubernetes.io/projected/e7658661-8ddc-4443-91d0-edeaab291256-kube-api-access-p9d5c\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:53:48.972025 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.972004 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.973354 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.973028 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt8ph\" (UniqueName: \"kubernetes.io/projected/15d3a384-31d9-4152-9e38-491942e6d5c5-kube-api-access-mt8ph\") pod \"prometheus-operator-9cd89b74c-ltszg\" (UID: \"15d3a384-31d9-4152-9e38-491942e6d5c5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-ltszg" Nov 02 21:53:48.973354 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.973068 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-df98z\" (UniqueName: \"kubernetes.io/projected/e2026273-f131-45c2-a443-c66a07d518ae-kube-api-access-df98z\") pod \"insights-runtime-extractor-nltff\" (UID: \"e2026273-f131-45c2-a443-c66a07d518ae\") " pod="openshift-insights/insights-runtime-extractor-nltff" Nov 02 21:53:48.973354 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.973286 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99wqw\" (UniqueName: \"kubernetes.io/projected/e761db17-b05a-4f51-8fb9-c2126ee35fe1-kube-api-access-99wqw\") pod \"dns-default-ntgwx\" (UID: \"e761db17-b05a-4f51-8fb9-c2126ee35fe1\") " pod="openshift-dns/dns-default-ntgwx" Nov 02 21:53:48.973354 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.973312 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvh9s\" (UniqueName: \"kubernetes.io/projected/76322934-bb51-4c0e-a7df-37f506b6cfc4-kube-api-access-lvh9s\") pod \"ingress-canary-m95sf\" (UID: \"76322934-bb51-4c0e-a7df-37f506b6cfc4\") " pod="openshift-ingress-canary/ingress-canary-m95sf" Nov 02 21:53:48.973594 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.973481 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wfn9\" (UniqueName: \"kubernetes.io/projected/e2494f67-c3dd-4cc1-9035-da81cb1c6308-kube-api-access-4wfn9\") pod \"console-6bfc5dd8c9-24hxz\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:48.973594 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.973534 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9hbn\" (UniqueName: \"kubernetes.io/projected/4e73c1ca-fa5d-4485-a439-a6f8eb19a731-kube-api-access-r9hbn\") pod \"openshift-state-metrics-7bd7489957-jffwq\" (UID: \"4e73c1ca-fa5d-4485-a439-a6f8eb19a731\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-jffwq" Nov 02 21:53:48.973594 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.973579 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9bb7\" (UniqueName: \"kubernetes.io/projected/2e3415b9-cef2-439e-a516-f4adc73822c4-kube-api-access-j9bb7\") pod \"thanos-querier-74977cc9f9-qzn9x\" (UID: \"2e3415b9-cef2-439e-a516-f4adc73822c4\") " pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:48.973756 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.973648 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr7j5\" (UniqueName: \"kubernetes.io/projected/646bc644-a377-48b5-bd3b-1562b53e93eb-kube-api-access-rr7j5\") pod \"prometheus-k8s-0\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:48.974168 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.974151 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8kx7\" (UniqueName: \"kubernetes.io/projected/15a806bb-6e90-479d-8f94-d9915b47cbde-kube-api-access-t8kx7\") pod \"multus-additional-cni-plugins-5mtfp\" (UID: \"15a806bb-6e90-479d-8f94-d9915b47cbde\") " pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:53:48.974372 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.974357 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnhnw\" (UniqueName: \"kubernetes.io/projected/983b05f9-8574-4a23-b3de-951a68c553a1-kube-api-access-wnhnw\") pod \"node-resolver-ck8br\" (UID: \"983b05f9-8574-4a23-b3de-951a68c553a1\") " pod="openshift-dns/node-resolver-ck8br" Nov 02 21:53:48.983806 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.983770 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gsxn\" (UniqueName: \"kubernetes.io/projected/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-kube-api-access-4gsxn\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:48.983806 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.983794 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7ccd\" (UniqueName: \"kubernetes.io/projected/c0fdd204-e1ad-4de8-ab18-52ab672cc3a4-kube-api-access-n7ccd\") pod \"node-ca-bjwd8\" (UID: \"c0fdd204-e1ad-4de8-ab18-52ab672cc3a4\") " pod="openshift-image-registry/node-ca-bjwd8" Nov 02 21:53:48.985980 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.985957 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d9ln\" (UniqueName: \"kubernetes.io/projected/943a1337-2968-4104-aa18-90f3cd407ea0-kube-api-access-4d9ln\") pod \"console-7d6f59494d-bzp74\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:53:48.986095 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.986020 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mnfp\" (UniqueName: \"kubernetes.io/projected/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-kube-api-access-4mnfp\") pod \"alertmanager-main-0\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:53:48.986197 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:48.986175 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqb44\" (UniqueName: \"kubernetes.io/projected/52ac610d-a729-4e9f-b70b-700d30dbf64a-kube-api-access-dqb44\") pod \"kube-state-metrics-5dc8d7d89b-w8nqg\" (UID: \"52ac610d-a729-4e9f-b70b-700d30dbf64a\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-w8nqg" Nov 02 21:53:49.065812 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:49.065735 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e7658661-8ddc-4443-91d0-edeaab291256-etc-selinux\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:53:49.065812 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:49.065772 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-root\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:49.065812 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:49.065805 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e7658661-8ddc-4443-91d0-edeaab291256-sys-fs\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:53:49.066097 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:49.065839 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/649dd5b0-1649-4f63-a148-40fd3f3e07f4-dbus\") pod \"global-pull-secret-syncer-vcx54\" (UID: \"649dd5b0-1649-4f63-a148-40fd3f3e07f4\") " pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:53:49.066097 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:49.065863 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e7658661-8ddc-4443-91d0-edeaab291256-etc-selinux\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:53:49.066097 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:49.065865 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-root\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:49.066097 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:49.065870 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15a806bb-6e90-479d-8f94-d9915b47cbde-system-cni-dir\") pod \"multus-additional-cni-plugins-5mtfp\" (UID: \"15a806bb-6e90-479d-8f94-d9915b47cbde\") " pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:53:49.066097 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:49.065901 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15a806bb-6e90-479d-8f94-d9915b47cbde-system-cni-dir\") pod \"multus-additional-cni-plugins-5mtfp\" (UID: \"15a806bb-6e90-479d-8f94-d9915b47cbde\") " pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:53:49.066097 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:49.065905 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e7658661-8ddc-4443-91d0-edeaab291256-sys-fs\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:53:49.066097 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:49.065930 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-sys\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:49.066097 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:49.065957 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/649dd5b0-1649-4f63-a148-40fd3f3e07f4-dbus\") pod \"global-pull-secret-syncer-vcx54\" (UID: \"649dd5b0-1649-4f63-a148-40fd3f3e07f4\") " pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:53:49.066097 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:49.065967 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/983b05f9-8574-4a23-b3de-951a68c553a1-hosts-file\") pod \"node-resolver-ck8br\" (UID: \"983b05f9-8574-4a23-b3de-951a68c553a1\") " pod="openshift-dns/node-resolver-ck8br" Nov 02 21:53:49.066097 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:49.066003 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/983b05f9-8574-4a23-b3de-951a68c553a1-hosts-file\") pod \"node-resolver-ck8br\" (UID: \"983b05f9-8574-4a23-b3de-951a68c553a1\") " pod="openshift-dns/node-resolver-ck8br" Nov 02 21:53:49.066097 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:49.066007 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e7658661-8ddc-4443-91d0-edeaab291256-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:53:49.066097 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:49.066024 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-sys\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:49.066097 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:49.066028 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e7658661-8ddc-4443-91d0-edeaab291256-socket-dir\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:53:49.066097 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:49.066053 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e7658661-8ddc-4443-91d0-edeaab291256-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:53:49.066097 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:49.066067 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e7658661-8ddc-4443-91d0-edeaab291256-socket-dir\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:53:49.066097 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:49.066089 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e7658661-8ddc-4443-91d0-edeaab291256-device-dir\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:53:49.066602 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:49.066128 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e7658661-8ddc-4443-91d0-edeaab291256-device-dir\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:53:49.066602 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:49.066146 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-node-exporter-wtmp\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:49.066602 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:49.066174 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e71535c3-0a11-43fc-ad7e-4ea18213f0cf-node-exporter-wtmp\") pod \"node-exporter-lzs7z\" (UID: \"e71535c3-0a11-43fc-ad7e-4ea18213f0cf\") " pod="openshift-monitoring/node-exporter-lzs7z" Nov 02 21:53:49.066602 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:49.066193 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e7658661-8ddc-4443-91d0-edeaab291256-registration-dir\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:53:49.066602 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:49.066218 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e7658661-8ddc-4443-91d0-edeaab291256-registration-dir\") pod \"aws-ebs-csi-driver-node-v26bq\" (UID: \"e7658661-8ddc-4443-91d0-edeaab291256\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v26bq" Nov 02 21:53:49.066602 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:49.066220 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15a806bb-6e90-479d-8f94-d9915b47cbde-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5mtfp\" (UID: \"15a806bb-6e90-479d-8f94-d9915b47cbde\") " pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:53:49.066602 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:49.066245 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15a806bb-6e90-479d-8f94-d9915b47cbde-cnibin\") pod \"multus-additional-cni-plugins-5mtfp\" (UID: \"15a806bb-6e90-479d-8f94-d9915b47cbde\") " pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:53:49.066602 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:49.066249 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15a806bb-6e90-479d-8f94-d9915b47cbde-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5mtfp\" (UID: \"15a806bb-6e90-479d-8f94-d9915b47cbde\") " pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:53:49.066602 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:49.066265 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e2026273-f131-45c2-a443-c66a07d518ae-crio-socket\") pod \"insights-runtime-extractor-nltff\" (UID: \"e2026273-f131-45c2-a443-c66a07d518ae\") " pod="openshift-insights/insights-runtime-extractor-nltff" Nov 02 21:53:49.066602 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:49.066276 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15a806bb-6e90-479d-8f94-d9915b47cbde-cnibin\") pod \"multus-additional-cni-plugins-5mtfp\" (UID: \"15a806bb-6e90-479d-8f94-d9915b47cbde\") " pod="openshift-multus/multus-additional-cni-plugins-5mtfp" Nov 02 21:53:49.066602 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:49.066302 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/649dd5b0-1649-4f63-a148-40fd3f3e07f4-kubelet-config\") pod \"global-pull-secret-syncer-vcx54\" (UID: \"649dd5b0-1649-4f63-a148-40fd3f3e07f4\") " pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:53:49.066602 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:49.066305 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e2026273-f131-45c2-a443-c66a07d518ae-crio-socket\") pod \"insights-runtime-extractor-nltff\" (UID: \"e2026273-f131-45c2-a443-c66a07d518ae\") " pod="openshift-insights/insights-runtime-extractor-nltff" Nov 02 21:53:49.066602 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:49.066325 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c0fdd204-e1ad-4de8-ab18-52ab672cc3a4-host\") pod \"node-ca-bjwd8\" (UID: \"c0fdd204-e1ad-4de8-ab18-52ab672cc3a4\") " pod="openshift-image-registry/node-ca-bjwd8" Nov 02 21:53:49.066602 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:49.066352 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/649dd5b0-1649-4f63-a148-40fd3f3e07f4-kubelet-config\") pod \"global-pull-secret-syncer-vcx54\" (UID: \"649dd5b0-1649-4f63-a148-40fd3f3e07f4\") " pod="kube-system/global-pull-secret-syncer-vcx54" Nov 02 21:53:49.066602 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:49.066370 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c0fdd204-e1ad-4de8-ab18-52ab672cc3a4-host\") pod \"node-ca-bjwd8\" (UID: \"c0fdd204-e1ad-4de8-ab18-52ab672cc3a4\") " pod="openshift-image-registry/node-ca-bjwd8" Nov 02 21:53:49.175517 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:49.175485 5963 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-74977cc9f9-qzn9x" Nov 02 21:53:49.813541 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:49.813503 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:49.906420 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:49.906371 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:50.257939 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:50.257855 5963 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:50.276799 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:50.276774 5963 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:53:50.568628 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:50.568594 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:50.668851 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:50.668809 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:51.229063 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:51.229036 5963 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ntgwx" Nov 02 21:53:53.102114 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:53.102087 5963 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:54.479428 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:54.479377 5963 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:53:55.025922 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:55.025886 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:55.133197 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:55.133150 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:56.620464 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:56.620383 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bfc5dd8c9-24hxz"] Nov 02 21:53:57.085633 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:57.085588 5963 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:53:57.119220 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:57.119182 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:57.234050 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:57.234011 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:53:58.716266 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:58.716237 5963 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:53:58.716719 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:58.716497 5963 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 02 21:53:59.109953 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:53:59.109925 5963 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:53:59.123624 ip-10-0-139-99 kubenswrapper[5963]: E1102 21:53:59.123592 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 21:54:01.298168 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:01.298129 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:54:01.397820 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:01.397783 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:54:02.360074 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:02.360040 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 02 21:54:02.360487 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:02.360354 5963 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" containerName="alertmanager" containerID="cri-o://66f253e12c92dd139d56b719ec01a70361e8d1af8d8cdf78cf944290e557bdea" gracePeriod=120 Nov 02 21:54:02.360487 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:02.360426 5963 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" containerName="kube-rbac-proxy-metric" containerID="cri-o://2f7b7a98f49c8a2c7473452f2cd54f3f12c37bdad32330eaeb1b13cfacc99690" gracePeriod=120 Nov 02 21:54:02.360487 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:02.360440 5963 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" containerName="kube-rbac-proxy-web" containerID="cri-o://731aed8ef96af035785601ca05e4e1dd8ce19f381a2e2c518678e94c42a654f9" gracePeriod=120 Nov 02 21:54:02.360654 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:02.360490 5963 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" containerName="config-reloader" containerID="cri-o://e7c1b3941060b58914bbc302790fff4d58fd1b3eb80393d4f472eadb5f78c342" gracePeriod=120 Nov 02 21:54:02.360654 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:02.360520 5963 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" containerName="kube-rbac-proxy" containerID="cri-o://a822c83143587b2aacfbf41c2111f306b0ff11570eec49afcaf6b832a80059a6" gracePeriod=120 Nov 02 21:54:02.360654 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:02.360496 5963 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" containerName="prom-label-proxy" containerID="cri-o://51c4c089d275254e34282547f9d0572366afcfb7b4bbe95f81003865158b1f4d" gracePeriod=120 Nov 02 21:54:02.900950 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:02.900922 5963 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-km4nc" Nov 02 21:54:02.995222 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:02.995188 5963 generic.go:356] "Generic (PLEG): container finished" podID="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" containerID="51c4c089d275254e34282547f9d0572366afcfb7b4bbe95f81003865158b1f4d" exitCode=0 Nov 02 21:54:02.995222 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:02.995213 5963 generic.go:356] "Generic (PLEG): container finished" podID="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" containerID="2f7b7a98f49c8a2c7473452f2cd54f3f12c37bdad32330eaeb1b13cfacc99690" exitCode=0 Nov 02 21:54:02.995222 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:02.995220 5963 generic.go:356] "Generic (PLEG): container finished" podID="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" containerID="a822c83143587b2aacfbf41c2111f306b0ff11570eec49afcaf6b832a80059a6" exitCode=0 Nov 02 21:54:02.995222 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:02.995226 5963 generic.go:356] "Generic (PLEG): container finished" podID="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" containerID="e7c1b3941060b58914bbc302790fff4d58fd1b3eb80393d4f472eadb5f78c342" exitCode=0 Nov 02 21:54:02.995222 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:02.995232 5963 generic.go:356] "Generic (PLEG): container finished" podID="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" containerID="66f253e12c92dd139d56b719ec01a70361e8d1af8d8cdf78cf944290e557bdea" exitCode=0 Nov 02 21:54:02.995513 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:02.995259 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d45953b9-e0fd-49ec-9ec0-aa366fa92c79","Type":"ContainerDied","Data":"51c4c089d275254e34282547f9d0572366afcfb7b4bbe95f81003865158b1f4d"} Nov 02 21:54:02.995513 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:02.995323 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d45953b9-e0fd-49ec-9ec0-aa366fa92c79","Type":"ContainerDied","Data":"2f7b7a98f49c8a2c7473452f2cd54f3f12c37bdad32330eaeb1b13cfacc99690"} Nov 02 21:54:02.995513 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:02.995349 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d45953b9-e0fd-49ec-9ec0-aa366fa92c79","Type":"ContainerDied","Data":"a822c83143587b2aacfbf41c2111f306b0ff11570eec49afcaf6b832a80059a6"} Nov 02 21:54:02.995513 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:02.995373 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d45953b9-e0fd-49ec-9ec0-aa366fa92c79","Type":"ContainerDied","Data":"e7c1b3941060b58914bbc302790fff4d58fd1b3eb80393d4f472eadb5f78c342"} Nov 02 21:54:02.995513 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:02.995395 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d45953b9-e0fd-49ec-9ec0-aa366fa92c79","Type":"ContainerDied","Data":"66f253e12c92dd139d56b719ec01a70361e8d1af8d8cdf78cf944290e557bdea"} Nov 02 21:54:03.644713 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.644691 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:03.799100 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.799017 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-config-out\" (UniqueName: \"kubernetes.io/empty-dir/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-config-out\") pod \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " Nov 02 21:54:03.799100 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.799055 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-tls-assets\" (UniqueName: \"kubernetes.io/projected/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-tls-assets\") pod \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " Nov 02 21:54:03.799100 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.799084 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-main-tls\") pod \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " Nov 02 21:54:03.799396 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.799122 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-kube-rbac-proxy-web\") pod \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " Nov 02 21:54:03.799396 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.799144 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-alertmanager-trusted-ca-bundle\") pod \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " Nov 02 21:54:03.799396 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.799195 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-web-config\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-web-config\") pod \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " Nov 02 21:54:03.799396 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.799230 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-metrics-client-ca\") pod \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " Nov 02 21:54:03.799396 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.799258 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-kube-api-access-4mnfp\" (UniqueName: \"kubernetes.io/projected/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-kube-api-access-4mnfp\") pod \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " Nov 02 21:54:03.799396 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.799293 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-kube-rbac-proxy-metric\") pod \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " Nov 02 21:54:03.799396 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.799382 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-config-volume\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-config-volume\") pod \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " Nov 02 21:54:03.799823 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.799412 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-alertmanager-main-db\") pod \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " Nov 02 21:54:03.799823 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.799451 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-kube-rbac-proxy\") pod \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " Nov 02 21:54:03.799823 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.799493 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-cluster-tls-config\") pod \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\" (UID: \"d45953b9-e0fd-49ec-9ec0-aa366fa92c79\") " Nov 02 21:54:03.799823 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.799613 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-alertmanager-trusted-ca-bundle" pod "d45953b9-e0fd-49ec-9ec0-aa366fa92c79" (UID: "d45953b9-e0fd-49ec-9ec0-aa366fa92c79"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 21:54:03.800200 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.799841 5963 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:03.800731 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.800356 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-metrics-client-ca" pod "d45953b9-e0fd-49ec-9ec0-aa366fa92c79" (UID: "d45953b9-e0fd-49ec-9ec0-aa366fa92c79"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 21:54:03.800731 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.800612 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-alertmanager-main-db" pod "d45953b9-e0fd-49ec-9ec0-aa366fa92c79" (UID: "d45953b9-e0fd-49ec-9ec0-aa366fa92c79"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 21:54:03.802644 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.802598 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-main-tls" pod "d45953b9-e0fd-49ec-9ec0-aa366fa92c79" (UID: "d45953b9-e0fd-49ec-9ec0-aa366fa92c79"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 21:54:03.802990 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.802961 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-kube-rbac-proxy-web" pod "d45953b9-e0fd-49ec-9ec0-aa366fa92c79" (UID: "d45953b9-e0fd-49ec-9ec0-aa366fa92c79"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 21:54:03.803083 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.803014 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-config-out" pod "d45953b9-e0fd-49ec-9ec0-aa366fa92c79" (UID: "d45953b9-e0fd-49ec-9ec0-aa366fa92c79"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 21:54:03.803391 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.803369 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-tls-assets" pod "d45953b9-e0fd-49ec-9ec0-aa366fa92c79" (UID: "d45953b9-e0fd-49ec-9ec0-aa366fa92c79"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 21:54:03.803533 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.803403 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-config-volume" pod "d45953b9-e0fd-49ec-9ec0-aa366fa92c79" (UID: "d45953b9-e0fd-49ec-9ec0-aa366fa92c79"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 21:54:03.803716 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.803693 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-kube-api-access-4mnfp" pod "d45953b9-e0fd-49ec-9ec0-aa366fa92c79" (UID: "d45953b9-e0fd-49ec-9ec0-aa366fa92c79"). InnerVolumeSpecName "kube-api-access-4mnfp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 21:54:03.804321 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.804293 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-kube-rbac-proxy-metric" pod "d45953b9-e0fd-49ec-9ec0-aa366fa92c79" (UID: "d45953b9-e0fd-49ec-9ec0-aa366fa92c79"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 21:54:03.804423 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.804383 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-kube-rbac-proxy" pod "d45953b9-e0fd-49ec-9ec0-aa366fa92c79" (UID: "d45953b9-e0fd-49ec-9ec0-aa366fa92c79"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 21:54:03.807119 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.807093 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-cluster-tls-config" pod "d45953b9-e0fd-49ec-9ec0-aa366fa92c79" (UID: "d45953b9-e0fd-49ec-9ec0-aa366fa92c79"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 21:54:03.815690 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.815604 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-web-config" pod "d45953b9-e0fd-49ec-9ec0-aa366fa92c79" (UID: "d45953b9-e0fd-49ec-9ec0-aa366fa92c79"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 21:54:03.901179 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.901148 5963 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-web-config\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:03.901179 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.901173 5963 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-metrics-client-ca\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:03.901179 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.901184 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mnfp\" (UniqueName: \"kubernetes.io/projected/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-kube-api-access-4mnfp\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:03.901392 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.901196 5963 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:03.901392 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.901206 5963 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-config-volume\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:03.901392 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.901215 5963 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-alertmanager-main-db\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:03.901392 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.901224 5963 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:03.901392 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.901233 5963 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-cluster-tls-config\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:03.901392 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.901241 5963 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-config-out\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:03.901392 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.901249 5963 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-tls-assets\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:03.901392 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.901257 5963 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-main-tls\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:03.901392 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:03.901265 5963 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d45953b9-e0fd-49ec-9ec0-aa366fa92c79-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:04.002685 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.002632 5963 generic.go:356] "Generic (PLEG): container finished" podID="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" containerID="731aed8ef96af035785601ca05e4e1dd8ce19f381a2e2c518678e94c42a654f9" exitCode=0 Nov 02 21:54:04.002847 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.002701 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d45953b9-e0fd-49ec-9ec0-aa366fa92c79","Type":"ContainerDied","Data":"731aed8ef96af035785601ca05e4e1dd8ce19f381a2e2c518678e94c42a654f9"} Nov 02 21:54:04.002847 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.002735 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.002847 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.002782 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d45953b9-e0fd-49ec-9ec0-aa366fa92c79","Type":"ContainerDied","Data":"20dee4bad545e8a356d919537c0f80d5a45ac3647ec5912cf8aa83ad05285258"} Nov 02 21:54:04.002847 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.002816 5963 scope.go:122] "RemoveContainer" containerID="51c4c089d275254e34282547f9d0572366afcfb7b4bbe95f81003865158b1f4d" Nov 02 21:54:04.010797 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.010778 5963 scope.go:122] "RemoveContainer" containerID="2f7b7a98f49c8a2c7473452f2cd54f3f12c37bdad32330eaeb1b13cfacc99690" Nov 02 21:54:04.017632 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.017615 5963 scope.go:122] "RemoveContainer" containerID="a822c83143587b2aacfbf41c2111f306b0ff11570eec49afcaf6b832a80059a6" Nov 02 21:54:04.024306 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.024093 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 02 21:54:04.028204 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.028180 5963 scope.go:122] "RemoveContainer" containerID="731aed8ef96af035785601ca05e4e1dd8ce19f381a2e2c518678e94c42a654f9" Nov 02 21:54:04.029250 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.029227 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 02 21:54:04.037520 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.037498 5963 scope.go:122] "RemoveContainer" containerID="e7c1b3941060b58914bbc302790fff4d58fd1b3eb80393d4f472eadb5f78c342" Nov 02 21:54:04.044643 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.044624 5963 scope.go:122] "RemoveContainer" containerID="66f253e12c92dd139d56b719ec01a70361e8d1af8d8cdf78cf944290e557bdea" Nov 02 21:54:04.051725 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.051634 5963 scope.go:122] "RemoveContainer" containerID="a83d6a4a581be30b30f501dbc4934ec6538832baf6b39177932118adddb1d5b0" Nov 02 21:54:04.058253 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.058235 5963 scope.go:122] "RemoveContainer" containerID="51c4c089d275254e34282547f9d0572366afcfb7b4bbe95f81003865158b1f4d" Nov 02 21:54:04.058505 ip-10-0-139-99 kubenswrapper[5963]: E1102 21:54:04.058480 5963 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51c4c089d275254e34282547f9d0572366afcfb7b4bbe95f81003865158b1f4d\": container with ID starting with 51c4c089d275254e34282547f9d0572366afcfb7b4bbe95f81003865158b1f4d not found: ID does not exist" containerID="51c4c089d275254e34282547f9d0572366afcfb7b4bbe95f81003865158b1f4d" Nov 02 21:54:04.058556 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.058513 5963 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51c4c089d275254e34282547f9d0572366afcfb7b4bbe95f81003865158b1f4d"} err="failed to get container status \"51c4c089d275254e34282547f9d0572366afcfb7b4bbe95f81003865158b1f4d\": rpc error: code = NotFound desc = could not find container \"51c4c089d275254e34282547f9d0572366afcfb7b4bbe95f81003865158b1f4d\": container with ID starting with 51c4c089d275254e34282547f9d0572366afcfb7b4bbe95f81003865158b1f4d not found: ID does not exist" Nov 02 21:54:04.058556 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.058547 5963 scope.go:122] "RemoveContainer" containerID="2f7b7a98f49c8a2c7473452f2cd54f3f12c37bdad32330eaeb1b13cfacc99690" Nov 02 21:54:04.058799 ip-10-0-139-99 kubenswrapper[5963]: E1102 21:54:04.058784 5963 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f7b7a98f49c8a2c7473452f2cd54f3f12c37bdad32330eaeb1b13cfacc99690\": container with ID starting with 2f7b7a98f49c8a2c7473452f2cd54f3f12c37bdad32330eaeb1b13cfacc99690 not found: ID does not exist" containerID="2f7b7a98f49c8a2c7473452f2cd54f3f12c37bdad32330eaeb1b13cfacc99690" Nov 02 21:54:04.058849 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.058803 5963 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f7b7a98f49c8a2c7473452f2cd54f3f12c37bdad32330eaeb1b13cfacc99690"} err="failed to get container status \"2f7b7a98f49c8a2c7473452f2cd54f3f12c37bdad32330eaeb1b13cfacc99690\": rpc error: code = NotFound desc = could not find container \"2f7b7a98f49c8a2c7473452f2cd54f3f12c37bdad32330eaeb1b13cfacc99690\": container with ID starting with 2f7b7a98f49c8a2c7473452f2cd54f3f12c37bdad32330eaeb1b13cfacc99690 not found: ID does not exist" Nov 02 21:54:04.058849 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.058819 5963 scope.go:122] "RemoveContainer" containerID="a822c83143587b2aacfbf41c2111f306b0ff11570eec49afcaf6b832a80059a6" Nov 02 21:54:04.059070 ip-10-0-139-99 kubenswrapper[5963]: E1102 21:54:04.059053 5963 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a822c83143587b2aacfbf41c2111f306b0ff11570eec49afcaf6b832a80059a6\": container with ID starting with a822c83143587b2aacfbf41c2111f306b0ff11570eec49afcaf6b832a80059a6 not found: ID does not exist" containerID="a822c83143587b2aacfbf41c2111f306b0ff11570eec49afcaf6b832a80059a6" Nov 02 21:54:04.059114 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.059076 5963 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a822c83143587b2aacfbf41c2111f306b0ff11570eec49afcaf6b832a80059a6"} err="failed to get container status \"a822c83143587b2aacfbf41c2111f306b0ff11570eec49afcaf6b832a80059a6\": rpc error: code = NotFound desc = could not find container \"a822c83143587b2aacfbf41c2111f306b0ff11570eec49afcaf6b832a80059a6\": container with ID starting with a822c83143587b2aacfbf41c2111f306b0ff11570eec49afcaf6b832a80059a6 not found: ID does not exist" Nov 02 21:54:04.059114 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.059090 5963 scope.go:122] "RemoveContainer" containerID="731aed8ef96af035785601ca05e4e1dd8ce19f381a2e2c518678e94c42a654f9" Nov 02 21:54:04.059322 ip-10-0-139-99 kubenswrapper[5963]: E1102 21:54:04.059296 5963 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"731aed8ef96af035785601ca05e4e1dd8ce19f381a2e2c518678e94c42a654f9\": container with ID starting with 731aed8ef96af035785601ca05e4e1dd8ce19f381a2e2c518678e94c42a654f9 not found: ID does not exist" containerID="731aed8ef96af035785601ca05e4e1dd8ce19f381a2e2c518678e94c42a654f9" Nov 02 21:54:04.059365 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.059327 5963 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"731aed8ef96af035785601ca05e4e1dd8ce19f381a2e2c518678e94c42a654f9"} err="failed to get container status \"731aed8ef96af035785601ca05e4e1dd8ce19f381a2e2c518678e94c42a654f9\": rpc error: code = NotFound desc = could not find container \"731aed8ef96af035785601ca05e4e1dd8ce19f381a2e2c518678e94c42a654f9\": container with ID starting with 731aed8ef96af035785601ca05e4e1dd8ce19f381a2e2c518678e94c42a654f9 not found: ID does not exist" Nov 02 21:54:04.059365 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.059341 5963 scope.go:122] "RemoveContainer" containerID="e7c1b3941060b58914bbc302790fff4d58fd1b3eb80393d4f472eadb5f78c342" Nov 02 21:54:04.059566 ip-10-0-139-99 kubenswrapper[5963]: E1102 21:54:04.059552 5963 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7c1b3941060b58914bbc302790fff4d58fd1b3eb80393d4f472eadb5f78c342\": container with ID starting with e7c1b3941060b58914bbc302790fff4d58fd1b3eb80393d4f472eadb5f78c342 not found: ID does not exist" containerID="e7c1b3941060b58914bbc302790fff4d58fd1b3eb80393d4f472eadb5f78c342" Nov 02 21:54:04.059604 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.059572 5963 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7c1b3941060b58914bbc302790fff4d58fd1b3eb80393d4f472eadb5f78c342"} err="failed to get container status \"e7c1b3941060b58914bbc302790fff4d58fd1b3eb80393d4f472eadb5f78c342\": rpc error: code = NotFound desc = could not find container \"e7c1b3941060b58914bbc302790fff4d58fd1b3eb80393d4f472eadb5f78c342\": container with ID starting with e7c1b3941060b58914bbc302790fff4d58fd1b3eb80393d4f472eadb5f78c342 not found: ID does not exist" Nov 02 21:54:04.059604 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.059590 5963 scope.go:122] "RemoveContainer" containerID="66f253e12c92dd139d56b719ec01a70361e8d1af8d8cdf78cf944290e557bdea" Nov 02 21:54:04.059830 ip-10-0-139-99 kubenswrapper[5963]: E1102 21:54:04.059809 5963 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66f253e12c92dd139d56b719ec01a70361e8d1af8d8cdf78cf944290e557bdea\": container with ID starting with 66f253e12c92dd139d56b719ec01a70361e8d1af8d8cdf78cf944290e557bdea not found: ID does not exist" containerID="66f253e12c92dd139d56b719ec01a70361e8d1af8d8cdf78cf944290e557bdea" Nov 02 21:54:04.059916 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.059833 5963 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66f253e12c92dd139d56b719ec01a70361e8d1af8d8cdf78cf944290e557bdea"} err="failed to get container status \"66f253e12c92dd139d56b719ec01a70361e8d1af8d8cdf78cf944290e557bdea\": rpc error: code = NotFound desc = could not find container \"66f253e12c92dd139d56b719ec01a70361e8d1af8d8cdf78cf944290e557bdea\": container with ID starting with 66f253e12c92dd139d56b719ec01a70361e8d1af8d8cdf78cf944290e557bdea not found: ID does not exist" Nov 02 21:54:04.059916 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.059844 5963 scope.go:122] "RemoveContainer" containerID="a83d6a4a581be30b30f501dbc4934ec6538832baf6b39177932118adddb1d5b0" Nov 02 21:54:04.060247 ip-10-0-139-99 kubenswrapper[5963]: E1102 21:54:04.060203 5963 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a83d6a4a581be30b30f501dbc4934ec6538832baf6b39177932118adddb1d5b0\": container with ID starting with a83d6a4a581be30b30f501dbc4934ec6538832baf6b39177932118adddb1d5b0 not found: ID does not exist" containerID="a83d6a4a581be30b30f501dbc4934ec6538832baf6b39177932118adddb1d5b0" Nov 02 21:54:04.060351 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.060242 5963 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a83d6a4a581be30b30f501dbc4934ec6538832baf6b39177932118adddb1d5b0"} err="failed to get container status \"a83d6a4a581be30b30f501dbc4934ec6538832baf6b39177932118adddb1d5b0\": rpc error: code = NotFound desc = could not find container \"a83d6a4a581be30b30f501dbc4934ec6538832baf6b39177932118adddb1d5b0\": container with ID starting with a83d6a4a581be30b30f501dbc4934ec6538832baf6b39177932118adddb1d5b0 not found: ID does not exist" Nov 02 21:54:04.079700 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.061763 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 02 21:54:04.079700 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.062073 5963 cpu_manager.go:414] "containerMap: removing container" podUID="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" containerName="kube-rbac-proxy" Nov 02 21:54:04.079700 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.062087 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" containerName="kube-rbac-proxy" Nov 02 21:54:04.079700 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.062102 5963 cpu_manager.go:414] "containerMap: removing container" podUID="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" containerName="prom-label-proxy" Nov 02 21:54:04.079700 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.062108 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" containerName="prom-label-proxy" Nov 02 21:54:04.079700 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.062116 5963 cpu_manager.go:414] "containerMap: removing container" podUID="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" containerName="init-config-reloader" Nov 02 21:54:04.079700 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.062121 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" containerName="init-config-reloader" Nov 02 21:54:04.079700 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.062130 5963 cpu_manager.go:414] "containerMap: removing container" podUID="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" containerName="config-reloader" Nov 02 21:54:04.079700 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.062135 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" containerName="config-reloader" Nov 02 21:54:04.079700 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.062143 5963 cpu_manager.go:414] "containerMap: removing container" podUID="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" containerName="kube-rbac-proxy-metric" Nov 02 21:54:04.079700 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.062148 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" containerName="kube-rbac-proxy-metric" Nov 02 21:54:04.079700 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.062157 5963 cpu_manager.go:414] "containerMap: removing container" podUID="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" containerName="kube-rbac-proxy-web" Nov 02 21:54:04.079700 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.062162 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" containerName="kube-rbac-proxy-web" Nov 02 21:54:04.079700 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.062181 5963 cpu_manager.go:414] "containerMap: removing container" podUID="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" containerName="alertmanager" Nov 02 21:54:04.079700 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.062186 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" containerName="alertmanager" Nov 02 21:54:04.079700 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.062233 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" containerName="kube-rbac-proxy" Nov 02 21:54:04.079700 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.062240 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" containerName="prom-label-proxy" Nov 02 21:54:04.079700 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.062249 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" containerName="init-config-reloader" Nov 02 21:54:04.079700 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.062261 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" containerName="config-reloader" Nov 02 21:54:04.079700 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.062268 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" containerName="kube-rbac-proxy-metric" Nov 02 21:54:04.079700 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.062275 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" containerName="kube-rbac-proxy-web" Nov 02 21:54:04.079700 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.062281 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" containerName="alertmanager" Nov 02 21:54:04.092251 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.092216 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 02 21:54:04.092399 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.092379 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.099911 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.099860 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Nov 02 21:54:04.099911 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.099871 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Nov 02 21:54:04.099911 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.099903 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Nov 02 21:54:04.100143 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.099934 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Nov 02 21:54:04.100143 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.099870 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Nov 02 21:54:04.100143 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.099974 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Nov 02 21:54:04.100322 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.100286 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Nov 02 21:54:04.100437 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.100364 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Nov 02 21:54:04.100437 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.100431 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-p5gzk\"" Nov 02 21:54:04.102896 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.102880 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Nov 02 21:54:04.202911 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.202877 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7915633e-afc1-45ce-9192-3f05daef918a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7915633e-afc1-45ce-9192-3f05daef918a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.203071 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.202911 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7915633e-afc1-45ce-9192-3f05daef918a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7915633e-afc1-45ce-9192-3f05daef918a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.203071 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.203009 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7915633e-afc1-45ce-9192-3f05daef918a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7915633e-afc1-45ce-9192-3f05daef918a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.203071 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.203042 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7915633e-afc1-45ce-9192-3f05daef918a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7915633e-afc1-45ce-9192-3f05daef918a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.203071 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.203066 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7915633e-afc1-45ce-9192-3f05daef918a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7915633e-afc1-45ce-9192-3f05daef918a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.203263 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.203170 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7915633e-afc1-45ce-9192-3f05daef918a-config-out\") pod \"alertmanager-main-0\" (UID: \"7915633e-afc1-45ce-9192-3f05daef918a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.203263 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.203226 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7915633e-afc1-45ce-9192-3f05daef918a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7915633e-afc1-45ce-9192-3f05daef918a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.203366 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.203266 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7915633e-afc1-45ce-9192-3f05daef918a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7915633e-afc1-45ce-9192-3f05daef918a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.203423 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.203365 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7915633e-afc1-45ce-9192-3f05daef918a-config-volume\") pod \"alertmanager-main-0\" (UID: \"7915633e-afc1-45ce-9192-3f05daef918a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.203423 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.203392 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7915633e-afc1-45ce-9192-3f05daef918a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7915633e-afc1-45ce-9192-3f05daef918a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.203526 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.203474 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8q7n\" (UniqueName: \"kubernetes.io/projected/7915633e-afc1-45ce-9192-3f05daef918a-kube-api-access-g8q7n\") pod \"alertmanager-main-0\" (UID: \"7915633e-afc1-45ce-9192-3f05daef918a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.203526 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.203505 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7915633e-afc1-45ce-9192-3f05daef918a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7915633e-afc1-45ce-9192-3f05daef918a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.203599 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.203556 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7915633e-afc1-45ce-9192-3f05daef918a-web-config\") pod \"alertmanager-main-0\" (UID: \"7915633e-afc1-45ce-9192-3f05daef918a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.304476 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.304446 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7915633e-afc1-45ce-9192-3f05daef918a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7915633e-afc1-45ce-9192-3f05daef918a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.304637 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.304485 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7915633e-afc1-45ce-9192-3f05daef918a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7915633e-afc1-45ce-9192-3f05daef918a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.304637 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.304507 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7915633e-afc1-45ce-9192-3f05daef918a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7915633e-afc1-45ce-9192-3f05daef918a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.304637 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.304529 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7915633e-afc1-45ce-9192-3f05daef918a-config-out\") pod \"alertmanager-main-0\" (UID: \"7915633e-afc1-45ce-9192-3f05daef918a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.304637 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.304557 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7915633e-afc1-45ce-9192-3f05daef918a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7915633e-afc1-45ce-9192-3f05daef918a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.304637 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.304606 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7915633e-afc1-45ce-9192-3f05daef918a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7915633e-afc1-45ce-9192-3f05daef918a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.304637 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.304631 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7915633e-afc1-45ce-9192-3f05daef918a-config-volume\") pod \"alertmanager-main-0\" (UID: \"7915633e-afc1-45ce-9192-3f05daef918a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.304963 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.304654 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7915633e-afc1-45ce-9192-3f05daef918a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7915633e-afc1-45ce-9192-3f05daef918a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.304963 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.304710 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8q7n\" (UniqueName: \"kubernetes.io/projected/7915633e-afc1-45ce-9192-3f05daef918a-kube-api-access-g8q7n\") pod \"alertmanager-main-0\" (UID: \"7915633e-afc1-45ce-9192-3f05daef918a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.304963 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.304758 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7915633e-afc1-45ce-9192-3f05daef918a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7915633e-afc1-45ce-9192-3f05daef918a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.304963 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.304791 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7915633e-afc1-45ce-9192-3f05daef918a-web-config\") pod \"alertmanager-main-0\" (UID: \"7915633e-afc1-45ce-9192-3f05daef918a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.304963 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.304815 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7915633e-afc1-45ce-9192-3f05daef918a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7915633e-afc1-45ce-9192-3f05daef918a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.304963 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.304835 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7915633e-afc1-45ce-9192-3f05daef918a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7915633e-afc1-45ce-9192-3f05daef918a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.304963 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.304922 5963 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Nov 02 21:54:04.305272 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.305140 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7915633e-afc1-45ce-9192-3f05daef918a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7915633e-afc1-45ce-9192-3f05daef918a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.306294 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.306252 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7915633e-afc1-45ce-9192-3f05daef918a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7915633e-afc1-45ce-9192-3f05daef918a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.306756 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.306731 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7915633e-afc1-45ce-9192-3f05daef918a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7915633e-afc1-45ce-9192-3f05daef918a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.308264 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.308023 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7915633e-afc1-45ce-9192-3f05daef918a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7915633e-afc1-45ce-9192-3f05daef918a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.308264 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.308190 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7915633e-afc1-45ce-9192-3f05daef918a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7915633e-afc1-45ce-9192-3f05daef918a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.308426 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.308278 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7915633e-afc1-45ce-9192-3f05daef918a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7915633e-afc1-45ce-9192-3f05daef918a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.308426 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.308341 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7915633e-afc1-45ce-9192-3f05daef918a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7915633e-afc1-45ce-9192-3f05daef918a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.308527 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.308459 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7915633e-afc1-45ce-9192-3f05daef918a-web-config\") pod \"alertmanager-main-0\" (UID: \"7915633e-afc1-45ce-9192-3f05daef918a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.308527 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.308487 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7915633e-afc1-45ce-9192-3f05daef918a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7915633e-afc1-45ce-9192-3f05daef918a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.308808 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.308784 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7915633e-afc1-45ce-9192-3f05daef918a-config-out\") pod \"alertmanager-main-0\" (UID: \"7915633e-afc1-45ce-9192-3f05daef918a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.309118 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.309102 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7915633e-afc1-45ce-9192-3f05daef918a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7915633e-afc1-45ce-9192-3f05daef918a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.309978 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.309961 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7915633e-afc1-45ce-9192-3f05daef918a-config-volume\") pod \"alertmanager-main-0\" (UID: \"7915633e-afc1-45ce-9192-3f05daef918a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.317776 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.317756 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8q7n\" (UniqueName: \"kubernetes.io/projected/7915633e-afc1-45ce-9192-3f05daef918a-kube-api-access-g8q7n\") pod \"alertmanager-main-0\" (UID: \"7915633e-afc1-45ce-9192-3f05daef918a\") " pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.507476 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.507437 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Nov 02 21:54:04.821534 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:04.821501 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 02 21:54:04.824963 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:54:04.824933 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7915633e_afc1_45ce_9192_3f05daef918a.slice/crio-d3b3f9048b2c0a03e5f1ce8cf45564bcfd756e223d8489d803d626bb59243e99 WatchSource:0}: Error finding container d3b3f9048b2c0a03e5f1ce8cf45564bcfd756e223d8489d803d626bb59243e99: Status 404 returned error can't find the container with id d3b3f9048b2c0a03e5f1ce8cf45564bcfd756e223d8489d803d626bb59243e99 Nov 02 21:54:05.008608 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:05.008576 5963 generic.go:356] "Generic (PLEG): container finished" podID="7915633e-afc1-45ce-9192-3f05daef918a" containerID="32fb0322538889c9cfad2a72bf4b0989eda019d9e2ee36045825c9c9d00a9574" exitCode=0 Nov 02 21:54:05.008780 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:05.008615 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7915633e-afc1-45ce-9192-3f05daef918a","Type":"ContainerDied","Data":"32fb0322538889c9cfad2a72bf4b0989eda019d9e2ee36045825c9c9d00a9574"} Nov 02 21:54:05.008780 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:05.008687 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7915633e-afc1-45ce-9192-3f05daef918a","Type":"ContainerStarted","Data":"d3b3f9048b2c0a03e5f1ce8cf45564bcfd756e223d8489d803d626bb59243e99"} Nov 02 21:54:05.563194 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:05.563133 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:54:05.666821 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:05.666783 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:54:05.863313 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:05.863233 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d45953b9-e0fd-49ec-9ec0-aa366fa92c79" path="/var/lib/kubelet/pods/d45953b9-e0fd-49ec-9ec0-aa366fa92c79/volumes" Nov 02 21:54:06.016193 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:06.016160 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7915633e-afc1-45ce-9192-3f05daef918a","Type":"ContainerStarted","Data":"87417ee13f43f96281f88e3afbc37bc2eebd38e27de9ac8fdc686439ceffa5bc"} Nov 02 21:54:06.016336 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:06.016221 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7915633e-afc1-45ce-9192-3f05daef918a","Type":"ContainerStarted","Data":"ce2b86199381e51fe29b759038e4ff2cea874a3a9531897be5b3616311dda608"} Nov 02 21:54:06.016336 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:06.016251 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7915633e-afc1-45ce-9192-3f05daef918a","Type":"ContainerStarted","Data":"1757ce4e465a4faa78b0c9866f55ac7317d03a998ca9dc0ae54ae9a23bc31982"} Nov 02 21:54:06.016336 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:06.016276 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7915633e-afc1-45ce-9192-3f05daef918a","Type":"ContainerStarted","Data":"dd1b6fbc7d3410b52e4b373734ee69e67c53f56e1dc28168354fed4f36c23f02"} Nov 02 21:54:06.016336 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:06.016298 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7915633e-afc1-45ce-9192-3f05daef918a","Type":"ContainerStarted","Data":"4543355bfba50caf17b6201ef69cfc23d34dfc8514e6dc1d767db21b4e1966d9"} Nov 02 21:54:06.016336 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:06.016319 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7915633e-afc1-45ce-9192-3f05daef918a","Type":"ContainerStarted","Data":"cddcc438c23282878a1535b2517ab4069b685a330fa2c33a21f409a6c437794a"} Nov 02 21:54:06.050605 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:06.050543 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.039653184 podStartE2EDuration="2.050528849s" totalImagesPullingTime="0s" totalInitContainerRuntime="10.875665ms" isStatefulPod=false podCreationTimestamp="2026-11-02 21:54:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:54:06.049886281 +0000 UTC m=+18.301884750" watchObservedRunningTime="2026-11-02 21:54:06.050528849 +0000 UTC m=+18.302527309" Nov 02 21:54:06.805752 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:06.805721 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Nov 02 21:54:06.806053 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:06.806025 5963 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="646bc644-a377-48b5-bd3b-1562b53e93eb" containerName="prometheus" containerID="cri-o://68fc175a79d05c447feb16ecda46d779005fd852e615f9114dbb856c46fab41a" gracePeriod=600 Nov 02 21:54:06.806188 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:06.806075 5963 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="646bc644-a377-48b5-bd3b-1562b53e93eb" containerName="kube-rbac-proxy" containerID="cri-o://5a6e1638c722142ccf66a57de8d015e4503c0ea07f05702a3126733122cdd466" gracePeriod=600 Nov 02 21:54:06.806188 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:06.806101 5963 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="646bc644-a377-48b5-bd3b-1562b53e93eb" containerName="kube-rbac-proxy-web" containerID="cri-o://a6b778bd10fca1d6914481751f929468997c44d9d7d0d5b6ba9ea62e7fefd537" gracePeriod=600 Nov 02 21:54:06.806188 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:06.806093 5963 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="646bc644-a377-48b5-bd3b-1562b53e93eb" containerName="thanos-sidecar" containerID="cri-o://3e11aaf421ec33d0ae48bb2859868654890a42e2635ad23ef8d0d6393567fb39" gracePeriod=600 Nov 02 21:54:06.806346 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:06.806196 5963 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="646bc644-a377-48b5-bd3b-1562b53e93eb" containerName="config-reloader" containerID="cri-o://ad8531d2561f22bda8b1cd923aeca751cce0aa99f23652e49ed48ca64b10ab9b" gracePeriod=600 Nov 02 21:54:06.806346 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:06.806211 5963 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="646bc644-a377-48b5-bd3b-1562b53e93eb" containerName="kube-rbac-proxy-thanos" containerID="cri-o://7980bd990e5b6a833ade5df5cd3d4c10ce2e910ceaebf2844249193e2ae9769c" gracePeriod=600 Nov 02 21:54:07.024380 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.024344 5963 generic.go:356] "Generic (PLEG): container finished" podID="646bc644-a377-48b5-bd3b-1562b53e93eb" containerID="7980bd990e5b6a833ade5df5cd3d4c10ce2e910ceaebf2844249193e2ae9769c" exitCode=0 Nov 02 21:54:07.024380 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.024376 5963 generic.go:356] "Generic (PLEG): container finished" podID="646bc644-a377-48b5-bd3b-1562b53e93eb" containerID="5a6e1638c722142ccf66a57de8d015e4503c0ea07f05702a3126733122cdd466" exitCode=0 Nov 02 21:54:07.024380 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.024384 5963 generic.go:356] "Generic (PLEG): container finished" podID="646bc644-a377-48b5-bd3b-1562b53e93eb" containerID="a6b778bd10fca1d6914481751f929468997c44d9d7d0d5b6ba9ea62e7fefd537" exitCode=0 Nov 02 21:54:07.024985 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.024392 5963 generic.go:356] "Generic (PLEG): container finished" podID="646bc644-a377-48b5-bd3b-1562b53e93eb" containerID="3e11aaf421ec33d0ae48bb2859868654890a42e2635ad23ef8d0d6393567fb39" exitCode=0 Nov 02 21:54:07.024985 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.024400 5963 generic.go:356] "Generic (PLEG): container finished" podID="646bc644-a377-48b5-bd3b-1562b53e93eb" containerID="ad8531d2561f22bda8b1cd923aeca751cce0aa99f23652e49ed48ca64b10ab9b" exitCode=0 Nov 02 21:54:07.024985 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.024408 5963 generic.go:356] "Generic (PLEG): container finished" podID="646bc644-a377-48b5-bd3b-1562b53e93eb" containerID="68fc175a79d05c447feb16ecda46d779005fd852e615f9114dbb856c46fab41a" exitCode=0 Nov 02 21:54:07.024985 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.024418 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"646bc644-a377-48b5-bd3b-1562b53e93eb","Type":"ContainerDied","Data":"7980bd990e5b6a833ade5df5cd3d4c10ce2e910ceaebf2844249193e2ae9769c"} Nov 02 21:54:07.024985 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.024513 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"646bc644-a377-48b5-bd3b-1562b53e93eb","Type":"ContainerDied","Data":"5a6e1638c722142ccf66a57de8d015e4503c0ea07f05702a3126733122cdd466"} Nov 02 21:54:07.024985 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.024574 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"646bc644-a377-48b5-bd3b-1562b53e93eb","Type":"ContainerDied","Data":"a6b778bd10fca1d6914481751f929468997c44d9d7d0d5b6ba9ea62e7fefd537"} Nov 02 21:54:07.024985 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.024612 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"646bc644-a377-48b5-bd3b-1562b53e93eb","Type":"ContainerDied","Data":"3e11aaf421ec33d0ae48bb2859868654890a42e2635ad23ef8d0d6393567fb39"} Nov 02 21:54:07.024985 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.024651 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"646bc644-a377-48b5-bd3b-1562b53e93eb","Type":"ContainerDied","Data":"ad8531d2561f22bda8b1cd923aeca751cce0aa99f23652e49ed48ca64b10ab9b"} Nov 02 21:54:07.024985 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.024707 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"646bc644-a377-48b5-bd3b-1562b53e93eb","Type":"ContainerDied","Data":"68fc175a79d05c447feb16ecda46d779005fd852e615f9114dbb856c46fab41a"} Nov 02 21:54:07.087441 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.087407 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:07.235926 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.235889 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/646bc644-a377-48b5-bd3b-1562b53e93eb-config-out\" (UniqueName: \"kubernetes.io/empty-dir/646bc644-a377-48b5-bd3b-1562b53e93eb-config-out\") pod \"646bc644-a377-48b5-bd3b-1562b53e93eb\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " Nov 02 21:54:07.236298 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.235937 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-web-config\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-web-config\") pod \"646bc644-a377-48b5-bd3b-1562b53e93eb\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " Nov 02 21:54:07.236298 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.235958 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-config\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-config\") pod \"646bc644-a377-48b5-bd3b-1562b53e93eb\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " Nov 02 21:54:07.236298 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.235983 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-metrics-client-certs\") pod \"646bc644-a377-48b5-bd3b-1562b53e93eb\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " Nov 02 21:54:07.236298 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.236012 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-configmap-serving-certs-ca-bundle\") pod \"646bc644-a377-48b5-bd3b-1562b53e93eb\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " Nov 02 21:54:07.236298 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.236048 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-thanos-prometheus-http-client-file\") pod \"646bc644-a377-48b5-bd3b-1562b53e93eb\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " Nov 02 21:54:07.236298 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.236066 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-kube-rbac-proxy\") pod \"646bc644-a377-48b5-bd3b-1562b53e93eb\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " Nov 02 21:54:07.236298 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.236085 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-rulefiles-1\") pod \"646bc644-a377-48b5-bd3b-1562b53e93eb\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " Nov 02 21:54:07.236298 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.236110 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-grpc-tls\") pod \"646bc644-a377-48b5-bd3b-1562b53e93eb\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " Nov 02 21:54:07.236298 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.236142 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-rulefiles-2\") pod \"646bc644-a377-48b5-bd3b-1562b53e93eb\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " Nov 02 21:54:07.236298 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.236179 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/646bc644-a377-48b5-bd3b-1562b53e93eb-tls-assets\" (UniqueName: \"kubernetes.io/projected/646bc644-a377-48b5-bd3b-1562b53e93eb-tls-assets\") pod \"646bc644-a377-48b5-bd3b-1562b53e93eb\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " Nov 02 21:54:07.236298 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.236206 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/646bc644-a377-48b5-bd3b-1562b53e93eb-kube-api-access-rr7j5\" (UniqueName: \"kubernetes.io/projected/646bc644-a377-48b5-bd3b-1562b53e93eb-kube-api-access-rr7j5\") pod \"646bc644-a377-48b5-bd3b-1562b53e93eb\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " Nov 02 21:54:07.236298 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.236244 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"646bc644-a377-48b5-bd3b-1562b53e93eb\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " Nov 02 21:54:07.236298 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.236289 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-configmap-metrics-client-ca\") pod \"646bc644-a377-48b5-bd3b-1562b53e93eb\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " Nov 02 21:54:07.237001 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.236329 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-configmap-kubelet-serving-ca-bundle\") pod \"646bc644-a377-48b5-bd3b-1562b53e93eb\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " Nov 02 21:54:07.237001 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.236360 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-prometheus-k8s-tls\") pod \"646bc644-a377-48b5-bd3b-1562b53e93eb\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " Nov 02 21:54:07.237001 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.236405 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-db\") pod \"646bc644-a377-48b5-bd3b-1562b53e93eb\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " Nov 02 21:54:07.237001 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.236438 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-rulefiles-0\") pod \"646bc644-a377-48b5-bd3b-1562b53e93eb\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " Nov 02 21:54:07.237001 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.236470 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-trusted-ca-bundle\") pod \"646bc644-a377-48b5-bd3b-1562b53e93eb\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " Nov 02 21:54:07.237001 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.236498 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"646bc644-a377-48b5-bd3b-1562b53e93eb\" (UID: \"646bc644-a377-48b5-bd3b-1562b53e93eb\") " Nov 02 21:54:07.237001 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.236695 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-configmap-serving-certs-ca-bundle" pod "646bc644-a377-48b5-bd3b-1562b53e93eb" (UID: "646bc644-a377-48b5-bd3b-1562b53e93eb"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 21:54:07.237348 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.237046 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-rulefiles-2" pod "646bc644-a377-48b5-bd3b-1562b53e93eb" (UID: "646bc644-a377-48b5-bd3b-1562b53e93eb"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 21:54:07.237691 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.237581 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-configmap-metrics-client-ca" pod "646bc644-a377-48b5-bd3b-1562b53e93eb" (UID: "646bc644-a377-48b5-bd3b-1562b53e93eb"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 21:54:07.238297 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.238075 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-rulefiles-1" pod "646bc644-a377-48b5-bd3b-1562b53e93eb" (UID: "646bc644-a377-48b5-bd3b-1562b53e93eb"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 21:54:07.238386 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.238340 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-configmap-kubelet-serving-ca-bundle" pod "646bc644-a377-48b5-bd3b-1562b53e93eb" (UID: "646bc644-a377-48b5-bd3b-1562b53e93eb"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 21:54:07.238525 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.238426 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-db" pod "646bc644-a377-48b5-bd3b-1562b53e93eb" (UID: "646bc644-a377-48b5-bd3b-1562b53e93eb"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 21:54:07.238714 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.238692 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-trusted-ca-bundle" pod "646bc644-a377-48b5-bd3b-1562b53e93eb" (UID: "646bc644-a377-48b5-bd3b-1562b53e93eb"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 21:54:07.238794 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.238656 5963 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:07.238794 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.238789 5963 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:07.238904 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.238807 5963 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:07.238958 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.238824 5963 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-configmap-metrics-client-ca\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:07.238958 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.238937 5963 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:07.238958 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.238954 5963 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-db\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:07.239505 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.239468 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-thanos-prometheus-http-client-file" pod "646bc644-a377-48b5-bd3b-1562b53e93eb" (UID: "646bc644-a377-48b5-bd3b-1562b53e93eb"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 21:54:07.240031 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.240004 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-rulefiles-0" pod "646bc644-a377-48b5-bd3b-1562b53e93eb" (UID: "646bc644-a377-48b5-bd3b-1562b53e93eb"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 21:54:07.241101 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.241070 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/646bc644-a377-48b5-bd3b-1562b53e93eb-tls-assets" pod "646bc644-a377-48b5-bd3b-1562b53e93eb" (UID: "646bc644-a377-48b5-bd3b-1562b53e93eb"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 21:54:07.241268 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.241230 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/646bc644-a377-48b5-bd3b-1562b53e93eb-config-out" pod "646bc644-a377-48b5-bd3b-1562b53e93eb" (UID: "646bc644-a377-48b5-bd3b-1562b53e93eb"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 21:54:07.241460 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.241434 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-prometheus-k8s-kube-rbac-proxy-web" pod "646bc644-a377-48b5-bd3b-1562b53e93eb" (UID: "646bc644-a377-48b5-bd3b-1562b53e93eb"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 21:54:07.241731 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.241706 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-metrics-client-certs" pod "646bc644-a377-48b5-bd3b-1562b53e93eb" (UID: "646bc644-a377-48b5-bd3b-1562b53e93eb"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 21:54:07.241855 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.241776 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-kube-rbac-proxy" pod "646bc644-a377-48b5-bd3b-1562b53e93eb" (UID: "646bc644-a377-48b5-bd3b-1562b53e93eb"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 21:54:07.241900 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.241877 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-grpc-tls" pod "646bc644-a377-48b5-bd3b-1562b53e93eb" (UID: "646bc644-a377-48b5-bd3b-1562b53e93eb"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 21:54:07.241986 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.241962 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-prometheus-k8s-tls" pod "646bc644-a377-48b5-bd3b-1562b53e93eb" (UID: "646bc644-a377-48b5-bd3b-1562b53e93eb"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 21:54:07.242160 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.242119 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-config" pod "646bc644-a377-48b5-bd3b-1562b53e93eb" (UID: "646bc644-a377-48b5-bd3b-1562b53e93eb"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 21:54:07.242298 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.242278 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/646bc644-a377-48b5-bd3b-1562b53e93eb-kube-api-access-rr7j5" pod "646bc644-a377-48b5-bd3b-1562b53e93eb" (UID: "646bc644-a377-48b5-bd3b-1562b53e93eb"). InnerVolumeSpecName "kube-api-access-rr7j5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 21:54:07.242627 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.242602 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-prometheus-k8s-thanos-sidecar-tls" pod "646bc644-a377-48b5-bd3b-1562b53e93eb" (UID: "646bc644-a377-48b5-bd3b-1562b53e93eb"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 21:54:07.253850 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.251980 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-web-config" pod "646bc644-a377-48b5-bd3b-1562b53e93eb" (UID: "646bc644-a377-48b5-bd3b-1562b53e93eb"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 21:54:07.339843 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.339758 5963 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/646bc644-a377-48b5-bd3b-1562b53e93eb-config-out\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:07.339843 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.339790 5963 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-web-config\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:07.339843 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.339804 5963 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-config\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:07.339843 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.339818 5963 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-metrics-client-certs\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:07.339843 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.339832 5963 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:07.339843 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.339846 5963 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-kube-rbac-proxy\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:07.340151 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.339860 5963 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-grpc-tls\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:07.340151 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.339872 5963 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/646bc644-a377-48b5-bd3b-1562b53e93eb-tls-assets\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:07.340151 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.339885 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rr7j5\" (UniqueName: \"kubernetes.io/projected/646bc644-a377-48b5-bd3b-1562b53e93eb-kube-api-access-rr7j5\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:07.340151 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.339897 5963 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:07.340151 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.339910 5963 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:07.340151 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.339923 5963 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:07.340151 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.339936 5963 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/646bc644-a377-48b5-bd3b-1562b53e93eb-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:07.340151 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.339949 5963 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/646bc644-a377-48b5-bd3b-1562b53e93eb-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:07.958994 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:07.958959 5963 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:54:08.031588 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.031543 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"646bc644-a377-48b5-bd3b-1562b53e93eb","Type":"ContainerDied","Data":"249a9856013b47fb204ab861d32e3068bf3bb7d9a25cf8e8f901dfcb7321c0ed"} Nov 02 21:54:08.031986 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.031602 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.031986 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.031639 5963 scope.go:122] "RemoveContainer" containerID="7980bd990e5b6a833ade5df5cd3d4c10ce2e910ceaebf2844249193e2ae9769c" Nov 02 21:54:08.040113 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.040094 5963 scope.go:122] "RemoveContainer" containerID="5a6e1638c722142ccf66a57de8d015e4503c0ea07f05702a3126733122cdd466" Nov 02 21:54:08.047266 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.047234 5963 scope.go:122] "RemoveContainer" containerID="a6b778bd10fca1d6914481751f929468997c44d9d7d0d5b6ba9ea62e7fefd537" Nov 02 21:54:08.053564 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.053543 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Nov 02 21:54:08.054911 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.054896 5963 scope.go:122] "RemoveContainer" containerID="3e11aaf421ec33d0ae48bb2859868654890a42e2635ad23ef8d0d6393567fb39" Nov 02 21:54:08.063462 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.060372 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Nov 02 21:54:08.067398 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.067378 5963 scope.go:122] "RemoveContainer" containerID="ad8531d2561f22bda8b1cd923aeca751cce0aa99f23652e49ed48ca64b10ab9b" Nov 02 21:54:08.074735 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.074716 5963 scope.go:122] "RemoveContainer" containerID="68fc175a79d05c447feb16ecda46d779005fd852e615f9114dbb856c46fab41a" Nov 02 21:54:08.083880 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.083858 5963 scope.go:122] "RemoveContainer" containerID="daa4ae9e23bc55b5e728ec658b4b361f8e847c756f967d68b8464ec4cf23b58a" Nov 02 21:54:08.089652 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.089629 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Nov 02 21:54:08.090040 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.090024 5963 cpu_manager.go:414] "containerMap: removing container" podUID="646bc644-a377-48b5-bd3b-1562b53e93eb" containerName="kube-rbac-proxy-web" Nov 02 21:54:08.090128 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.090042 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="646bc644-a377-48b5-bd3b-1562b53e93eb" containerName="kube-rbac-proxy-web" Nov 02 21:54:08.090128 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.090058 5963 cpu_manager.go:414] "containerMap: removing container" podUID="646bc644-a377-48b5-bd3b-1562b53e93eb" containerName="config-reloader" Nov 02 21:54:08.090128 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.090065 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="646bc644-a377-48b5-bd3b-1562b53e93eb" containerName="config-reloader" Nov 02 21:54:08.090128 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.090082 5963 cpu_manager.go:414] "containerMap: removing container" podUID="646bc644-a377-48b5-bd3b-1562b53e93eb" containerName="thanos-sidecar" Nov 02 21:54:08.090128 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.090090 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="646bc644-a377-48b5-bd3b-1562b53e93eb" containerName="thanos-sidecar" Nov 02 21:54:08.090128 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.090107 5963 cpu_manager.go:414] "containerMap: removing container" podUID="646bc644-a377-48b5-bd3b-1562b53e93eb" containerName="kube-rbac-proxy" Nov 02 21:54:08.090128 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.090113 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="646bc644-a377-48b5-bd3b-1562b53e93eb" containerName="kube-rbac-proxy" Nov 02 21:54:08.090449 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.090135 5963 cpu_manager.go:414] "containerMap: removing container" podUID="646bc644-a377-48b5-bd3b-1562b53e93eb" containerName="init-config-reloader" Nov 02 21:54:08.090449 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.090142 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="646bc644-a377-48b5-bd3b-1562b53e93eb" containerName="init-config-reloader" Nov 02 21:54:08.090449 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.090159 5963 cpu_manager.go:414] "containerMap: removing container" podUID="646bc644-a377-48b5-bd3b-1562b53e93eb" containerName="kube-rbac-proxy-thanos" Nov 02 21:54:08.090449 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.090167 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="646bc644-a377-48b5-bd3b-1562b53e93eb" containerName="kube-rbac-proxy-thanos" Nov 02 21:54:08.090449 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.090176 5963 cpu_manager.go:414] "containerMap: removing container" podUID="646bc644-a377-48b5-bd3b-1562b53e93eb" containerName="prometheus" Nov 02 21:54:08.090449 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.090183 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="646bc644-a377-48b5-bd3b-1562b53e93eb" containerName="prometheus" Nov 02 21:54:08.090449 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.090254 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="646bc644-a377-48b5-bd3b-1562b53e93eb" containerName="kube-rbac-proxy" Nov 02 21:54:08.090449 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.090269 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="646bc644-a377-48b5-bd3b-1562b53e93eb" containerName="init-config-reloader" Nov 02 21:54:08.090449 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.090279 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="646bc644-a377-48b5-bd3b-1562b53e93eb" containerName="kube-rbac-proxy-thanos" Nov 02 21:54:08.090449 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.090290 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="646bc644-a377-48b5-bd3b-1562b53e93eb" containerName="prometheus" Nov 02 21:54:08.090449 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.090302 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="646bc644-a377-48b5-bd3b-1562b53e93eb" containerName="kube-rbac-proxy-web" Nov 02 21:54:08.090449 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.090311 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="646bc644-a377-48b5-bd3b-1562b53e93eb" containerName="config-reloader" Nov 02 21:54:08.090449 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.090321 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="646bc644-a377-48b5-bd3b-1562b53e93eb" containerName="thanos-sidecar" Nov 02 21:54:08.131560 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.131485 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Nov 02 21:54:08.131699 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.131621 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.143235 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.142794 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Nov 02 21:54:08.143235 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.142814 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Nov 02 21:54:08.143235 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.142874 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Nov 02 21:54:08.143235 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.142891 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Nov 02 21:54:08.143235 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.142912 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Nov 02 21:54:08.143235 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.142951 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Nov 02 21:54:08.143235 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.142960 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Nov 02 21:54:08.143235 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.142966 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-409jhd5jfe14t\"" Nov 02 21:54:08.143235 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.142977 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Nov 02 21:54:08.143235 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.142993 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Nov 02 21:54:08.143235 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.143046 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Nov 02 21:54:08.143235 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.143047 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rfcf5\"" Nov 02 21:54:08.143235 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.143187 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Nov 02 21:54:08.144093 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.144081 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Nov 02 21:54:08.147088 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.147068 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Nov 02 21:54:08.147210 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.147197 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Nov 02 21:54:08.246603 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.246565 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/af89cac1-f11d-4d03-bdb6-6a2d983ea393-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.246799 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.246608 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/af89cac1-f11d-4d03-bdb6-6a2d983ea393-config\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.246799 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.246636 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/af89cac1-f11d-4d03-bdb6-6a2d983ea393-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.246799 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.246744 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/af89cac1-f11d-4d03-bdb6-6a2d983ea393-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.246901 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.246801 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af89cac1-f11d-4d03-bdb6-6a2d983ea393-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.246901 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.246836 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/af89cac1-f11d-4d03-bdb6-6a2d983ea393-config-out\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.246901 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.246854 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af89cac1-f11d-4d03-bdb6-6a2d983ea393-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.247000 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.246934 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/af89cac1-f11d-4d03-bdb6-6a2d983ea393-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.247000 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.246976 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/af89cac1-f11d-4d03-bdb6-6a2d983ea393-web-config\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.247068 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.247002 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/af89cac1-f11d-4d03-bdb6-6a2d983ea393-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.247068 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.247019 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/af89cac1-f11d-4d03-bdb6-6a2d983ea393-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.247068 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.247059 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/af89cac1-f11d-4d03-bdb6-6a2d983ea393-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.247157 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.247092 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af89cac1-f11d-4d03-bdb6-6a2d983ea393-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.247157 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.247120 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/af89cac1-f11d-4d03-bdb6-6a2d983ea393-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.247222 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.247164 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af89cac1-f11d-4d03-bdb6-6a2d983ea393-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.247222 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.247186 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/af89cac1-f11d-4d03-bdb6-6a2d983ea393-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.247222 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.247212 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/af89cac1-f11d-4d03-bdb6-6a2d983ea393-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.247321 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.247264 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/af89cac1-f11d-4d03-bdb6-6a2d983ea393-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.247321 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.247284 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tcx8\" (UniqueName: \"kubernetes.io/projected/af89cac1-f11d-4d03-bdb6-6a2d983ea393-kube-api-access-6tcx8\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.247321 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.247306 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/af89cac1-f11d-4d03-bdb6-6a2d983ea393-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.348238 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.348194 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/af89cac1-f11d-4d03-bdb6-6a2d983ea393-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.348238 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.348241 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/af89cac1-f11d-4d03-bdb6-6a2d983ea393-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.348467 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.348262 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/af89cac1-f11d-4d03-bdb6-6a2d983ea393-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.348467 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.348281 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af89cac1-f11d-4d03-bdb6-6a2d983ea393-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.348467 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.348303 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/af89cac1-f11d-4d03-bdb6-6a2d983ea393-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.348467 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.348325 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af89cac1-f11d-4d03-bdb6-6a2d983ea393-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.348467 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.348361 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/af89cac1-f11d-4d03-bdb6-6a2d983ea393-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.348467 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.348401 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/af89cac1-f11d-4d03-bdb6-6a2d983ea393-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.348467 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.348447 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/af89cac1-f11d-4d03-bdb6-6a2d983ea393-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.348863 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.348471 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tcx8\" (UniqueName: \"kubernetes.io/projected/af89cac1-f11d-4d03-bdb6-6a2d983ea393-kube-api-access-6tcx8\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.348863 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.348502 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/af89cac1-f11d-4d03-bdb6-6a2d983ea393-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.348863 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.348797 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/af89cac1-f11d-4d03-bdb6-6a2d983ea393-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.348863 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.348847 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/af89cac1-f11d-4d03-bdb6-6a2d983ea393-config\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.349235 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.348877 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/af89cac1-f11d-4d03-bdb6-6a2d983ea393-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.349235 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.348910 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/af89cac1-f11d-4d03-bdb6-6a2d983ea393-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.349235 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.348943 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af89cac1-f11d-4d03-bdb6-6a2d983ea393-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.349235 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.348987 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/af89cac1-f11d-4d03-bdb6-6a2d983ea393-config-out\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.349235 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.349057 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af89cac1-f11d-4d03-bdb6-6a2d983ea393-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.349235 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.349153 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af89cac1-f11d-4d03-bdb6-6a2d983ea393-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.350589 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.350399 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/af89cac1-f11d-4d03-bdb6-6a2d983ea393-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.350589 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.350438 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/af89cac1-f11d-4d03-bdb6-6a2d983ea393-web-config\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.351648 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.351563 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/af89cac1-f11d-4d03-bdb6-6a2d983ea393-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.351769 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.351647 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/af89cac1-f11d-4d03-bdb6-6a2d983ea393-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.352093 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.352067 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af89cac1-f11d-4d03-bdb6-6a2d983ea393-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.352578 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.352557 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/af89cac1-f11d-4d03-bdb6-6a2d983ea393-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.352848 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.352822 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af89cac1-f11d-4d03-bdb6-6a2d983ea393-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.353179 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.353156 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/af89cac1-f11d-4d03-bdb6-6a2d983ea393-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.353460 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.353203 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/af89cac1-f11d-4d03-bdb6-6a2d983ea393-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.353460 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.353384 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af89cac1-f11d-4d03-bdb6-6a2d983ea393-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.353735 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.353614 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/af89cac1-f11d-4d03-bdb6-6a2d983ea393-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.353823 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.353778 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/af89cac1-f11d-4d03-bdb6-6a2d983ea393-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.353823 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.353785 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/af89cac1-f11d-4d03-bdb6-6a2d983ea393-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.354155 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.354127 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/af89cac1-f11d-4d03-bdb6-6a2d983ea393-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.354238 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.354152 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/af89cac1-f11d-4d03-bdb6-6a2d983ea393-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.354853 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.354826 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/af89cac1-f11d-4d03-bdb6-6a2d983ea393-config-out\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.354950 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.354902 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/af89cac1-f11d-4d03-bdb6-6a2d983ea393-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.355053 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.355036 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/af89cac1-f11d-4d03-bdb6-6a2d983ea393-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.355216 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.355199 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/af89cac1-f11d-4d03-bdb6-6a2d983ea393-config\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.355441 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.355425 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/af89cac1-f11d-4d03-bdb6-6a2d983ea393-web-config\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.362320 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.362302 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tcx8\" (UniqueName: \"kubernetes.io/projected/af89cac1-f11d-4d03-bdb6-6a2d983ea393-kube-api-access-6tcx8\") pod \"prometheus-k8s-0\" (UID: \"af89cac1-f11d-4d03-bdb6-6a2d983ea393\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.584978 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.584936 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:08.626267 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.626243 5963 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g996m" Nov 02 21:54:08.900808 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:08.900651 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Nov 02 21:54:08.903787 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:54:08.903757 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf89cac1_f11d_4d03_bdb6_6a2d983ea393.slice/crio-3f3d37d3d9e1c545869275c8b8737036a2c9fb286140be17185d0c224fa535ab WatchSource:0}: Error finding container 3f3d37d3d9e1c545869275c8b8737036a2c9fb286140be17185d0c224fa535ab: Status 404 returned error can't find the container with id 3f3d37d3d9e1c545869275c8b8737036a2c9fb286140be17185d0c224fa535ab Nov 02 21:54:09.036907 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:09.036877 5963 generic.go:356] "Generic (PLEG): container finished" podID="af89cac1-f11d-4d03-bdb6-6a2d983ea393" containerID="e4ab24cbffe7f22584756719a476cd369438fbe17e58e06500e2a51088b09e8a" exitCode=0 Nov 02 21:54:09.037257 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:09.036957 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"af89cac1-f11d-4d03-bdb6-6a2d983ea393","Type":"ContainerDied","Data":"e4ab24cbffe7f22584756719a476cd369438fbe17e58e06500e2a51088b09e8a"} Nov 02 21:54:09.037257 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:09.037032 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"af89cac1-f11d-4d03-bdb6-6a2d983ea393","Type":"ContainerStarted","Data":"3f3d37d3d9e1c545869275c8b8737036a2c9fb286140be17185d0c224fa535ab"} Nov 02 21:54:09.863175 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:09.863140 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="646bc644-a377-48b5-bd3b-1562b53e93eb" path="/var/lib/kubelet/pods/646bc644-a377-48b5-bd3b-1562b53e93eb/volumes" Nov 02 21:54:10.046584 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:10.046505 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"af89cac1-f11d-4d03-bdb6-6a2d983ea393","Type":"ContainerStarted","Data":"17c4e485b1346a8992b36d303816d913946f39392f09561fa98da486f407a084"} Nov 02 21:54:10.046584 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:10.046568 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"af89cac1-f11d-4d03-bdb6-6a2d983ea393","Type":"ContainerStarted","Data":"bb56342341b108fd29a6cc4fb50ebf9637e04bb02e46bec865d0ed66d7090511"} Nov 02 21:54:10.047017 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:10.046594 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"af89cac1-f11d-4d03-bdb6-6a2d983ea393","Type":"ContainerStarted","Data":"1fca18e38554c50edf9a9e8ff6127590f3c6efc1a0a32c9684c1b3cfa2161c9e"} Nov 02 21:54:10.047017 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:10.046618 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"af89cac1-f11d-4d03-bdb6-6a2d983ea393","Type":"ContainerStarted","Data":"48b878612bc7afb48ec7bb593b79fa8f37952519fb65164e6cc8553728aa64ef"} Nov 02 21:54:10.047017 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:10.046641 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"af89cac1-f11d-4d03-bdb6-6a2d983ea393","Type":"ContainerStarted","Data":"0572d935470cc0b090a70c30d0594f475873abbe82f793a28c556c8aa3fc2b7b"} Nov 02 21:54:10.047017 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:10.046680 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"af89cac1-f11d-4d03-bdb6-6a2d983ea393","Type":"ContainerStarted","Data":"c3f80039abc33d859c8d98dfe0ddb3cbf6435357407d323e39f15682f7368df3"} Nov 02 21:54:10.082320 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:10.082260 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.059118545 podStartE2EDuration="2.082246317s" totalImagesPullingTime="0s" totalInitContainerRuntime="23.127772ms" isStatefulPod=false podCreationTimestamp="2026-11-02 21:54:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:54:10.081589422 +0000 UTC m=+22.333587902" watchObservedRunningTime="2026-11-02 21:54:10.082246317 +0000 UTC m=+22.334244781" Nov 02 21:54:10.672114 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:10.672078 5963 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:10.688393 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:10.688367 5963 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:10.833761 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:10.833724 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:54:11.051694 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:11.051588 5963 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:11.067169 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:11.067142 5963 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Nov 02 21:54:11.416955 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:11.416922 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:54:11.517527 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:11.517490 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:54:13.862859 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:13.862819 5963 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-7d6f59494d-bzp74" podUID="943a1337-2968-4104-aa18-90f3cd407ea0" containerName="console" containerID="cri-o://c57340be14a0d5866af6287ffecc149c30dc77300aecf2ce4dd32d0e9bf2af39" gracePeriod=15 Nov 02 21:54:14.064563 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:14.064532 5963 generic.go:356] "Generic (PLEG): container finished" podID="943a1337-2968-4104-aa18-90f3cd407ea0" containerID="c57340be14a0d5866af6287ffecc149c30dc77300aecf2ce4dd32d0e9bf2af39" exitCode=0 Nov 02 21:54:14.064777 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:14.064599 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d6f59494d-bzp74" event={"ID":"943a1337-2968-4104-aa18-90f3cd407ea0","Type":"ContainerDied","Data":"c57340be14a0d5866af6287ffecc149c30dc77300aecf2ce4dd32d0e9bf2af39"} Nov 02 21:54:14.144650 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:14.144573 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:54:14.303805 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:14.303770 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/943a1337-2968-4104-aa18-90f3cd407ea0-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/943a1337-2968-4104-aa18-90f3cd407ea0-console-serving-cert\") pod \"943a1337-2968-4104-aa18-90f3cd407ea0\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " Nov 02 21:54:14.303805 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:14.303812 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/943a1337-2968-4104-aa18-90f3cd407ea0-tmp\" (UniqueName: \"kubernetes.io/empty-dir/943a1337-2968-4104-aa18-90f3cd407ea0-tmp\") pod \"943a1337-2968-4104-aa18-90f3cd407ea0\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " Nov 02 21:54:14.304071 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:14.303865 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/943a1337-2968-4104-aa18-90f3cd407ea0-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/943a1337-2968-4104-aa18-90f3cd407ea0-oauth-serving-cert\") pod \"943a1337-2968-4104-aa18-90f3cd407ea0\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " Nov 02 21:54:14.304071 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:14.303907 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/943a1337-2968-4104-aa18-90f3cd407ea0-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/943a1337-2968-4104-aa18-90f3cd407ea0-console-oauth-config\") pod \"943a1337-2968-4104-aa18-90f3cd407ea0\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " Nov 02 21:54:14.304071 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:14.303932 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/943a1337-2968-4104-aa18-90f3cd407ea0-service-ca\" (UniqueName: \"kubernetes.io/configmap/943a1337-2968-4104-aa18-90f3cd407ea0-service-ca\") pod \"943a1337-2968-4104-aa18-90f3cd407ea0\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " Nov 02 21:54:14.304071 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:14.303974 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/943a1337-2968-4104-aa18-90f3cd407ea0-kube-api-access-4d9ln\" (UniqueName: \"kubernetes.io/projected/943a1337-2968-4104-aa18-90f3cd407ea0-kube-api-access-4d9ln\") pod \"943a1337-2968-4104-aa18-90f3cd407ea0\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " Nov 02 21:54:14.304071 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:14.304018 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/943a1337-2968-4104-aa18-90f3cd407ea0-console-config\" (UniqueName: \"kubernetes.io/configmap/943a1337-2968-4104-aa18-90f3cd407ea0-console-config\") pod \"943a1337-2968-4104-aa18-90f3cd407ea0\" (UID: \"943a1337-2968-4104-aa18-90f3cd407ea0\") " Nov 02 21:54:14.304318 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:14.304168 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/943a1337-2968-4104-aa18-90f3cd407ea0-tmp" pod "943a1337-2968-4104-aa18-90f3cd407ea0" (UID: "943a1337-2968-4104-aa18-90f3cd407ea0"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 21:54:14.304318 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:14.304276 5963 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/943a1337-2968-4104-aa18-90f3cd407ea0-tmp\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:14.304478 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:14.304455 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/943a1337-2968-4104-aa18-90f3cd407ea0-oauth-serving-cert" pod "943a1337-2968-4104-aa18-90f3cd407ea0" (UID: "943a1337-2968-4104-aa18-90f3cd407ea0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 21:54:14.304546 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:14.304468 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/943a1337-2968-4104-aa18-90f3cd407ea0-service-ca" pod "943a1337-2968-4104-aa18-90f3cd407ea0" (UID: "943a1337-2968-4104-aa18-90f3cd407ea0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 21:54:14.304546 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:14.304508 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/943a1337-2968-4104-aa18-90f3cd407ea0-console-config" pod "943a1337-2968-4104-aa18-90f3cd407ea0" (UID: "943a1337-2968-4104-aa18-90f3cd407ea0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 21:54:14.306435 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:14.306406 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/943a1337-2968-4104-aa18-90f3cd407ea0-console-oauth-config" pod "943a1337-2968-4104-aa18-90f3cd407ea0" (UID: "943a1337-2968-4104-aa18-90f3cd407ea0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 21:54:14.306561 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:14.306471 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/943a1337-2968-4104-aa18-90f3cd407ea0-kube-api-access-4d9ln" pod "943a1337-2968-4104-aa18-90f3cd407ea0" (UID: "943a1337-2968-4104-aa18-90f3cd407ea0"). InnerVolumeSpecName "kube-api-access-4d9ln". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 21:54:14.306561 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:14.306479 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/943a1337-2968-4104-aa18-90f3cd407ea0-console-serving-cert" pod "943a1337-2968-4104-aa18-90f3cd407ea0" (UID: "943a1337-2968-4104-aa18-90f3cd407ea0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 21:54:14.405063 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:14.404974 5963 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/943a1337-2968-4104-aa18-90f3cd407ea0-oauth-serving-cert\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:14.405063 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:14.405008 5963 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/943a1337-2968-4104-aa18-90f3cd407ea0-console-oauth-config\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:14.405063 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:14.405017 5963 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/943a1337-2968-4104-aa18-90f3cd407ea0-service-ca\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:14.405063 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:14.405026 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4d9ln\" (UniqueName: \"kubernetes.io/projected/943a1337-2968-4104-aa18-90f3cd407ea0-kube-api-access-4d9ln\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:14.405063 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:14.405035 5963 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/943a1337-2968-4104-aa18-90f3cd407ea0-console-config\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:14.405063 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:14.405044 5963 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/943a1337-2968-4104-aa18-90f3cd407ea0-console-serving-cert\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:15.069418 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:15.069383 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d6f59494d-bzp74" event={"ID":"943a1337-2968-4104-aa18-90f3cd407ea0","Type":"ContainerDied","Data":"c226e31ec99116e0934c2bef84809cbf3754c952d373ee11f2e5763a8f62c26c"} Nov 02 21:54:15.069840 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:15.069445 5963 scope.go:122] "RemoveContainer" containerID="c57340be14a0d5866af6287ffecc149c30dc77300aecf2ce4dd32d0e9bf2af39" Nov 02 21:54:15.069840 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:15.069395 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d6f59494d-bzp74" Nov 02 21:54:15.095440 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:15.091793 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d6f59494d-bzp74"] Nov 02 21:54:15.096719 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:15.096698 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d6f59494d-bzp74"] Nov 02 21:54:15.862910 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:15.862876 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="943a1337-2968-4104-aa18-90f3cd407ea0" path="/var/lib/kubelet/pods/943a1337-2968-4104-aa18-90f3cd407ea0/volumes" Nov 02 21:54:17.088096 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:17.088070 5963 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-747nn" Nov 02 21:54:21.641254 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:21.641195 5963 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-6bfc5dd8c9-24hxz" podUID="e2494f67-c3dd-4cc1-9035-da81cb1c6308" containerName="console" containerID="cri-o://5e91b554665cbe9b1716333bdf78b5c533305322c1cc1aec5f9cf6938b33461d" gracePeriod=15 Nov 02 21:54:21.889468 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:21.889445 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:54:21.963874 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:21.963786 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e2494f67-c3dd-4cc1-9035-da81cb1c6308-tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2494f67-c3dd-4cc1-9035-da81cb1c6308-tmp\") pod \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " Nov 02 21:54:21.963874 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:21.963841 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-trusted-ca-bundle\") pod \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " Nov 02 21:54:21.963874 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:21.963870 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e2494f67-c3dd-4cc1-9035-da81cb1c6308-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2494f67-c3dd-4cc1-9035-da81cb1c6308-console-serving-cert\") pod \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " Nov 02 21:54:21.964159 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:21.963886 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-oauth-serving-cert\") pod \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " Nov 02 21:54:21.964159 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:21.963912 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-console-config\" (UniqueName: \"kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-console-config\") pod \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " Nov 02 21:54:21.964159 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:21.963945 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e2494f67-c3dd-4cc1-9035-da81cb1c6308-kube-api-access-4wfn9\" (UniqueName: \"kubernetes.io/projected/e2494f67-c3dd-4cc1-9035-da81cb1c6308-kube-api-access-4wfn9\") pod \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " Nov 02 21:54:21.964159 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:21.964117 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2494f67-c3dd-4cc1-9035-da81cb1c6308-tmp" pod "e2494f67-c3dd-4cc1-9035-da81cb1c6308" (UID: "e2494f67-c3dd-4cc1-9035-da81cb1c6308"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 21:54:21.964357 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:21.964324 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-console-config" pod "e2494f67-c3dd-4cc1-9035-da81cb1c6308" (UID: "e2494f67-c3dd-4cc1-9035-da81cb1c6308"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 21:54:21.964407 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:21.964367 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-oauth-serving-cert" pod "e2494f67-c3dd-4cc1-9035-da81cb1c6308" (UID: "e2494f67-c3dd-4cc1-9035-da81cb1c6308"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 21:54:21.964407 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:21.964378 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-trusted-ca-bundle" pod "e2494f67-c3dd-4cc1-9035-da81cb1c6308" (UID: "e2494f67-c3dd-4cc1-9035-da81cb1c6308"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 21:54:21.966365 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:21.966340 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2494f67-c3dd-4cc1-9035-da81cb1c6308-console-serving-cert" pod "e2494f67-c3dd-4cc1-9035-da81cb1c6308" (UID: "e2494f67-c3dd-4cc1-9035-da81cb1c6308"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 21:54:21.966463 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:21.966380 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2494f67-c3dd-4cc1-9035-da81cb1c6308-kube-api-access-4wfn9" pod "e2494f67-c3dd-4cc1-9035-da81cb1c6308" (UID: "e2494f67-c3dd-4cc1-9035-da81cb1c6308"). InnerVolumeSpecName "kube-api-access-4wfn9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 21:54:22.064939 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:22.064902 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e2494f67-c3dd-4cc1-9035-da81cb1c6308-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2494f67-c3dd-4cc1-9035-da81cb1c6308-console-oauth-config\") pod \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " Nov 02 21:54:22.065111 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:22.064945 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-service-ca\") pod \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\" (UID: \"e2494f67-c3dd-4cc1-9035-da81cb1c6308\") " Nov 02 21:54:22.065160 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:22.065144 5963 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2494f67-c3dd-4cc1-9035-da81cb1c6308-console-serving-cert\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:22.065160 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:22.065157 5963 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-oauth-serving-cert\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:22.065250 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:22.065167 5963 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-console-config\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:22.065250 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:22.065177 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wfn9\" (UniqueName: \"kubernetes.io/projected/e2494f67-c3dd-4cc1-9035-da81cb1c6308-kube-api-access-4wfn9\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:22.065250 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:22.065202 5963 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2494f67-c3dd-4cc1-9035-da81cb1c6308-tmp\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:22.065250 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:22.065216 5963 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-trusted-ca-bundle\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:22.065370 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:22.065305 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-service-ca" pod "e2494f67-c3dd-4cc1-9035-da81cb1c6308" (UID: "e2494f67-c3dd-4cc1-9035-da81cb1c6308"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 21:54:22.067212 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:22.067190 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2494f67-c3dd-4cc1-9035-da81cb1c6308-console-oauth-config" pod "e2494f67-c3dd-4cc1-9035-da81cb1c6308" (UID: "e2494f67-c3dd-4cc1-9035-da81cb1c6308"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 21:54:22.096692 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:22.096648 5963 generic.go:356] "Generic (PLEG): container finished" podID="e2494f67-c3dd-4cc1-9035-da81cb1c6308" containerID="5e91b554665cbe9b1716333bdf78b5c533305322c1cc1aec5f9cf6938b33461d" exitCode=0 Nov 02 21:54:22.096863 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:22.096725 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bfc5dd8c9-24hxz" Nov 02 21:54:22.096863 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:22.096703 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bfc5dd8c9-24hxz" event={"ID":"e2494f67-c3dd-4cc1-9035-da81cb1c6308","Type":"ContainerDied","Data":"5e91b554665cbe9b1716333bdf78b5c533305322c1cc1aec5f9cf6938b33461d"} Nov 02 21:54:22.096863 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:22.096796 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bfc5dd8c9-24hxz" event={"ID":"e2494f67-c3dd-4cc1-9035-da81cb1c6308","Type":"ContainerDied","Data":"b32881df604a3e3309316929c6e7485ad735c819a5dbedfe2c87ccf1b6bccdf8"} Nov 02 21:54:22.096863 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:22.096816 5963 scope.go:122] "RemoveContainer" containerID="5e91b554665cbe9b1716333bdf78b5c533305322c1cc1aec5f9cf6938b33461d" Nov 02 21:54:22.105770 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:22.105749 5963 scope.go:122] "RemoveContainer" containerID="5e91b554665cbe9b1716333bdf78b5c533305322c1cc1aec5f9cf6938b33461d" Nov 02 21:54:22.106052 ip-10-0-139-99 kubenswrapper[5963]: E1102 21:54:22.106034 5963 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e91b554665cbe9b1716333bdf78b5c533305322c1cc1aec5f9cf6938b33461d\": container with ID starting with 5e91b554665cbe9b1716333bdf78b5c533305322c1cc1aec5f9cf6938b33461d not found: ID does not exist" containerID="5e91b554665cbe9b1716333bdf78b5c533305322c1cc1aec5f9cf6938b33461d" Nov 02 21:54:22.106111 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:22.106063 5963 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e91b554665cbe9b1716333bdf78b5c533305322c1cc1aec5f9cf6938b33461d"} err="failed to get container status \"5e91b554665cbe9b1716333bdf78b5c533305322c1cc1aec5f9cf6938b33461d\": rpc error: code = NotFound desc = could not find container \"5e91b554665cbe9b1716333bdf78b5c533305322c1cc1aec5f9cf6938b33461d\": container with ID starting with 5e91b554665cbe9b1716333bdf78b5c533305322c1cc1aec5f9cf6938b33461d not found: ID does not exist" Nov 02 21:54:22.117621 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:22.117598 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bfc5dd8c9-24hxz"] Nov 02 21:54:22.125968 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:22.125940 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6bfc5dd8c9-24hxz"] Nov 02 21:54:22.165991 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:22.165961 5963 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2494f67-c3dd-4cc1-9035-da81cb1c6308-console-oauth-config\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:22.165991 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:22.165987 5963 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2494f67-c3dd-4cc1-9035-da81cb1c6308-service-ca\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:54:23.863233 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:23.863198 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e2494f67-c3dd-4cc1-9035-da81cb1c6308" path="/var/lib/kubelet/pods/e2494f67-c3dd-4cc1-9035-da81cb1c6308/volumes" Nov 02 21:54:27.964408 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:27.964379 5963 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:54:27.968249 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:27.968231 5963 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-76cf56f7bc-r5j6d" Nov 02 21:54:28.397885 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:28.397844 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:54:28.499567 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:28.499527 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:54:28.784932 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:28.784837 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:54:28.884422 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:28.884391 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:54:29.123309 ip-10-0-139-99 kubenswrapper[5963]: E1102 21:54:29.123272 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 21:54:29.152345 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:29.152308 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:54:41.075982 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:41.075950 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:54:41.170184 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:41.170149 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:54:43.946115 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:43.946082 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:54:50.564547 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:50.564507 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:54:50.665485 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:50.665443 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:54:50.760153 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:50.760116 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:54:57.165921 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:54:57.165882 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:54:59.122313 ip-10-0-139-99 kubenswrapper[5963]: E1102 21:54:59.122276 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 21:55:25.216943 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:55:25.216893 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:55:25.312071 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:55:25.312025 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:55:29.122469 ip-10-0-139-99 kubenswrapper[5963]: E1102 21:55:29.122387 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 21:55:48.443639 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:55:48.443602 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:55:48.534792 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:55:48.534761 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:55:57.224022 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:55:57.223989 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:55:59.122373 ip-10-0-139-99 kubenswrapper[5963]: E1102 21:55:59.122336 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 21:56:09.633958 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:09.633921 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:56:09.734392 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:09.734348 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:56:15.947953 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:15.947915 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:56:22.526758 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:22.526717 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:56:23.057233 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:23.057197 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:56:23.152288 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:23.152250 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:56:29.122166 ip-10-0-139-99 kubenswrapper[5963]: E1102 21:56:29.122121 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 21:56:36.727781 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:36.727743 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:56:38.124918 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:38.124877 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:56:39.917744 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:39.917710 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:56:40.014025 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:40.013998 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:56:42.054299 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:42.054256 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:56:42.158280 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:42.158235 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:56:44.279116 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:44.279084 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:56:44.456100 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:44.456066 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:56:44.713770 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:44.713729 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:56:44.814929 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:44.814896 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:56:50.111205 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:50.111173 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:56:50.212354 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:50.212318 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:56:52.669710 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:52.669641 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:56:55.172608 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:55.172573 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-597b95cb84-nmxzq"] Nov 02 21:56:55.173113 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:55.173008 5963 cpu_manager.go:414] "containerMap: removing container" podUID="943a1337-2968-4104-aa18-90f3cd407ea0" containerName="console" Nov 02 21:56:55.173113 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:55.173022 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="943a1337-2968-4104-aa18-90f3cd407ea0" containerName="console" Nov 02 21:56:55.173113 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:55.173037 5963 cpu_manager.go:414] "containerMap: removing container" podUID="e2494f67-c3dd-4cc1-9035-da81cb1c6308" containerName="console" Nov 02 21:56:55.173113 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:55.173042 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e2494f67-c3dd-4cc1-9035-da81cb1c6308" containerName="console" Nov 02 21:56:55.173113 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:55.173104 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="943a1337-2968-4104-aa18-90f3cd407ea0" containerName="console" Nov 02 21:56:55.173113 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:55.173116 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="e2494f67-c3dd-4cc1-9035-da81cb1c6308" containerName="console" Nov 02 21:56:55.176040 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:55.176024 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-597b95cb84-nmxzq" Nov 02 21:56:55.179681 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:55.179643 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Nov 02 21:56:55.180562 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:55.180549 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Nov 02 21:56:55.180622 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:55.180603 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-tw9hv\"" Nov 02 21:56:55.186153 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:55.186134 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-597b95cb84-nmxzq"] Nov 02 21:56:55.334774 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:55.334741 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/386079c2-e3e9-4953-8385-2848daf47baa-bound-sa-token\") pod \"cert-manager-597b95cb84-nmxzq\" (UID: \"386079c2-e3e9-4953-8385-2848daf47baa\") " pod="cert-manager/cert-manager-597b95cb84-nmxzq" Nov 02 21:56:55.334932 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:55.334795 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z44k7\" (UniqueName: \"kubernetes.io/projected/386079c2-e3e9-4953-8385-2848daf47baa-kube-api-access-z44k7\") pod \"cert-manager-597b95cb84-nmxzq\" (UID: \"386079c2-e3e9-4953-8385-2848daf47baa\") " pod="cert-manager/cert-manager-597b95cb84-nmxzq" Nov 02 21:56:55.436136 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:55.436045 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/386079c2-e3e9-4953-8385-2848daf47baa-bound-sa-token\") pod \"cert-manager-597b95cb84-nmxzq\" (UID: \"386079c2-e3e9-4953-8385-2848daf47baa\") " pod="cert-manager/cert-manager-597b95cb84-nmxzq" Nov 02 21:56:55.436136 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:55.436113 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z44k7\" (UniqueName: \"kubernetes.io/projected/386079c2-e3e9-4953-8385-2848daf47baa-kube-api-access-z44k7\") pod \"cert-manager-597b95cb84-nmxzq\" (UID: \"386079c2-e3e9-4953-8385-2848daf47baa\") " pod="cert-manager/cert-manager-597b95cb84-nmxzq" Nov 02 21:56:55.448170 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:55.448140 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/386079c2-e3e9-4953-8385-2848daf47baa-bound-sa-token\") pod \"cert-manager-597b95cb84-nmxzq\" (UID: \"386079c2-e3e9-4953-8385-2848daf47baa\") " pod="cert-manager/cert-manager-597b95cb84-nmxzq" Nov 02 21:56:55.448294 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:55.448274 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z44k7\" (UniqueName: \"kubernetes.io/projected/386079c2-e3e9-4953-8385-2848daf47baa-kube-api-access-z44k7\") pod \"cert-manager-597b95cb84-nmxzq\" (UID: \"386079c2-e3e9-4953-8385-2848daf47baa\") " pod="cert-manager/cert-manager-597b95cb84-nmxzq" Nov 02 21:56:55.498223 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:55.498193 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-597b95cb84-nmxzq" Nov 02 21:56:55.769204 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:55.769135 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-597b95cb84-nmxzq"] Nov 02 21:56:55.772425 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:56:55.772398 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod386079c2_e3e9_4953_8385_2848daf47baa.slice/crio-2d30f4e9a313564809195203e0efd57eec8f95c79dce1d4091169fad0ba7bb6c WatchSource:0}: Error finding container 2d30f4e9a313564809195203e0efd57eec8f95c79dce1d4091169fad0ba7bb6c: Status 404 returned error can't find the container with id 2d30f4e9a313564809195203e0efd57eec8f95c79dce1d4091169fad0ba7bb6c Nov 02 21:56:55.774591 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:55.774568 5963 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 02 21:56:56.657111 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:56.657028 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-597b95cb84-nmxzq" event={"ID":"386079c2-e3e9-4953-8385-2848daf47baa","Type":"ContainerStarted","Data":"2d30f4e9a313564809195203e0efd57eec8f95c79dce1d4091169fad0ba7bb6c"} Nov 02 21:56:57.281217 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:57.281180 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:56:59.121976 ip-10-0-139-99 kubenswrapper[5963]: E1102 21:56:59.121939 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 21:56:59.670656 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:59.670622 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-597b95cb84-nmxzq" event={"ID":"386079c2-e3e9-4953-8385-2848daf47baa","Type":"ContainerStarted","Data":"bac5068bcb06bcb69e814385885da7c1d2a6624488776400e635fa32a6ea7005"} Nov 02 21:56:59.690211 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:59.690160 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-597b95cb84-nmxzq" podStartSLOduration=1.5422203319999999 podStartE2EDuration="4.690147755s" totalImagesPullingTime="3.147927423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 21:56:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:56:59.688579942 +0000 UTC m=+191.940578402" watchObservedRunningTime="2026-11-02 21:56:59.690147755 +0000 UTC m=+191.942146220" Nov 02 21:56:59.970105 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:56:59.970017 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:57:00.090007 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:00.089976 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:57:11.382883 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:11.382846 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:57:11.478159 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:11.478123 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:57:19.273095 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:19.273057 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:57:19.370549 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:19.370515 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:57:21.325931 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:21.325898 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:57:22.140469 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:22.140427 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:57:22.256631 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:22.256594 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:57:23.669838 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:23.669796 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:57:29.122141 ip-10-0-139-99 kubenswrapper[5963]: E1102 21:57:29.122107 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 21:57:40.359427 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:40.359390 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:57:41.506372 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:41.506324 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:57:45.235600 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:45.235567 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-84dd85c977-48r7t"] Nov 02 21:57:45.240438 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:45.240413 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-84dd85c977-48r7t" Nov 02 21:57:45.246186 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:45.246166 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-hwqtb\"" Nov 02 21:57:45.249541 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:45.249522 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Nov 02 21:57:45.249714 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:45.249594 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Nov 02 21:57:45.251024 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:45.251005 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-84dd85c977-48r7t"] Nov 02 21:57:45.251136 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:45.251124 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Nov 02 21:57:45.252418 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:45.252393 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:57:45.346599 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:45.346567 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Nov 02 21:57:45.355975 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:45.355949 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnj2g\" (UniqueName: \"kubernetes.io/projected/1dc4889e-804c-495f-8bdc-f66626310dcb-kube-api-access-nnj2g\") pod \"kubeflow-trainer-controller-manager-84dd85c977-48r7t\" (UID: \"1dc4889e-804c-495f-8bdc-f66626310dcb\") " pod="opendatahub/kubeflow-trainer-controller-manager-84dd85c977-48r7t" Nov 02 21:57:45.356123 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:45.355979 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1dc4889e-804c-495f-8bdc-f66626310dcb-cert\") pod \"kubeflow-trainer-controller-manager-84dd85c977-48r7t\" (UID: \"1dc4889e-804c-495f-8bdc-f66626310dcb\") " pod="opendatahub/kubeflow-trainer-controller-manager-84dd85c977-48r7t" Nov 02 21:57:45.356123 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:45.356023 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/1dc4889e-804c-495f-8bdc-f66626310dcb-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-84dd85c977-48r7t\" (UID: \"1dc4889e-804c-495f-8bdc-f66626310dcb\") " pod="opendatahub/kubeflow-trainer-controller-manager-84dd85c977-48r7t" Nov 02 21:57:45.360469 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:45.360445 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:57:45.457581 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:45.457550 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnj2g\" (UniqueName: \"kubernetes.io/projected/1dc4889e-804c-495f-8bdc-f66626310dcb-kube-api-access-nnj2g\") pod \"kubeflow-trainer-controller-manager-84dd85c977-48r7t\" (UID: \"1dc4889e-804c-495f-8bdc-f66626310dcb\") " pod="opendatahub/kubeflow-trainer-controller-manager-84dd85c977-48r7t" Nov 02 21:57:45.457581 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:45.457580 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1dc4889e-804c-495f-8bdc-f66626310dcb-cert\") pod \"kubeflow-trainer-controller-manager-84dd85c977-48r7t\" (UID: \"1dc4889e-804c-495f-8bdc-f66626310dcb\") " pod="opendatahub/kubeflow-trainer-controller-manager-84dd85c977-48r7t" Nov 02 21:57:45.457863 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:45.457719 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/1dc4889e-804c-495f-8bdc-f66626310dcb-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-84dd85c977-48r7t\" (UID: \"1dc4889e-804c-495f-8bdc-f66626310dcb\") " pod="opendatahub/kubeflow-trainer-controller-manager-84dd85c977-48r7t" Nov 02 21:57:45.458338 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:45.458321 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/1dc4889e-804c-495f-8bdc-f66626310dcb-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-84dd85c977-48r7t\" (UID: \"1dc4889e-804c-495f-8bdc-f66626310dcb\") " pod="opendatahub/kubeflow-trainer-controller-manager-84dd85c977-48r7t" Nov 02 21:57:45.459793 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:45.459768 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:57:45.460216 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:45.460195 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1dc4889e-804c-495f-8bdc-f66626310dcb-cert\") pod \"kubeflow-trainer-controller-manager-84dd85c977-48r7t\" (UID: \"1dc4889e-804c-495f-8bdc-f66626310dcb\") " pod="opendatahub/kubeflow-trainer-controller-manager-84dd85c977-48r7t" Nov 02 21:57:45.469961 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:45.469939 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnj2g\" (UniqueName: \"kubernetes.io/projected/1dc4889e-804c-495f-8bdc-f66626310dcb-kube-api-access-nnj2g\") pod \"kubeflow-trainer-controller-manager-84dd85c977-48r7t\" (UID: \"1dc4889e-804c-495f-8bdc-f66626310dcb\") " pod="opendatahub/kubeflow-trainer-controller-manager-84dd85c977-48r7t" Nov 02 21:57:45.553768 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:45.553754 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-84dd85c977-48r7t" Nov 02 21:57:45.824796 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:45.824728 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-84dd85c977-48r7t"] Nov 02 21:57:45.828267 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:57:45.828240 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1dc4889e_804c_495f_8bdc_f66626310dcb.slice/crio-9d4622f421c687cc9da12b1e6d42f87ff4413079737b12a786ecf3d4b40a91bc WatchSource:0}: Error finding container 9d4622f421c687cc9da12b1e6d42f87ff4413079737b12a786ecf3d4b40a91bc: Status 404 returned error can't find the container with id 9d4622f421c687cc9da12b1e6d42f87ff4413079737b12a786ecf3d4b40a91bc Nov 02 21:57:45.838341 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:45.838308 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-84dd85c977-48r7t" event={"ID":"1dc4889e-804c-495f-8bdc-f66626310dcb","Type":"ContainerStarted","Data":"9d4622f421c687cc9da12b1e6d42f87ff4413079737b12a786ecf3d4b40a91bc"} Nov 02 21:57:51.863761 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:51.863731 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-84dd85c977-48r7t" event={"ID":"1dc4889e-804c-495f-8bdc-f66626310dcb","Type":"ContainerStarted","Data":"f2867e30cf8d90eaecfa5d597904e24f23303ddc733de086ce479ce9ac19d056"} Nov 02 21:57:51.863761 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:51.863766 5963 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-84dd85c977-48r7t" Nov 02 21:57:51.883079 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:51.883025 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-84dd85c977-48r7t" podStartSLOduration=1.869410041 podStartE2EDuration="6.883013088s" totalImagesPullingTime="5.013603047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 21:57:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:57:51.881982451 +0000 UTC m=+244.133980943" watchObservedRunningTime="2026-11-02 21:57:51.883013088 +0000 UTC m=+244.135011554" Nov 02 21:57:53.033847 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:53.033811 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:57:53.127771 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:53.127735 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:57:57.332525 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:57:57.332484 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:57:59.123085 ip-10-0-139-99 kubenswrapper[5963]: E1102 21:57:59.123048 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 21:58:07.871088 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:58:07.871045 5963 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-84dd85c977-48r7t" Nov 02 21:58:12.234316 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:58:12.234282 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:58:12.424521 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:58:12.424458 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:58:21.323179 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:58:21.323143 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:58:22.811517 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:58:22.811476 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:58:22.912577 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:58:22.912544 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:58:24.818795 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:58:24.818758 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kueue-operator/openshift-kueue-operator-86d856df97-dm5tq"] Nov 02 21:58:24.824586 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:58:24.824564 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kueue-operator/openshift-kueue-operator-86d856df97-dm5tq" Nov 02 21:58:24.833296 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:58:24.833268 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kueue-operator/openshift-kueue-operator-86d856df97-dm5tq"] Nov 02 21:58:24.891768 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:58:24.891730 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccxtz\" (UniqueName: \"kubernetes.io/projected/513a8fcd-52cd-49d3-85cc-54235323d939-kube-api-access-ccxtz\") pod \"openshift-kueue-operator-86d856df97-dm5tq\" (UID: \"513a8fcd-52cd-49d3-85cc-54235323d939\") " pod="openshift-kueue-operator/openshift-kueue-operator-86d856df97-dm5tq" Nov 02 21:58:24.891768 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:58:24.891775 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/513a8fcd-52cd-49d3-85cc-54235323d939-tmp\") pod \"openshift-kueue-operator-86d856df97-dm5tq\" (UID: \"513a8fcd-52cd-49d3-85cc-54235323d939\") " pod="openshift-kueue-operator/openshift-kueue-operator-86d856df97-dm5tq" Nov 02 21:58:24.902065 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:58:24.902029 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kueue-operator\"/\"kube-root-ca.crt\"" Nov 02 21:58:24.902192 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:58:24.902103 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kueue-operator\"/\"openshift-service-ca.crt\"" Nov 02 21:58:24.902192 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:58:24.902110 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kueue-operator\"/\"openshift-kueue-operator-dockercfg-slj2d\"" Nov 02 21:58:24.992841 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:58:24.992807 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccxtz\" (UniqueName: \"kubernetes.io/projected/513a8fcd-52cd-49d3-85cc-54235323d939-kube-api-access-ccxtz\") pod \"openshift-kueue-operator-86d856df97-dm5tq\" (UID: \"513a8fcd-52cd-49d3-85cc-54235323d939\") " pod="openshift-kueue-operator/openshift-kueue-operator-86d856df97-dm5tq" Nov 02 21:58:24.993017 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:58:24.992848 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/513a8fcd-52cd-49d3-85cc-54235323d939-tmp\") pod \"openshift-kueue-operator-86d856df97-dm5tq\" (UID: \"513a8fcd-52cd-49d3-85cc-54235323d939\") " pod="openshift-kueue-operator/openshift-kueue-operator-86d856df97-dm5tq" Nov 02 21:58:24.993258 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:58:24.993242 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/513a8fcd-52cd-49d3-85cc-54235323d939-tmp\") pod \"openshift-kueue-operator-86d856df97-dm5tq\" (UID: \"513a8fcd-52cd-49d3-85cc-54235323d939\") " pod="openshift-kueue-operator/openshift-kueue-operator-86d856df97-dm5tq" Nov 02 21:58:25.007395 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:58:25.007367 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccxtz\" (UniqueName: \"kubernetes.io/projected/513a8fcd-52cd-49d3-85cc-54235323d939-kube-api-access-ccxtz\") pod \"openshift-kueue-operator-86d856df97-dm5tq\" (UID: \"513a8fcd-52cd-49d3-85cc-54235323d939\") " pod="openshift-kueue-operator/openshift-kueue-operator-86d856df97-dm5tq" Nov 02 21:58:25.136750 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:58:25.136642 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kueue-operator/openshift-kueue-operator-86d856df97-dm5tq" Nov 02 21:58:25.418302 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:58:25.418220 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kueue-operator/openshift-kueue-operator-86d856df97-dm5tq"] Nov 02 21:58:25.421542 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:58:25.421516 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod513a8fcd_52cd_49d3_85cc_54235323d939.slice/crio-cc2f917668150b338d8a4736f26c66942b7f8361a83ccd33bd95c1184fe7ae74 WatchSource:0}: Error finding container cc2f917668150b338d8a4736f26c66942b7f8361a83ccd33bd95c1184fe7ae74: Status 404 returned error can't find the container with id cc2f917668150b338d8a4736f26c66942b7f8361a83ccd33bd95c1184fe7ae74 Nov 02 21:58:25.987997 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:58:25.987961 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kueue-operator/openshift-kueue-operator-86d856df97-dm5tq" event={"ID":"513a8fcd-52cd-49d3-85cc-54235323d939","Type":"ContainerStarted","Data":"cc2f917668150b338d8a4736f26c66942b7f8361a83ccd33bd95c1184fe7ae74"} Nov 02 21:58:29.121051 ip-10-0-139-99 kubenswrapper[5963]: E1102 21:58:29.120976 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 21:58:34.020378 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:58:34.020337 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kueue-operator/openshift-kueue-operator-86d856df97-dm5tq" event={"ID":"513a8fcd-52cd-49d3-85cc-54235323d939","Type":"ContainerStarted","Data":"205b20300d3863bc21421ae45dcf3e4db1df7efade65418fb8805f1ba8e73866"} Nov 02 21:58:34.042684 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:58:34.042122 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kueue-operator/openshift-kueue-operator-86d856df97-dm5tq" podStartSLOduration=1.5126134869999999 podStartE2EDuration="10.042105054s" totalImagesPullingTime="8.529491567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 21:58:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:58:34.041837066 +0000 UTC m=+286.293835541" watchObservedRunningTime="2026-11-02 21:58:34.042105054 +0000 UTC m=+286.294103515" Nov 02 21:58:37.537034 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:58:37.537000 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:58:37.888029 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:58:37.887995 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:58:57.398468 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:58:57.398433 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:58:59.122224 ip-10-0-139-99 kubenswrapper[5963]: E1102 21:58:59.122188 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 21:59:05.929414 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:05.929379 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:59:06.007128 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:06.007064 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kueue-operator/kueue-controller-manager-584bfbcd45-chch4"] Nov 02 21:59:06.011621 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:06.011598 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kueue-operator/kueue-controller-manager-584bfbcd45-chch4" Nov 02 21:59:06.028790 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:06.028761 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kueue-operator/kueue-controller-manager-584bfbcd45-chch4"] Nov 02 21:59:06.033368 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:06.033327 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f0f0889-fd22-4c9d-b689-1676196376b2-cert\") pod \"kueue-controller-manager-584bfbcd45-chch4\" (UID: \"1f0f0889-fd22-4c9d-b689-1676196376b2\") " pod="openshift-kueue-operator/kueue-controller-manager-584bfbcd45-chch4" Nov 02 21:59:06.033368 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:06.033365 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6whzd\" (UniqueName: \"kubernetes.io/projected/1f0f0889-fd22-4c9d-b689-1676196376b2-kube-api-access-6whzd\") pod \"kueue-controller-manager-584bfbcd45-chch4\" (UID: \"1f0f0889-fd22-4c9d-b689-1676196376b2\") " pod="openshift-kueue-operator/kueue-controller-manager-584bfbcd45-chch4" Nov 02 21:59:06.033607 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:06.033395 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"visibility\" (UniqueName: \"kubernetes.io/secret/1f0f0889-fd22-4c9d-b689-1676196376b2-visibility\") pod \"kueue-controller-manager-584bfbcd45-chch4\" (UID: \"1f0f0889-fd22-4c9d-b689-1676196376b2\") " pod="openshift-kueue-operator/kueue-controller-manager-584bfbcd45-chch4" Nov 02 21:59:06.033607 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:06.033469 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f0f0889-fd22-4c9d-b689-1676196376b2-metrics-certs\") pod \"kueue-controller-manager-584bfbcd45-chch4\" (UID: \"1f0f0889-fd22-4c9d-b689-1676196376b2\") " pod="openshift-kueue-operator/kueue-controller-manager-584bfbcd45-chch4" Nov 02 21:59:06.033607 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:06.033572 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1f0f0889-fd22-4c9d-b689-1676196376b2-manager-config\") pod \"kueue-controller-manager-584bfbcd45-chch4\" (UID: \"1f0f0889-fd22-4c9d-b689-1676196376b2\") " pod="openshift-kueue-operator/kueue-controller-manager-584bfbcd45-chch4" Nov 02 21:59:06.037709 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:06.037657 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:59:06.098122 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:06.098089 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kueue-operator\"/\"kueue-manager-config\"" Nov 02 21:59:06.098122 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:06.098126 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kueue-operator\"/\"kueue-webhook-server-cert\"" Nov 02 21:59:06.098368 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:06.098169 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kueue-operator\"/\"kueue-visibility-server-cert\"" Nov 02 21:59:06.098368 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:06.098176 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kueue-operator\"/\"kueue-controller-manager-dockercfg-wm6xg\"" Nov 02 21:59:06.098368 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:06.098278 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kueue-operator\"/\"metrics-server-cert\"" Nov 02 21:59:06.134758 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:06.134716 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1f0f0889-fd22-4c9d-b689-1676196376b2-manager-config\") pod \"kueue-controller-manager-584bfbcd45-chch4\" (UID: \"1f0f0889-fd22-4c9d-b689-1676196376b2\") " pod="openshift-kueue-operator/kueue-controller-manager-584bfbcd45-chch4" Nov 02 21:59:06.134952 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:06.134819 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f0f0889-fd22-4c9d-b689-1676196376b2-cert\") pod \"kueue-controller-manager-584bfbcd45-chch4\" (UID: \"1f0f0889-fd22-4c9d-b689-1676196376b2\") " pod="openshift-kueue-operator/kueue-controller-manager-584bfbcd45-chch4" Nov 02 21:59:06.134952 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:06.134843 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6whzd\" (UniqueName: \"kubernetes.io/projected/1f0f0889-fd22-4c9d-b689-1676196376b2-kube-api-access-6whzd\") pod \"kueue-controller-manager-584bfbcd45-chch4\" (UID: \"1f0f0889-fd22-4c9d-b689-1676196376b2\") " pod="openshift-kueue-operator/kueue-controller-manager-584bfbcd45-chch4" Nov 02 21:59:06.134952 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:06.134884 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"visibility\" (UniqueName: \"kubernetes.io/secret/1f0f0889-fd22-4c9d-b689-1676196376b2-visibility\") pod \"kueue-controller-manager-584bfbcd45-chch4\" (UID: \"1f0f0889-fd22-4c9d-b689-1676196376b2\") " pod="openshift-kueue-operator/kueue-controller-manager-584bfbcd45-chch4" Nov 02 21:59:06.134952 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:06.134920 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f0f0889-fd22-4c9d-b689-1676196376b2-metrics-certs\") pod \"kueue-controller-manager-584bfbcd45-chch4\" (UID: \"1f0f0889-fd22-4c9d-b689-1676196376b2\") " pod="openshift-kueue-operator/kueue-controller-manager-584bfbcd45-chch4" Nov 02 21:59:06.135516 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:06.135491 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1f0f0889-fd22-4c9d-b689-1676196376b2-manager-config\") pod \"kueue-controller-manager-584bfbcd45-chch4\" (UID: \"1f0f0889-fd22-4c9d-b689-1676196376b2\") " pod="openshift-kueue-operator/kueue-controller-manager-584bfbcd45-chch4" Nov 02 21:59:06.138199 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:06.138173 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f0f0889-fd22-4c9d-b689-1676196376b2-cert\") pod \"kueue-controller-manager-584bfbcd45-chch4\" (UID: \"1f0f0889-fd22-4c9d-b689-1676196376b2\") " pod="openshift-kueue-operator/kueue-controller-manager-584bfbcd45-chch4" Nov 02 21:59:06.138317 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:06.138180 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f0f0889-fd22-4c9d-b689-1676196376b2-metrics-certs\") pod \"kueue-controller-manager-584bfbcd45-chch4\" (UID: \"1f0f0889-fd22-4c9d-b689-1676196376b2\") " pod="openshift-kueue-operator/kueue-controller-manager-584bfbcd45-chch4" Nov 02 21:59:06.138317 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:06.138243 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"visibility\" (UniqueName: \"kubernetes.io/secret/1f0f0889-fd22-4c9d-b689-1676196376b2-visibility\") pod \"kueue-controller-manager-584bfbcd45-chch4\" (UID: \"1f0f0889-fd22-4c9d-b689-1676196376b2\") " pod="openshift-kueue-operator/kueue-controller-manager-584bfbcd45-chch4" Nov 02 21:59:06.149486 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:06.149456 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6whzd\" (UniqueName: \"kubernetes.io/projected/1f0f0889-fd22-4c9d-b689-1676196376b2-kube-api-access-6whzd\") pod \"kueue-controller-manager-584bfbcd45-chch4\" (UID: \"1f0f0889-fd22-4c9d-b689-1676196376b2\") " pod="openshift-kueue-operator/kueue-controller-manager-584bfbcd45-chch4" Nov 02 21:59:06.331258 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:06.331218 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kueue-operator/kueue-controller-manager-584bfbcd45-chch4" Nov 02 21:59:06.624293 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:06.624206 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kueue-operator/kueue-controller-manager-584bfbcd45-chch4"] Nov 02 21:59:06.628705 ip-10-0-139-99 kubenswrapper[5963]: W1102 21:59:06.628679 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f0f0889_fd22_4c9d_b689_1676196376b2.slice/crio-f793494c0f09e504b52fb477f57ef101206411419f43bd58a6c4ec1d07b0de7f WatchSource:0}: Error finding container f793494c0f09e504b52fb477f57ef101206411419f43bd58a6c4ec1d07b0de7f: Status 404 returned error can't find the container with id f793494c0f09e504b52fb477f57ef101206411419f43bd58a6c4ec1d07b0de7f Nov 02 21:59:07.149786 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:07.149747 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kueue-operator/kueue-controller-manager-584bfbcd45-chch4" event={"ID":"1f0f0889-fd22-4c9d-b689-1676196376b2","Type":"ContainerStarted","Data":"f793494c0f09e504b52fb477f57ef101206411419f43bd58a6c4ec1d07b0de7f"} Nov 02 21:59:11.168113 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:11.168074 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kueue-operator/kueue-controller-manager-584bfbcd45-chch4" event={"ID":"1f0f0889-fd22-4c9d-b689-1676196376b2","Type":"ContainerStarted","Data":"d25a1104ba874dcf205ee6868620508e203affc38743e062474570e5c239b19a"} Nov 02 21:59:11.168590 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:11.168143 5963 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-kueue-operator/kueue-controller-manager-584bfbcd45-chch4" Nov 02 21:59:11.196315 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:11.196226 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kueue-operator/kueue-controller-manager-584bfbcd45-chch4" podStartSLOduration=2.070877637 podStartE2EDuration="6.196210465s" totalImagesPullingTime="4.125332828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 21:59:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:59:11.194953259 +0000 UTC m=+323.446951727" watchObservedRunningTime="2026-11-02 21:59:11.196210465 +0000 UTC m=+323.448208932" Nov 02 21:59:22.177719 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:22.177686 5963 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kueue-operator/kueue-controller-manager-584bfbcd45-chch4" Nov 02 21:59:22.928413 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:22.928377 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-kueue-operator/kueue-controller-manager-584bfbcd45-chch4"] Nov 02 21:59:22.928644 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:22.928563 5963 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-kueue-operator/kueue-controller-manager-584bfbcd45-chch4" podUID="1f0f0889-fd22-4c9d-b689-1676196376b2" containerName="manager" containerID="cri-o://d25a1104ba874dcf205ee6868620508e203affc38743e062474570e5c239b19a" gracePeriod=10 Nov 02 21:59:23.173646 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:23.173622 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kueue-operator/kueue-controller-manager-584bfbcd45-chch4" Nov 02 21:59:23.221924 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:23.221836 5963 generic.go:356] "Generic (PLEG): container finished" podID="1f0f0889-fd22-4c9d-b689-1676196376b2" containerID="d25a1104ba874dcf205ee6868620508e203affc38743e062474570e5c239b19a" exitCode=0 Nov 02 21:59:23.222299 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:23.221929 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kueue-operator/kueue-controller-manager-584bfbcd45-chch4" event={"ID":"1f0f0889-fd22-4c9d-b689-1676196376b2","Type":"ContainerDied","Data":"d25a1104ba874dcf205ee6868620508e203affc38743e062474570e5c239b19a"} Nov 02 21:59:23.222299 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:23.221944 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kueue-operator/kueue-controller-manager-584bfbcd45-chch4" Nov 02 21:59:23.222299 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:23.221984 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kueue-operator/kueue-controller-manager-584bfbcd45-chch4" event={"ID":"1f0f0889-fd22-4c9d-b689-1676196376b2","Type":"ContainerDied","Data":"f793494c0f09e504b52fb477f57ef101206411419f43bd58a6c4ec1d07b0de7f"} Nov 02 21:59:23.222299 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:23.222016 5963 scope.go:122] "RemoveContainer" containerID="d25a1104ba874dcf205ee6868620508e203affc38743e062474570e5c239b19a" Nov 02 21:59:23.230570 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:23.230549 5963 scope.go:122] "RemoveContainer" containerID="d25a1104ba874dcf205ee6868620508e203affc38743e062474570e5c239b19a" Nov 02 21:59:23.230900 ip-10-0-139-99 kubenswrapper[5963]: E1102 21:59:23.230879 5963 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d25a1104ba874dcf205ee6868620508e203affc38743e062474570e5c239b19a\": container with ID starting with d25a1104ba874dcf205ee6868620508e203affc38743e062474570e5c239b19a not found: ID does not exist" containerID="d25a1104ba874dcf205ee6868620508e203affc38743e062474570e5c239b19a" Nov 02 21:59:23.230983 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:23.230913 5963 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d25a1104ba874dcf205ee6868620508e203affc38743e062474570e5c239b19a"} err="failed to get container status \"d25a1104ba874dcf205ee6868620508e203affc38743e062474570e5c239b19a\": rpc error: code = NotFound desc = could not find container \"d25a1104ba874dcf205ee6868620508e203affc38743e062474570e5c239b19a\": container with ID starting with d25a1104ba874dcf205ee6868620508e203affc38743e062474570e5c239b19a not found: ID does not exist" Nov 02 21:59:23.283933 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:23.283895 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1f0f0889-fd22-4c9d-b689-1676196376b2-kube-api-access-6whzd\" (UniqueName: \"kubernetes.io/projected/1f0f0889-fd22-4c9d-b689-1676196376b2-kube-api-access-6whzd\") pod \"1f0f0889-fd22-4c9d-b689-1676196376b2\" (UID: \"1f0f0889-fd22-4c9d-b689-1676196376b2\") " Nov 02 21:59:23.284100 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:23.283953 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1f0f0889-fd22-4c9d-b689-1676196376b2-cert\" (UniqueName: \"kubernetes.io/secret/1f0f0889-fd22-4c9d-b689-1676196376b2-cert\") pod \"1f0f0889-fd22-4c9d-b689-1676196376b2\" (UID: \"1f0f0889-fd22-4c9d-b689-1676196376b2\") " Nov 02 21:59:23.284100 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:23.283999 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1f0f0889-fd22-4c9d-b689-1676196376b2-manager-config\" (UniqueName: \"kubernetes.io/configmap/1f0f0889-fd22-4c9d-b689-1676196376b2-manager-config\") pod \"1f0f0889-fd22-4c9d-b689-1676196376b2\" (UID: \"1f0f0889-fd22-4c9d-b689-1676196376b2\") " Nov 02 21:59:23.284100 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:23.284022 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1f0f0889-fd22-4c9d-b689-1676196376b2-metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f0f0889-fd22-4c9d-b689-1676196376b2-metrics-certs\") pod \"1f0f0889-fd22-4c9d-b689-1676196376b2\" (UID: \"1f0f0889-fd22-4c9d-b689-1676196376b2\") " Nov 02 21:59:23.284100 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:23.284081 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1f0f0889-fd22-4c9d-b689-1676196376b2-visibility\" (UniqueName: \"kubernetes.io/secret/1f0f0889-fd22-4c9d-b689-1676196376b2-visibility\") pod \"1f0f0889-fd22-4c9d-b689-1676196376b2\" (UID: \"1f0f0889-fd22-4c9d-b689-1676196376b2\") " Nov 02 21:59:23.286495 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:23.286458 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f0f0889-fd22-4c9d-b689-1676196376b2-cert" pod "1f0f0889-fd22-4c9d-b689-1676196376b2" (UID: "1f0f0889-fd22-4c9d-b689-1676196376b2"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 21:59:23.286630 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:23.286525 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f0f0889-fd22-4c9d-b689-1676196376b2-kube-api-access-6whzd" pod "1f0f0889-fd22-4c9d-b689-1676196376b2" (UID: "1f0f0889-fd22-4c9d-b689-1676196376b2"). InnerVolumeSpecName "kube-api-access-6whzd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 21:59:23.286760 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:23.286729 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f0f0889-fd22-4c9d-b689-1676196376b2-metrics-certs" pod "1f0f0889-fd22-4c9d-b689-1676196376b2" (UID: "1f0f0889-fd22-4c9d-b689-1676196376b2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 21:59:23.286822 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:23.286766 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f0f0889-fd22-4c9d-b689-1676196376b2-visibility" pod "1f0f0889-fd22-4c9d-b689-1676196376b2" (UID: "1f0f0889-fd22-4c9d-b689-1676196376b2"). InnerVolumeSpecName "visibility". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 21:59:23.289062 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:23.289040 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f0f0889-fd22-4c9d-b689-1676196376b2-manager-config" pod "1f0f0889-fd22-4c9d-b689-1676196376b2" (UID: "1f0f0889-fd22-4c9d-b689-1676196376b2"). InnerVolumeSpecName "manager-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 21:59:23.384636 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:23.384599 5963 reconciler_common.go:299] "Volume detached for volume \"visibility\" (UniqueName: \"kubernetes.io/secret/1f0f0889-fd22-4c9d-b689-1676196376b2-visibility\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:59:23.384636 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:23.384630 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6whzd\" (UniqueName: \"kubernetes.io/projected/1f0f0889-fd22-4c9d-b689-1676196376b2-kube-api-access-6whzd\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:59:23.384636 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:23.384640 5963 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f0f0889-fd22-4c9d-b689-1676196376b2-cert\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:59:23.384885 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:23.384649 5963 reconciler_common.go:299] "Volume detached for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1f0f0889-fd22-4c9d-b689-1676196376b2-manager-config\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:59:23.384885 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:23.384679 5963 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f0f0889-fd22-4c9d-b689-1676196376b2-metrics-certs\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 21:59:23.544645 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:23.544608 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-kueue-operator/kueue-controller-manager-584bfbcd45-chch4"] Nov 02 21:59:23.549603 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:23.549581 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-kueue-operator/kueue-controller-manager-584bfbcd45-chch4"] Nov 02 21:59:23.863674 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:23.863633 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1f0f0889-fd22-4c9d-b689-1676196376b2" path="/var/lib/kubelet/pods/1f0f0889-fd22-4c9d-b689-1676196376b2/volumes" Nov 02 21:59:29.122468 ip-10-0-139-99 kubenswrapper[5963]: E1102 21:59:29.122427 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 21:59:35.894286 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:35.894229 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:59:35.988867 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:35.988839 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:59:36.374987 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:36.374948 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:59:37.839380 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:37.839343 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:59:38.395540 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:38.395507 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:59:38.498584 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:38.498555 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:59:41.380310 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:41.380278 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:59:41.476156 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:41.476126 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:59:42.855378 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:42.855344 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:59:52.126207 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:52.126168 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:59:52.232626 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:52.232592 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:59:52.333229 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:52.333195 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:59:54.498920 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:54.498882 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:59:54.599747 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:54.599709 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:59:55.224521 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:55.224491 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-operators/nfs-provisioner-74bbcc8765-sqcwt"] Nov 02 21:59:55.224891 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:55.224878 5963 cpu_manager.go:414] "containerMap: removing container" podUID="1f0f0889-fd22-4c9d-b689-1676196376b2" containerName="manager" Nov 02 21:59:55.224949 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:55.224893 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1f0f0889-fd22-4c9d-b689-1676196376b2" containerName="manager" Nov 02 21:59:55.224985 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:55.224963 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="1f0f0889-fd22-4c9d-b689-1676196376b2" containerName="manager" Nov 02 21:59:55.230828 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:55.230807 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/nfs-provisioner-74bbcc8765-sqcwt" Nov 02 21:59:55.237892 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:55.237776 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-operators/nfs-provisioner-74bbcc8765-sqcwt"] Nov 02 21:59:55.237892 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:55.237821 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Nov 02 21:59:55.237892 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:55.237877 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Nov 02 21:59:55.238086 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:55.237962 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"nfs-provisioner-dockercfg-87d68\"" Nov 02 21:59:55.361164 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:55.361123 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:59:55.364179 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:55.364160 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8dlh\" (UniqueName: \"kubernetes.io/projected/a86e88d4-a899-433a-a83a-e59eba087dc6-kube-api-access-v8dlh\") pod \"nfs-provisioner-74bbcc8765-sqcwt\" (UID: \"a86e88d4-a899-433a-a83a-e59eba087dc6\") " pod="openshift-operators/nfs-provisioner-74bbcc8765-sqcwt" Nov 02 21:59:55.465536 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:55.465501 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8dlh\" (UniqueName: \"kubernetes.io/projected/a86e88d4-a899-433a-a83a-e59eba087dc6-kube-api-access-v8dlh\") pod \"nfs-provisioner-74bbcc8765-sqcwt\" (UID: \"a86e88d4-a899-433a-a83a-e59eba087dc6\") " pod="openshift-operators/nfs-provisioner-74bbcc8765-sqcwt" Nov 02 21:59:55.478293 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:55.478227 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8dlh\" (UniqueName: \"kubernetes.io/projected/a86e88d4-a899-433a-a83a-e59eba087dc6-kube-api-access-v8dlh\") pod \"nfs-provisioner-74bbcc8765-sqcwt\" (UID: \"a86e88d4-a899-433a-a83a-e59eba087dc6\") " pod="openshift-operators/nfs-provisioner-74bbcc8765-sqcwt" Nov 02 21:59:57.442478 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:57.442397 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 21:59:58.998102 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:58.998060 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-03e00caf-9d08-4487-9a67-8f9032c7b6ce\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0da9a0072befd1248\") pod \"nfs-provisioner-74bbcc8765-sqcwt\" (UID: \"a86e88d4-a899-433a-a83a-e59eba087dc6\") " pod="openshift-operators/nfs-provisioner-74bbcc8765-sqcwt" Nov 02 21:59:59.005456 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:59.005427 5963 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-03e00caf-9d08-4487-9a67-8f9032c7b6ce\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0da9a0072befd1248\") pod \"nfs-provisioner-74bbcc8765-sqcwt\" (UID: \"a86e88d4-a899-433a-a83a-e59eba087dc6\") device path: \"\"" pod="openshift-operators/nfs-provisioner-74bbcc8765-sqcwt" Nov 02 21:59:59.099091 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:59.099058 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-03e00caf-9d08-4487-9a67-8f9032c7b6ce\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0da9a0072befd1248\") pod \"nfs-provisioner-74bbcc8765-sqcwt\" (UID: \"a86e88d4-a899-433a-a83a-e59eba087dc6\") " pod="openshift-operators/nfs-provisioner-74bbcc8765-sqcwt" Nov 02 21:59:59.099233 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:59.099201 5963 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-03e00caf-9d08-4487-9a67-8f9032c7b6ce\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0da9a0072befd1248\") pod \"nfs-provisioner-74bbcc8765-sqcwt\" (UID: \"a86e88d4-a899-433a-a83a-e59eba087dc6\") DevicePath \"\"" pod="openshift-operators/nfs-provisioner-74bbcc8765-sqcwt" Nov 02 21:59:59.102801 ip-10-0-139-99 kubenswrapper[5963]: I1102 21:59:59.102780 5963 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-03e00caf-9d08-4487-9a67-8f9032c7b6ce\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0da9a0072befd1248\") pod \"nfs-provisioner-74bbcc8765-sqcwt\" (UID: \"a86e88d4-a899-433a-a83a-e59eba087dc6\") DevicePath \"csi-4e2105bc0aedb68935068edfcfd5d1a6d9d4c3e025588ca5f0455b23424639d8\"" pod="openshift-operators/nfs-provisioner-74bbcc8765-sqcwt" Nov 02 21:59:59.123835 ip-10-0-139-99 kubenswrapper[5963]: E1102 21:59:59.123802 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:00:01.118217 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:00:01.118178 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:00:02.320508 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:00:02.320478 5963 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-03e00caf-9d08-4487-9a67-8f9032c7b6ce\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0da9a0072befd1248\") pod \"nfs-provisioner-74bbcc8765-sqcwt\" (UID: \"a86e88d4-a899-433a-a83a-e59eba087dc6\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/0bc84af0ec5eee901f41286b2e078e93021afd51cc94edb394b9f6c77aac3043/globalmount\"" pod="openshift-operators/nfs-provisioner-74bbcc8765-sqcwt" Nov 02 22:00:02.334371 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:00:02.334348 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-03e00caf-9d08-4487-9a67-8f9032c7b6ce\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0da9a0072befd1248\") pod \"nfs-provisioner-74bbcc8765-sqcwt\" (UID: \"a86e88d4-a899-433a-a83a-e59eba087dc6\") " pod="openshift-operators/nfs-provisioner-74bbcc8765-sqcwt" Nov 02 22:00:02.443495 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:00:02.443451 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/nfs-provisioner-74bbcc8765-sqcwt" Nov 02 22:00:02.720066 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:00:02.720037 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-operators/nfs-provisioner-74bbcc8765-sqcwt"] Nov 02 22:00:02.723887 ip-10-0-139-99 kubenswrapper[5963]: W1102 22:00:02.723857 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda86e88d4_a899_433a_a83a_e59eba087dc6.slice/crio-24928c3c79b04e928fd84b9314775563217921a7e20f0a88aea5287e56254af5 WatchSource:0}: Error finding container 24928c3c79b04e928fd84b9314775563217921a7e20f0a88aea5287e56254af5: Status 404 returned error can't find the container with id 24928c3c79b04e928fd84b9314775563217921a7e20f0a88aea5287e56254af5 Nov 02 22:00:03.390903 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:00:03.390864 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-operators/nfs-provisioner-74bbcc8765-sqcwt" event={"ID":"a86e88d4-a899-433a-a83a-e59eba087dc6","Type":"ContainerStarted","Data":"24928c3c79b04e928fd84b9314775563217921a7e20f0a88aea5287e56254af5"} Nov 02 22:00:06.405690 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:00:06.405575 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-operators/nfs-provisioner-74bbcc8765-sqcwt" event={"ID":"a86e88d4-a899-433a-a83a-e59eba087dc6","Type":"ContainerStarted","Data":"01e42411e2b2188f1482eee15b85c13209c0a66d70d7dd41886a6812374cfa66"} Nov 02 22:00:06.425744 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:00:06.425683 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-operators/nfs-provisioner-74bbcc8765-sqcwt" podStartSLOduration=11.059774232 podStartE2EDuration="14.42564211s" totalImagesPullingTime="3.365867878s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 21:59:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:00:06.424970816 +0000 UTC m=+378.676969282" watchObservedRunningTime="2026-11-02 22:00:06.42564211 +0000 UTC m=+378.677640578" Nov 02 22:00:09.897573 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:00:09.897518 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:00:09.999124 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:00:09.999087 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:00:10.099246 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:00:10.099207 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:00:12.258213 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:00:12.258179 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:00:12.355922 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:00:12.355892 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:00:13.164881 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:00:13.164847 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:00:29.123917 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:00:29.123873 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:00:57.503341 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:00:57.503306 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:00:59.123203 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:00:59.123169 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:01:20.854378 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:01:20.854336 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:01:29.122484 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:01:29.122402 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:01:57.581478 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:01:57.581437 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:01:59.122098 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:01:59.122065 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:02:04.643518 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:02:04.643477 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:02:04.744370 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:02:04.744329 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:02:04.839579 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:02:04.839549 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-76vkn/e2e-test-torch-node-0-0-blwx4"] Nov 02 22:02:04.842869 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:02:04.842851 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-76vkn/e2e-test-torch-node-0-0-blwx4" Nov 02 22:02:04.845256 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:02:04.845232 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:02:04.846480 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:02:04.846455 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-76vkn\"/\"kube-root-ca.crt\"" Nov 02 22:02:04.847480 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:02:04.847464 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-76vkn\"/\"openshift-service-ca.crt\"" Nov 02 22:02:04.847544 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:02:04.847493 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-76vkn\"/\"default-dockercfg-pb2m4\"" Nov 02 22:02:04.852885 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:02:04.852861 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-76vkn/e2e-test-torch-node-0-0-blwx4"] Nov 02 22:02:04.863703 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:02:04.863683 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whr7v\" (UniqueName: \"kubernetes.io/projected/d3f6a6f1-37ee-4356-8b44-99b9200afb5f-kube-api-access-whr7v\") pod \"e2e-test-torch-node-0-0-blwx4\" (UID: \"d3f6a6f1-37ee-4356-8b44-99b9200afb5f\") " pod="e2e-76vkn/e2e-test-torch-node-0-0-blwx4" Nov 02 22:02:04.965125 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:02:04.965038 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whr7v\" (UniqueName: \"kubernetes.io/projected/d3f6a6f1-37ee-4356-8b44-99b9200afb5f-kube-api-access-whr7v\") pod \"e2e-test-torch-node-0-0-blwx4\" (UID: \"d3f6a6f1-37ee-4356-8b44-99b9200afb5f\") " pod="e2e-76vkn/e2e-test-torch-node-0-0-blwx4" Nov 02 22:02:04.977343 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:02:04.977321 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whr7v\" (UniqueName: \"kubernetes.io/projected/d3f6a6f1-37ee-4356-8b44-99b9200afb5f-kube-api-access-whr7v\") pod \"e2e-test-torch-node-0-0-blwx4\" (UID: \"d3f6a6f1-37ee-4356-8b44-99b9200afb5f\") " pod="e2e-76vkn/e2e-test-torch-node-0-0-blwx4" Nov 02 22:02:05.155523 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:02:05.155491 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-76vkn/e2e-test-torch-node-0-0-blwx4" Nov 02 22:02:05.428976 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:02:05.428951 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-76vkn/e2e-test-torch-node-0-0-blwx4"] Nov 02 22:02:05.432364 ip-10-0-139-99 kubenswrapper[5963]: W1102 22:02:05.432329 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd3f6a6f1_37ee_4356_8b44_99b9200afb5f.slice/crio-de19c27bf8ddc254c420b9a3ecc5864105d578b9f67466e87580895cebf480c2 WatchSource:0}: Error finding container de19c27bf8ddc254c420b9a3ecc5864105d578b9f67466e87580895cebf480c2: Status 404 returned error can't find the container with id de19c27bf8ddc254c420b9a3ecc5864105d578b9f67466e87580895cebf480c2 Nov 02 22:02:05.434390 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:02:05.434369 5963 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 02 22:02:05.857826 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:02:05.857789 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-76vkn/e2e-test-torch-node-0-0-blwx4" event={"ID":"d3f6a6f1-37ee-4356-8b44-99b9200afb5f","Type":"ContainerStarted","Data":"de19c27bf8ddc254c420b9a3ecc5864105d578b9f67466e87580895cebf480c2"} Nov 02 22:02:29.125729 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:02:29.125621 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:02:53.613322 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:02:53.613277 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:02:54.465069 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:02:54.465035 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:02:57.613025 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:02:57.612947 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:02:59.123222 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:02:59.123185 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:03:29.125657 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:03:29.125583 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:03:57.666830 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:03:57.666790 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:03:59.126049 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:03:59.126005 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:04:12.074733 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:04:12.074693 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:04:26.571649 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:04:26.571557 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:04:26.667922 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:04:26.667894 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:04:29.122260 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:04:29.122216 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:04:57.716261 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:04:57.716218 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:04:59.125329 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:04:59.125290 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:05:29.128329 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:05:29.128289 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:05:57.786042 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:05:57.785834 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:05:59.130156 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:05:59.130113 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:06:25.510087 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:06:25.510030 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:06:25.608109 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:06:25.608062 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:06:29.129182 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:06:29.129146 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:06:57.833182 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:06:57.833126 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:06:59.257771 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:06:59.257727 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:07:29.128365 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:07:29.128280 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:07:57.886890 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:07:57.886853 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:07:59.124735 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:07:59.124655 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:08:02.022922 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:08:02.022883 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:08:29.125270 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:08:29.125223 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:08:33.526519 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:08:33.526485 5963 generic.go:356] "Generic (PLEG): container finished" podID="d3f6a6f1-37ee-4356-8b44-99b9200afb5f" containerID="5ec5ef3092e7e58337809f3fd27ecf3a901d099a096f09a4d931ca21bbb70845" exitCode=0 Nov 02 22:08:33.526928 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:08:33.526574 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-76vkn/e2e-test-torch-node-0-0-blwx4" event={"ID":"d3f6a6f1-37ee-4356-8b44-99b9200afb5f","Type":"ContainerDied","Data":"5ec5ef3092e7e58337809f3fd27ecf3a901d099a096f09a4d931ca21bbb70845"} Nov 02 22:08:34.718241 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:08:34.718208 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-76vkn/e2e-test-torch-node-0-0-blwx4" Nov 02 22:08:34.862802 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:08:34.862770 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d3f6a6f1-37ee-4356-8b44-99b9200afb5f-kube-api-access-whr7v\" (UniqueName: \"kubernetes.io/projected/d3f6a6f1-37ee-4356-8b44-99b9200afb5f-kube-api-access-whr7v\") pod \"d3f6a6f1-37ee-4356-8b44-99b9200afb5f\" (UID: \"d3f6a6f1-37ee-4356-8b44-99b9200afb5f\") " Nov 02 22:08:34.865237 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:08:34.865219 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3f6a6f1-37ee-4356-8b44-99b9200afb5f-kube-api-access-whr7v" pod "d3f6a6f1-37ee-4356-8b44-99b9200afb5f" (UID: "d3f6a6f1-37ee-4356-8b44-99b9200afb5f"). InnerVolumeSpecName "kube-api-access-whr7v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 22:08:34.963387 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:08:34.963350 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whr7v\" (UniqueName: \"kubernetes.io/projected/d3f6a6f1-37ee-4356-8b44-99b9200afb5f-kube-api-access-whr7v\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:08:35.542140 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:08:35.542106 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-76vkn/e2e-test-torch-node-0-0-blwx4" Nov 02 22:08:35.542140 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:08:35.542121 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-76vkn/e2e-test-torch-node-0-0-blwx4" event={"ID":"d3f6a6f1-37ee-4356-8b44-99b9200afb5f","Type":"ContainerDied","Data":"de19c27bf8ddc254c420b9a3ecc5864105d578b9f67466e87580895cebf480c2"} Nov 02 22:08:35.542351 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:08:35.542155 5963 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de19c27bf8ddc254c420b9a3ecc5864105d578b9f67466e87580895cebf480c2" Nov 02 22:08:35.966682 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:08:35.966618 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:08:36.093329 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:08:36.093288 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:08:36.193154 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:08:36.193113 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:08:36.293969 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:08:36.293891 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:08:36.308592 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:08:36.308563 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-zjmw8/e2e-test-jax-node-0-0-s485n"] Nov 02 22:08:36.308954 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:08:36.308937 5963 cpu_manager.go:414] "containerMap: removing container" podUID="d3f6a6f1-37ee-4356-8b44-99b9200afb5f" containerName="node" Nov 02 22:08:36.309038 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:08:36.308956 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d3f6a6f1-37ee-4356-8b44-99b9200afb5f" containerName="node" Nov 02 22:08:36.309098 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:08:36.309076 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="d3f6a6f1-37ee-4356-8b44-99b9200afb5f" containerName="node" Nov 02 22:08:36.328212 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:08:36.328190 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-zjmw8/e2e-test-jax-node-0-0-s485n"] Nov 02 22:08:36.328356 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:08:36.328278 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-zjmw8/e2e-test-jax-node-0-0-s485n" Nov 02 22:08:36.335224 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:08:36.335202 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-zjmw8\"/\"kube-root-ca.crt\"" Nov 02 22:08:36.335348 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:08:36.335328 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-zjmw8\"/\"openshift-service-ca.crt\"" Nov 02 22:08:36.335399 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:08:36.335334 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-zjmw8\"/\"default-dockercfg-gsbfk\"" Nov 02 22:08:36.476617 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:08:36.476581 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7d92\" (UniqueName: \"kubernetes.io/projected/e310a57f-3379-4397-bb43-e1f50429f180-kube-api-access-q7d92\") pod \"e2e-test-jax-node-0-0-s485n\" (UID: \"e310a57f-3379-4397-bb43-e1f50429f180\") " pod="e2e-zjmw8/e2e-test-jax-node-0-0-s485n" Nov 02 22:08:36.577352 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:08:36.577320 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7d92\" (UniqueName: \"kubernetes.io/projected/e310a57f-3379-4397-bb43-e1f50429f180-kube-api-access-q7d92\") pod \"e2e-test-jax-node-0-0-s485n\" (UID: \"e310a57f-3379-4397-bb43-e1f50429f180\") " pod="e2e-zjmw8/e2e-test-jax-node-0-0-s485n" Nov 02 22:08:36.590088 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:08:36.590056 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7d92\" (UniqueName: \"kubernetes.io/projected/e310a57f-3379-4397-bb43-e1f50429f180-kube-api-access-q7d92\") pod \"e2e-test-jax-node-0-0-s485n\" (UID: \"e310a57f-3379-4397-bb43-e1f50429f180\") " pod="e2e-zjmw8/e2e-test-jax-node-0-0-s485n" Nov 02 22:08:36.653129 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:08:36.653092 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-zjmw8/e2e-test-jax-node-0-0-s485n" Nov 02 22:08:36.956517 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:08:36.956434 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-zjmw8/e2e-test-jax-node-0-0-s485n"] Nov 02 22:08:36.959253 ip-10-0-139-99 kubenswrapper[5963]: W1102 22:08:36.959223 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode310a57f_3379_4397_bb43_e1f50429f180.slice/crio-be65dcbb156894d9fdd28f08e23e08f5482a296b8d8cfa0a58f71556b0fb858b WatchSource:0}: Error finding container be65dcbb156894d9fdd28f08e23e08f5482a296b8d8cfa0a58f71556b0fb858b: Status 404 returned error can't find the container with id be65dcbb156894d9fdd28f08e23e08f5482a296b8d8cfa0a58f71556b0fb858b Nov 02 22:08:36.961997 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:08:36.961977 5963 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 02 22:08:37.552279 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:08:37.552246 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-zjmw8/e2e-test-jax-node-0-0-s485n" event={"ID":"e310a57f-3379-4397-bb43-e1f50429f180","Type":"ContainerStarted","Data":"be65dcbb156894d9fdd28f08e23e08f5482a296b8d8cfa0a58f71556b0fb858b"} Nov 02 22:08:40.903526 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:08:40.903483 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-76vkn/e2e-test-torch-node-0-0-blwx4"] Nov 02 22:08:40.907424 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:08:40.907396 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-76vkn/e2e-test-torch-node-0-0-blwx4"] Nov 02 22:08:41.594486 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:08:41.594447 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:08:41.865637 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:08:41.865337 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d3f6a6f1-37ee-4356-8b44-99b9200afb5f" path="/var/lib/kubelet/pods/d3f6a6f1-37ee-4356-8b44-99b9200afb5f/volumes" Nov 02 22:08:41.882182 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:08:41.882155 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:08:41.979423 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:08:41.979375 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:08:42.478048 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:08:42.478012 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:08:42.578160 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:08:42.578129 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:08:57.948380 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:08:57.948262 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:08:59.124882 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:08:59.124838 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:09:29.128561 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:09:29.128523 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:09:31.020835 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:09:31.020795 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:09:58.007161 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:09:58.007122 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:09:59.126790 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:09:59.126757 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:10:29.127241 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:10:29.127152 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:10:58.059597 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:10:58.059556 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:10:59.127937 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:10:59.127887 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:11:07.286476 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:07.286387 5963 generic.go:356] "Generic (PLEG): container finished" podID="e310a57f-3379-4397-bb43-e1f50429f180" containerID="9912c7d1883cd7744dcb6227dfa37d041cb77f59451760fc77813050d0699163" exitCode=0 Nov 02 22:11:07.286476 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:07.286461 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-zjmw8/e2e-test-jax-node-0-0-s485n" event={"ID":"e310a57f-3379-4397-bb43-e1f50429f180","Type":"ContainerDied","Data":"9912c7d1883cd7744dcb6227dfa37d041cb77f59451760fc77813050d0699163"} Nov 02 22:11:08.441208 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:08.441178 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-zjmw8/e2e-test-jax-node-0-0-s485n" Nov 02 22:11:08.488043 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:08.488008 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e310a57f-3379-4397-bb43-e1f50429f180-kube-api-access-q7d92\" (UniqueName: \"kubernetes.io/projected/e310a57f-3379-4397-bb43-e1f50429f180-kube-api-access-q7d92\") pod \"e310a57f-3379-4397-bb43-e1f50429f180\" (UID: \"e310a57f-3379-4397-bb43-e1f50429f180\") " Nov 02 22:11:08.490526 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:08.490499 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e310a57f-3379-4397-bb43-e1f50429f180-kube-api-access-q7d92" pod "e310a57f-3379-4397-bb43-e1f50429f180" (UID: "e310a57f-3379-4397-bb43-e1f50429f180"). InnerVolumeSpecName "kube-api-access-q7d92". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 22:11:08.588784 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:08.588742 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7d92\" (UniqueName: \"kubernetes.io/projected/e310a57f-3379-4397-bb43-e1f50429f180-kube-api-access-q7d92\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:11:09.295633 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:09.295598 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-zjmw8/e2e-test-jax-node-0-0-s485n" event={"ID":"e310a57f-3379-4397-bb43-e1f50429f180","Type":"ContainerDied","Data":"be65dcbb156894d9fdd28f08e23e08f5482a296b8d8cfa0a58f71556b0fb858b"} Nov 02 22:11:09.295850 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:09.295642 5963 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be65dcbb156894d9fdd28f08e23e08f5482a296b8d8cfa0a58f71556b0fb858b" Nov 02 22:11:09.295850 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:09.295605 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-zjmw8/e2e-test-jax-node-0-0-s485n" Nov 02 22:11:09.312606 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:11:09.312569 5963 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode310a57f_3379_4397_bb43_e1f50429f180.slice\": RecentStats: unable to find data in memory cache]" Nov 02 22:11:09.788306 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:09.788271 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:11:09.887504 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:09.887455 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:11:09.977800 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:09.977769 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-qh9q9/e2e-test-xgboost-node-0-0-jnkpl"] Nov 02 22:11:09.978127 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:09.978111 5963 cpu_manager.go:414] "containerMap: removing container" podUID="e310a57f-3379-4397-bb43-e1f50429f180" containerName="node" Nov 02 22:11:09.978169 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:09.978128 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e310a57f-3379-4397-bb43-e1f50429f180" containerName="node" Nov 02 22:11:09.978224 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:09.978213 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="e310a57f-3379-4397-bb43-e1f50429f180" containerName="node" Nov 02 22:11:09.991403 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:09.991363 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:11:10.055775 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:10.055737 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-qh9q9/e2e-test-xgboost-node-0-0-jnkpl"] Nov 02 22:11:10.055940 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:10.055848 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-qh9q9/e2e-test-xgboost-node-0-0-jnkpl" Nov 02 22:11:10.061786 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:10.061757 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-qh9q9\"/\"openshift-service-ca.crt\"" Nov 02 22:11:10.061786 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:10.061765 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-qh9q9\"/\"default-dockercfg-b67qd\"" Nov 02 22:11:10.061958 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:10.061798 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-qh9q9\"/\"kube-root-ca.crt\"" Nov 02 22:11:10.204147 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:10.204105 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw9rt\" (UniqueName: \"kubernetes.io/projected/56913eb5-9419-4b36-9fb4-b0b89c4dbf74-kube-api-access-hw9rt\") pod \"e2e-test-xgboost-node-0-0-jnkpl\" (UID: \"56913eb5-9419-4b36-9fb4-b0b89c4dbf74\") " pod="e2e-qh9q9/e2e-test-xgboost-node-0-0-jnkpl" Nov 02 22:11:10.305245 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:10.305211 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw9rt\" (UniqueName: \"kubernetes.io/projected/56913eb5-9419-4b36-9fb4-b0b89c4dbf74-kube-api-access-hw9rt\") pod \"e2e-test-xgboost-node-0-0-jnkpl\" (UID: \"56913eb5-9419-4b36-9fb4-b0b89c4dbf74\") " pod="e2e-qh9q9/e2e-test-xgboost-node-0-0-jnkpl" Nov 02 22:11:10.318266 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:10.318198 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw9rt\" (UniqueName: \"kubernetes.io/projected/56913eb5-9419-4b36-9fb4-b0b89c4dbf74-kube-api-access-hw9rt\") pod \"e2e-test-xgboost-node-0-0-jnkpl\" (UID: \"56913eb5-9419-4b36-9fb4-b0b89c4dbf74\") " pod="e2e-qh9q9/e2e-test-xgboost-node-0-0-jnkpl" Nov 02 22:11:10.391222 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:10.391180 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-qh9q9/e2e-test-xgboost-node-0-0-jnkpl" Nov 02 22:11:10.707276 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:10.707199 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-qh9q9/e2e-test-xgboost-node-0-0-jnkpl"] Nov 02 22:11:10.710719 ip-10-0-139-99 kubenswrapper[5963]: W1102 22:11:10.710692 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod56913eb5_9419_4b36_9fb4_b0b89c4dbf74.slice/crio-dd018ec42c5da332dfb3b1eeb30fa944bc7257c6138afe783b0cc3ea2d8a9959 WatchSource:0}: Error finding container dd018ec42c5da332dfb3b1eeb30fa944bc7257c6138afe783b0cc3ea2d8a9959: Status 404 returned error can't find the container with id dd018ec42c5da332dfb3b1eeb30fa944bc7257c6138afe783b0cc3ea2d8a9959 Nov 02 22:11:11.306643 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:11.306599 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-qh9q9/e2e-test-xgboost-node-0-0-jnkpl" event={"ID":"56913eb5-9419-4b36-9fb4-b0b89c4dbf74","Type":"ContainerStarted","Data":"dd018ec42c5da332dfb3b1eeb30fa944bc7257c6138afe783b0cc3ea2d8a9959"} Nov 02 22:11:14.698029 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:14.697990 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-zjmw8/e2e-test-jax-node-0-0-s485n"] Nov 02 22:11:14.703079 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:14.703018 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-zjmw8/e2e-test-jax-node-0-0-s485n"] Nov 02 22:11:14.925531 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:14.925494 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:11:15.761566 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:15.761525 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:11:15.863621 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:15.863577 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:11:15.865301 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:15.865270 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e310a57f-3379-4397-bb43-e1f50429f180" path="/var/lib/kubelet/pods/e310a57f-3379-4397-bb43-e1f50429f180/volumes" Nov 02 22:11:29.130112 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:11:29.130067 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:11:56.542468 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:56.542437 5963 generic.go:356] "Generic (PLEG): container finished" podID="56913eb5-9419-4b36-9fb4-b0b89c4dbf74" containerID="74408e6f3e7ba9c1b4451138b3b3ed84e66c2d7395db2e938bda1d669f49838d" exitCode=0 Nov 02 22:11:56.542966 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:56.542525 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-qh9q9/e2e-test-xgboost-node-0-0-jnkpl" event={"ID":"56913eb5-9419-4b36-9fb4-b0b89c4dbf74","Type":"ContainerDied","Data":"74408e6f3e7ba9c1b4451138b3b3ed84e66c2d7395db2e938bda1d669f49838d"} Nov 02 22:11:57.682189 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:57.682162 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-qh9q9/e2e-test-xgboost-node-0-0-jnkpl" Nov 02 22:11:57.750959 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:57.750923 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/56913eb5-9419-4b36-9fb4-b0b89c4dbf74-kube-api-access-hw9rt\" (UniqueName: \"kubernetes.io/projected/56913eb5-9419-4b36-9fb4-b0b89c4dbf74-kube-api-access-hw9rt\") pod \"56913eb5-9419-4b36-9fb4-b0b89c4dbf74\" (UID: \"56913eb5-9419-4b36-9fb4-b0b89c4dbf74\") " Nov 02 22:11:57.753359 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:57.753322 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56913eb5-9419-4b36-9fb4-b0b89c4dbf74-kube-api-access-hw9rt" pod "56913eb5-9419-4b36-9fb4-b0b89c4dbf74" (UID: "56913eb5-9419-4b36-9fb4-b0b89c4dbf74"). InnerVolumeSpecName "kube-api-access-hw9rt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 22:11:57.852418 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:57.852382 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hw9rt\" (UniqueName: \"kubernetes.io/projected/56913eb5-9419-4b36-9fb4-b0b89c4dbf74-kube-api-access-hw9rt\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:11:58.119793 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:58.119701 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:11:58.551510 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:58.551433 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-qh9q9/e2e-test-xgboost-node-0-0-jnkpl" Nov 02 22:11:58.551656 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:58.551438 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-qh9q9/e2e-test-xgboost-node-0-0-jnkpl" event={"ID":"56913eb5-9419-4b36-9fb4-b0b89c4dbf74","Type":"ContainerDied","Data":"dd018ec42c5da332dfb3b1eeb30fa944bc7257c6138afe783b0cc3ea2d8a9959"} Nov 02 22:11:58.551656 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:58.551547 5963 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd018ec42c5da332dfb3b1eeb30fa944bc7257c6138afe783b0cc3ea2d8a9959" Nov 02 22:11:59.024616 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:59.024570 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:11:59.123024 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:59.122990 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:11:59.124458 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:11:59.124432 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:11:59.134611 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:59.134579 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-wbnkc/e2e-test-flux-node-0-0-h6qpw"] Nov 02 22:11:59.135010 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:59.134993 5963 cpu_manager.go:414] "containerMap: removing container" podUID="56913eb5-9419-4b36-9fb4-b0b89c4dbf74" containerName="node" Nov 02 22:11:59.135114 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:59.135012 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="56913eb5-9419-4b36-9fb4-b0b89c4dbf74" containerName="node" Nov 02 22:11:59.135173 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:59.135121 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="56913eb5-9419-4b36-9fb4-b0b89c4dbf74" containerName="node" Nov 02 22:11:59.137355 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:59.137338 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-wbnkc/e2e-test-flux-node-0-0-h6qpw" Nov 02 22:11:59.143556 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:59.143534 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-wbnkc\"/\"e2e-test-flux-flux-entrypoint\"" Nov 02 22:11:59.143556 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:59.143550 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-wbnkc\"/\"default-dockercfg-bhn7n\"" Nov 02 22:11:59.143775 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:59.143557 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-wbnkc\"/\"openshift-service-ca.crt\"" Nov 02 22:11:59.143775 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:59.143559 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-wbnkc\"/\"e2e-test-flux-flux-curve\"" Nov 02 22:11:59.143775 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:59.143720 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-wbnkc\"/\"kube-root-ca.crt\"" Nov 02 22:11:59.148007 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:59.147987 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-wbnkc/e2e-test-flux-node-0-0-h6qpw"] Nov 02 22:11:59.224413 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:59.224371 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:11:59.263622 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:59.263581 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h74gc\" (UniqueName: \"kubernetes.io/projected/96a03575-45c4-4d29-90ef-3798bfaaf1e1-kube-api-access-h74gc\") pod \"e2e-test-flux-node-0-0-h6qpw\" (UID: \"96a03575-45c4-4d29-90ef-3798bfaaf1e1\") " pod="e2e-wbnkc/e2e-test-flux-node-0-0-h6qpw" Nov 02 22:11:59.263823 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:59.263643 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"flux-install\" (UniqueName: \"kubernetes.io/empty-dir/96a03575-45c4-4d29-90ef-3798bfaaf1e1-flux-install\") pod \"e2e-test-flux-node-0-0-h6qpw\" (UID: \"96a03575-45c4-4d29-90ef-3798bfaaf1e1\") " pod="e2e-wbnkc/e2e-test-flux-node-0-0-h6qpw" Nov 02 22:11:59.263823 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:59.263783 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"e2e-test-flux-flux-entrypoint\" (UniqueName: \"kubernetes.io/configmap/96a03575-45c4-4d29-90ef-3798bfaaf1e1-e2e-test-flux-flux-entrypoint\") pod \"e2e-test-flux-node-0-0-h6qpw\" (UID: \"96a03575-45c4-4d29-90ef-3798bfaaf1e1\") " pod="e2e-wbnkc/e2e-test-flux-node-0-0-h6qpw" Nov 02 22:11:59.263823 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:59.263820 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"shared-memory\" (UniqueName: \"kubernetes.io/empty-dir/96a03575-45c4-4d29-90ef-3798bfaaf1e1-shared-memory\") pod \"e2e-test-flux-node-0-0-h6qpw\" (UID: \"96a03575-45c4-4d29-90ef-3798bfaaf1e1\") " pod="e2e-wbnkc/e2e-test-flux-node-0-0-h6qpw" Nov 02 22:11:59.263930 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:59.263844 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spack-install\" (UniqueName: \"kubernetes.io/empty-dir/96a03575-45c4-4d29-90ef-3798bfaaf1e1-spack-install\") pod \"e2e-test-flux-node-0-0-h6qpw\" (UID: \"96a03575-45c4-4d29-90ef-3798bfaaf1e1\") " pod="e2e-wbnkc/e2e-test-flux-node-0-0-h6qpw" Nov 02 22:11:59.263965 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:59.263923 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"flux-curve\" (UniqueName: \"kubernetes.io/secret/96a03575-45c4-4d29-90ef-3798bfaaf1e1-flux-curve\") pod \"e2e-test-flux-node-0-0-h6qpw\" (UID: \"96a03575-45c4-4d29-90ef-3798bfaaf1e1\") " pod="e2e-wbnkc/e2e-test-flux-node-0-0-h6qpw" Nov 02 22:11:59.365295 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:59.365252 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"flux-curve\" (UniqueName: \"kubernetes.io/secret/96a03575-45c4-4d29-90ef-3798bfaaf1e1-flux-curve\") pod \"e2e-test-flux-node-0-0-h6qpw\" (UID: \"96a03575-45c4-4d29-90ef-3798bfaaf1e1\") " pod="e2e-wbnkc/e2e-test-flux-node-0-0-h6qpw" Nov 02 22:11:59.365467 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:59.365314 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h74gc\" (UniqueName: \"kubernetes.io/projected/96a03575-45c4-4d29-90ef-3798bfaaf1e1-kube-api-access-h74gc\") pod \"e2e-test-flux-node-0-0-h6qpw\" (UID: \"96a03575-45c4-4d29-90ef-3798bfaaf1e1\") " pod="e2e-wbnkc/e2e-test-flux-node-0-0-h6qpw" Nov 02 22:11:59.365467 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:59.365352 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"flux-install\" (UniqueName: \"kubernetes.io/empty-dir/96a03575-45c4-4d29-90ef-3798bfaaf1e1-flux-install\") pod \"e2e-test-flux-node-0-0-h6qpw\" (UID: \"96a03575-45c4-4d29-90ef-3798bfaaf1e1\") " pod="e2e-wbnkc/e2e-test-flux-node-0-0-h6qpw" Nov 02 22:11:59.365467 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:59.365369 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"e2e-test-flux-flux-entrypoint\" (UniqueName: \"kubernetes.io/configmap/96a03575-45c4-4d29-90ef-3798bfaaf1e1-e2e-test-flux-flux-entrypoint\") pod \"e2e-test-flux-node-0-0-h6qpw\" (UID: \"96a03575-45c4-4d29-90ef-3798bfaaf1e1\") " pod="e2e-wbnkc/e2e-test-flux-node-0-0-h6qpw" Nov 02 22:11:59.365467 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:59.365389 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"shared-memory\" (UniqueName: \"kubernetes.io/empty-dir/96a03575-45c4-4d29-90ef-3798bfaaf1e1-shared-memory\") pod \"e2e-test-flux-node-0-0-h6qpw\" (UID: \"96a03575-45c4-4d29-90ef-3798bfaaf1e1\") " pod="e2e-wbnkc/e2e-test-flux-node-0-0-h6qpw" Nov 02 22:11:59.365467 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:59.365410 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"spack-install\" (UniqueName: \"kubernetes.io/empty-dir/96a03575-45c4-4d29-90ef-3798bfaaf1e1-spack-install\") pod \"e2e-test-flux-node-0-0-h6qpw\" (UID: \"96a03575-45c4-4d29-90ef-3798bfaaf1e1\") " pod="e2e-wbnkc/e2e-test-flux-node-0-0-h6qpw" Nov 02 22:11:59.365887 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:59.365860 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"flux-install\" (UniqueName: \"kubernetes.io/empty-dir/96a03575-45c4-4d29-90ef-3798bfaaf1e1-flux-install\") pod \"e2e-test-flux-node-0-0-h6qpw\" (UID: \"96a03575-45c4-4d29-90ef-3798bfaaf1e1\") " pod="e2e-wbnkc/e2e-test-flux-node-0-0-h6qpw" Nov 02 22:11:59.365992 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:59.365929 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"spack-install\" (UniqueName: \"kubernetes.io/empty-dir/96a03575-45c4-4d29-90ef-3798bfaaf1e1-spack-install\") pod \"e2e-test-flux-node-0-0-h6qpw\" (UID: \"96a03575-45c4-4d29-90ef-3798bfaaf1e1\") " pod="e2e-wbnkc/e2e-test-flux-node-0-0-h6qpw" Nov 02 22:11:59.366271 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:59.366243 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"e2e-test-flux-flux-entrypoint\" (UniqueName: \"kubernetes.io/configmap/96a03575-45c4-4d29-90ef-3798bfaaf1e1-e2e-test-flux-flux-entrypoint\") pod \"e2e-test-flux-node-0-0-h6qpw\" (UID: \"96a03575-45c4-4d29-90ef-3798bfaaf1e1\") " pod="e2e-wbnkc/e2e-test-flux-node-0-0-h6qpw" Nov 02 22:11:59.367864 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:59.367842 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"shared-memory\" (UniqueName: \"kubernetes.io/empty-dir/96a03575-45c4-4d29-90ef-3798bfaaf1e1-shared-memory\") pod \"e2e-test-flux-node-0-0-h6qpw\" (UID: \"96a03575-45c4-4d29-90ef-3798bfaaf1e1\") " pod="e2e-wbnkc/e2e-test-flux-node-0-0-h6qpw" Nov 02 22:11:59.367959 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:59.367918 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"flux-curve\" (UniqueName: \"kubernetes.io/secret/96a03575-45c4-4d29-90ef-3798bfaaf1e1-flux-curve\") pod \"e2e-test-flux-node-0-0-h6qpw\" (UID: \"96a03575-45c4-4d29-90ef-3798bfaaf1e1\") " pod="e2e-wbnkc/e2e-test-flux-node-0-0-h6qpw" Nov 02 22:11:59.378100 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:59.378062 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h74gc\" (UniqueName: \"kubernetes.io/projected/96a03575-45c4-4d29-90ef-3798bfaaf1e1-kube-api-access-h74gc\") pod \"e2e-test-flux-node-0-0-h6qpw\" (UID: \"96a03575-45c4-4d29-90ef-3798bfaaf1e1\") " pod="e2e-wbnkc/e2e-test-flux-node-0-0-h6qpw" Nov 02 22:11:59.450616 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:59.450577 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-wbnkc/e2e-test-flux-node-0-0-h6qpw" Nov 02 22:11:59.742733 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:11:59.742624 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-wbnkc/e2e-test-flux-node-0-0-h6qpw"] Nov 02 22:11:59.746790 ip-10-0-139-99 kubenswrapper[5963]: W1102 22:11:59.746761 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96a03575_45c4_4d29_90ef_3798bfaaf1e1.slice/crio-c5607f9f94825fcee02fd5706dd3be982518a794f9f46f519f4f1dce44821db9 WatchSource:0}: Error finding container c5607f9f94825fcee02fd5706dd3be982518a794f9f46f519f4f1dce44821db9: Status 404 returned error can't find the container with id c5607f9f94825fcee02fd5706dd3be982518a794f9f46f519f4f1dce44821db9 Nov 02 22:12:00.563857 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:00.563816 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-wbnkc/e2e-test-flux-node-0-0-h6qpw" event={"ID":"96a03575-45c4-4d29-90ef-3798bfaaf1e1","Type":"ContainerStarted","Data":"c5607f9f94825fcee02fd5706dd3be982518a794f9f46f519f4f1dce44821db9"} Nov 02 22:12:03.974180 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:03.974137 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-qh9q9/e2e-test-xgboost-node-0-0-jnkpl"] Nov 02 22:12:03.993240 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:03.993207 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-qh9q9/e2e-test-xgboost-node-0-0-jnkpl"] Nov 02 22:12:04.544598 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:04.544567 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:12:05.175780 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:05.175723 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:12:05.288770 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:05.288725 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:12:05.865237 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:05.865203 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="56913eb5-9419-4b36-9fb4-b0b89c4dbf74" path="/var/lib/kubelet/pods/56913eb5-9419-4b36-9fb4-b0b89c4dbf74/volumes" Nov 02 22:12:13.636700 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:13.636650 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-wbnkc/e2e-test-flux-node-0-0-h6qpw" event={"ID":"96a03575-45c4-4d29-90ef-3798bfaaf1e1","Type":"ContainerStarted","Data":"2427855e6429299f76f5fe6afb3ba8a23660084b1fd71a43a5315e9998ca4940"} Nov 02 22:12:17.655505 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:17.655465 5963 generic.go:356] "Generic (PLEG): container finished" podID="96a03575-45c4-4d29-90ef-3798bfaaf1e1" containerID="2427855e6429299f76f5fe6afb3ba8a23660084b1fd71a43a5315e9998ca4940" exitCode=0 Nov 02 22:12:17.655941 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:17.655542 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-wbnkc/e2e-test-flux-node-0-0-h6qpw" event={"ID":"96a03575-45c4-4d29-90ef-3798bfaaf1e1","Type":"ContainerDied","Data":"2427855e6429299f76f5fe6afb3ba8a23660084b1fd71a43a5315e9998ca4940"} Nov 02 22:12:20.677179 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:20.677137 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-wbnkc/e2e-test-flux-node-0-0-h6qpw" event={"ID":"96a03575-45c4-4d29-90ef-3798bfaaf1e1","Type":"ContainerStarted","Data":"bbb36f7f99e4fd1c70f275dd3732960cdb0eb20c930786d6264f8987ab5283c1"} Nov 02 22:12:20.700240 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:20.700177 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-wbnkc/e2e-test-flux-node-0-0-h6qpw" podStartSLOduration=2.66049508 podStartE2EDuration="21.700160721s" totalImagesPullingTime="15.111927423s" totalInitContainerRuntime="3.927738218s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:11:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:12:20.698397542 +0000 UTC m=+1112.950396022" watchObservedRunningTime="2026-11-02 22:12:20.700160721 +0000 UTC m=+1112.952159188" Nov 02 22:12:27.711120 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:27.711088 5963 generic.go:356] "Generic (PLEG): container finished" podID="96a03575-45c4-4d29-90ef-3798bfaaf1e1" containerID="bbb36f7f99e4fd1c70f275dd3732960cdb0eb20c930786d6264f8987ab5283c1" exitCode=0 Nov 02 22:12:27.711531 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:27.711155 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-wbnkc/e2e-test-flux-node-0-0-h6qpw" event={"ID":"96a03575-45c4-4d29-90ef-3798bfaaf1e1","Type":"ContainerDied","Data":"bbb36f7f99e4fd1c70f275dd3732960cdb0eb20c930786d6264f8987ab5283c1"} Nov 02 22:12:28.855799 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:28.855766 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-wbnkc/e2e-test-flux-node-0-0-h6qpw" Nov 02 22:12:28.940903 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:28.940865 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/96a03575-45c4-4d29-90ef-3798bfaaf1e1-spack-install\" (UniqueName: \"kubernetes.io/empty-dir/96a03575-45c4-4d29-90ef-3798bfaaf1e1-spack-install\") pod \"96a03575-45c4-4d29-90ef-3798bfaaf1e1\" (UID: \"96a03575-45c4-4d29-90ef-3798bfaaf1e1\") " Nov 02 22:12:28.941076 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:28.940914 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/96a03575-45c4-4d29-90ef-3798bfaaf1e1-shared-memory\" (UniqueName: \"kubernetes.io/empty-dir/96a03575-45c4-4d29-90ef-3798bfaaf1e1-shared-memory\") pod \"96a03575-45c4-4d29-90ef-3798bfaaf1e1\" (UID: \"96a03575-45c4-4d29-90ef-3798bfaaf1e1\") " Nov 02 22:12:28.941076 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:28.940956 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/96a03575-45c4-4d29-90ef-3798bfaaf1e1-kube-api-access-h74gc\" (UniqueName: \"kubernetes.io/projected/96a03575-45c4-4d29-90ef-3798bfaaf1e1-kube-api-access-h74gc\") pod \"96a03575-45c4-4d29-90ef-3798bfaaf1e1\" (UID: \"96a03575-45c4-4d29-90ef-3798bfaaf1e1\") " Nov 02 22:12:28.941076 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:28.941016 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/96a03575-45c4-4d29-90ef-3798bfaaf1e1-flux-install\" (UniqueName: \"kubernetes.io/empty-dir/96a03575-45c4-4d29-90ef-3798bfaaf1e1-flux-install\") pod \"96a03575-45c4-4d29-90ef-3798bfaaf1e1\" (UID: \"96a03575-45c4-4d29-90ef-3798bfaaf1e1\") " Nov 02 22:12:28.941076 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:28.941056 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/96a03575-45c4-4d29-90ef-3798bfaaf1e1-e2e-test-flux-flux-entrypoint\" (UniqueName: \"kubernetes.io/configmap/96a03575-45c4-4d29-90ef-3798bfaaf1e1-e2e-test-flux-flux-entrypoint\") pod \"96a03575-45c4-4d29-90ef-3798bfaaf1e1\" (UID: \"96a03575-45c4-4d29-90ef-3798bfaaf1e1\") " Nov 02 22:12:28.941240 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:28.941089 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/96a03575-45c4-4d29-90ef-3798bfaaf1e1-flux-curve\" (UniqueName: \"kubernetes.io/secret/96a03575-45c4-4d29-90ef-3798bfaaf1e1-flux-curve\") pod \"96a03575-45c4-4d29-90ef-3798bfaaf1e1\" (UID: \"96a03575-45c4-4d29-90ef-3798bfaaf1e1\") " Nov 02 22:12:28.941536 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:28.941504 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96a03575-45c4-4d29-90ef-3798bfaaf1e1-e2e-test-flux-flux-entrypoint" pod "96a03575-45c4-4d29-90ef-3798bfaaf1e1" (UID: "96a03575-45c4-4d29-90ef-3798bfaaf1e1"). InnerVolumeSpecName "e2e-test-flux-flux-entrypoint". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 22:12:28.943577 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:28.943517 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96a03575-45c4-4d29-90ef-3798bfaaf1e1-kube-api-access-h74gc" pod "96a03575-45c4-4d29-90ef-3798bfaaf1e1" (UID: "96a03575-45c4-4d29-90ef-3798bfaaf1e1"). InnerVolumeSpecName "kube-api-access-h74gc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 22:12:28.943577 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:28.943519 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96a03575-45c4-4d29-90ef-3798bfaaf1e1-shared-memory" pod "96a03575-45c4-4d29-90ef-3798bfaaf1e1" (UID: "96a03575-45c4-4d29-90ef-3798bfaaf1e1"). InnerVolumeSpecName "shared-memory". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 22:12:28.943783 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:28.943584 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96a03575-45c4-4d29-90ef-3798bfaaf1e1-flux-curve" pod "96a03575-45c4-4d29-90ef-3798bfaaf1e1" (UID: "96a03575-45c4-4d29-90ef-3798bfaaf1e1"). InnerVolumeSpecName "flux-curve". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 22:12:29.042133 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:29.042050 5963 reconciler_common.go:299] "Volume detached for volume \"shared-memory\" (UniqueName: \"kubernetes.io/empty-dir/96a03575-45c4-4d29-90ef-3798bfaaf1e1-shared-memory\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:12:29.042133 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:29.042095 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h74gc\" (UniqueName: \"kubernetes.io/projected/96a03575-45c4-4d29-90ef-3798bfaaf1e1-kube-api-access-h74gc\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:12:29.042133 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:29.042111 5963 reconciler_common.go:299] "Volume detached for volume \"e2e-test-flux-flux-entrypoint\" (UniqueName: \"kubernetes.io/configmap/96a03575-45c4-4d29-90ef-3798bfaaf1e1-e2e-test-flux-flux-entrypoint\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:12:29.042133 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:29.042127 5963 reconciler_common.go:299] "Volume detached for volume \"flux-curve\" (UniqueName: \"kubernetes.io/secret/96a03575-45c4-4d29-90ef-3798bfaaf1e1-flux-curve\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:12:29.125501 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:12:29.125459 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:12:29.723226 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:29.723192 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-wbnkc/e2e-test-flux-node-0-0-h6qpw" Nov 02 22:12:29.723431 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:29.723191 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-wbnkc/e2e-test-flux-node-0-0-h6qpw" event={"ID":"96a03575-45c4-4d29-90ef-3798bfaaf1e1","Type":"ContainerDied","Data":"c5607f9f94825fcee02fd5706dd3be982518a794f9f46f519f4f1dce44821db9"} Nov 02 22:12:29.723431 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:29.723316 5963 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c5607f9f94825fcee02fd5706dd3be982518a794f9f46f519f4f1dce44821db9" Nov 02 22:12:29.855202 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:29.855164 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:12:29.946752 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:29.946714 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96a03575-45c4-4d29-90ef-3798bfaaf1e1-spack-install" pod "96a03575-45c4-4d29-90ef-3798bfaaf1e1" (UID: "96a03575-45c4-4d29-90ef-3798bfaaf1e1"). InnerVolumeSpecName "spack-install". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 22:12:29.949264 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:29.949234 5963 reconciler_common.go:299] "Volume detached for volume \"spack-install\" (UniqueName: \"kubernetes.io/empty-dir/96a03575-45c4-4d29-90ef-3798bfaaf1e1-spack-install\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:12:29.960186 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:29.960160 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:12:30.068910 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:30.068877 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:12:31.133628 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:31.133593 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:12:31.234570 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:31.234536 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:12:32.797675 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:32.797616 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96a03575-45c4-4d29-90ef-3798bfaaf1e1-flux-install" pod "96a03575-45c4-4d29-90ef-3798bfaaf1e1" (UID: "96a03575-45c4-4d29-90ef-3798bfaaf1e1"). InnerVolumeSpecName "flux-install". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 22:12:32.874819 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:32.874783 5963 reconciler_common.go:299] "Volume detached for volume \"flux-install\" (UniqueName: \"kubernetes.io/empty-dir/96a03575-45c4-4d29-90ef-3798bfaaf1e1-flux-install\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:12:34.808728 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:34.808696 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-wbnkc/e2e-test-flux-node-0-0-h6qpw"] Nov 02 22:12:34.813130 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:34.813105 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-wbnkc/e2e-test-flux-node-0-0-h6qpw"] Nov 02 22:12:35.350038 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:35.350010 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:12:35.863135 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:35.863103 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="96a03575-45c4-4d29-90ef-3798bfaaf1e1" path="/var/lib/kubelet/pods/96a03575-45c4-4d29-90ef-3798bfaaf1e1/volumes" Nov 02 22:12:35.975353 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:35.975320 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:12:36.075827 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:36.075782 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:12:36.176548 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:36.176458 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:12:36.895561 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:36.895518 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:12:36.993197 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:36.993166 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:12:46.217954 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:46.217918 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:12:46.298327 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:46.298291 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-rksdj/e2e-deadline-job-node-0-0-n4kj9"] Nov 02 22:12:46.298714 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:46.298701 5963 cpu_manager.go:414] "containerMap: removing container" podUID="96a03575-45c4-4d29-90ef-3798bfaaf1e1" containerName="flux-installer" Nov 02 22:12:46.298771 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:46.298717 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="96a03575-45c4-4d29-90ef-3798bfaaf1e1" containerName="flux-installer" Nov 02 22:12:46.298771 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:46.298727 5963 cpu_manager.go:414] "containerMap: removing container" podUID="96a03575-45c4-4d29-90ef-3798bfaaf1e1" containerName="node" Nov 02 22:12:46.298771 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:46.298733 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="96a03575-45c4-4d29-90ef-3798bfaaf1e1" containerName="node" Nov 02 22:12:46.298873 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:46.298799 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="96a03575-45c4-4d29-90ef-3798bfaaf1e1" containerName="node" Nov 02 22:12:46.318486 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:46.318426 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:12:46.367018 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:46.366985 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-rksdj/e2e-deadline-job-node-0-0-n4kj9"] Nov 02 22:12:46.367186 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:46.367090 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-rksdj/e2e-deadline-job-node-0-0-n4kj9" Nov 02 22:12:46.370801 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:46.370772 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-rksdj\"/\"openshift-service-ca.crt\"" Nov 02 22:12:46.372435 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:46.372416 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-rksdj\"/\"kube-root-ca.crt\"" Nov 02 22:12:46.372435 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:46.372430 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-rksdj\"/\"default-dockercfg-sw8nx\"" Nov 02 22:12:46.416833 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:46.416809 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:12:46.495713 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:46.495614 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgjgc\" (UniqueName: \"kubernetes.io/projected/5622f1a3-f030-4238-bcdb-38b9754dbde4-kube-api-access-dgjgc\") pod \"e2e-deadline-job-node-0-0-n4kj9\" (UID: \"5622f1a3-f030-4238-bcdb-38b9754dbde4\") " pod="e2e-rksdj/e2e-deadline-job-node-0-0-n4kj9" Nov 02 22:12:46.596484 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:46.596444 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgjgc\" (UniqueName: \"kubernetes.io/projected/5622f1a3-f030-4238-bcdb-38b9754dbde4-kube-api-access-dgjgc\") pod \"e2e-deadline-job-node-0-0-n4kj9\" (UID: \"5622f1a3-f030-4238-bcdb-38b9754dbde4\") " pod="e2e-rksdj/e2e-deadline-job-node-0-0-n4kj9" Nov 02 22:12:46.609185 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:46.609154 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgjgc\" (UniqueName: \"kubernetes.io/projected/5622f1a3-f030-4238-bcdb-38b9754dbde4-kube-api-access-dgjgc\") pod \"e2e-deadline-job-node-0-0-n4kj9\" (UID: \"5622f1a3-f030-4238-bcdb-38b9754dbde4\") " pod="e2e-rksdj/e2e-deadline-job-node-0-0-n4kj9" Nov 02 22:12:46.679255 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:46.679219 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-rksdj/e2e-deadline-job-node-0-0-n4kj9" Nov 02 22:12:46.953899 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:46.953868 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-rksdj/e2e-deadline-job-node-0-0-n4kj9"] Nov 02 22:12:46.957189 ip-10-0-139-99 kubenswrapper[5963]: W1102 22:12:46.957160 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5622f1a3_f030_4238_bcdb_38b9754dbde4.slice/crio-29478e50ee313ac61edba358d7d13e33df2059ffb4f26350dcc78c17052d9e49 WatchSource:0}: Error finding container 29478e50ee313ac61edba358d7d13e33df2059ffb4f26350dcc78c17052d9e49: Status 404 returned error can't find the container with id 29478e50ee313ac61edba358d7d13e33df2059ffb4f26350dcc78c17052d9e49 Nov 02 22:12:47.806934 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:47.806900 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-rksdj/e2e-deadline-job-node-0-0-n4kj9" event={"ID":"5622f1a3-f030-4238-bcdb-38b9754dbde4","Type":"ContainerStarted","Data":"83f58ebf711c365254a0af8158a6050070ccf157ccb3b29633a3dc770ca67138"} Nov 02 22:12:47.807318 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:47.806951 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-rksdj/e2e-deadline-job-node-0-0-n4kj9" event={"ID":"5622f1a3-f030-4238-bcdb-38b9754dbde4","Type":"ContainerStarted","Data":"29478e50ee313ac61edba358d7d13e33df2059ffb4f26350dcc78c17052d9e49"} Nov 02 22:12:47.827260 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:47.827201 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-rksdj/e2e-deadline-job-node-0-0-n4kj9" podStartSLOduration=1.328906525 podStartE2EDuration="1.827182621s" totalImagesPullingTime="498.276096ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:12:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:12:47.826716004 +0000 UTC m=+1140.078714469" watchObservedRunningTime="2026-11-02 22:12:47.827182621 +0000 UTC m=+1140.079181089" Nov 02 22:12:51.907097 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:51.907060 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:12:52.016773 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:52.016734 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:12:56.040650 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:56.040619 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-rksdj/e2e-deadline-job-node-0-0-n4kj9"] Nov 02 22:12:56.041128 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:56.040840 5963 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-rksdj/e2e-deadline-job-node-0-0-n4kj9" podUID="5622f1a3-f030-4238-bcdb-38b9754dbde4" containerName="node" containerID="cri-o://83f58ebf711c365254a0af8158a6050070ccf157ccb3b29633a3dc770ca67138" gracePeriod=30 Nov 02 22:12:56.092588 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:56.092552 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:12:56.200170 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:56.200134 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:12:56.300031 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:56.299956 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:12:56.320125 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:56.320091 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-z272c/e2e-test-runtime-update-node-0-0-75zst"] Nov 02 22:12:56.331054 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:56.331024 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-z272c/e2e-test-runtime-update-node-0-0-75zst" Nov 02 22:12:56.332807 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:56.332781 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-z272c/e2e-test-runtime-update-node-0-0-75zst"] Nov 02 22:12:56.334825 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:56.334802 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-z272c\"/\"openshift-service-ca.crt\"" Nov 02 22:12:56.334946 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:56.334832 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-z272c\"/\"kube-root-ca.crt\"" Nov 02 22:12:56.334946 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:56.334863 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-z272c\"/\"default-dockercfg-xx9kx\"" Nov 02 22:12:56.395459 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:56.395427 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:12:56.486622 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:56.486584 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk9gc\" (UniqueName: \"kubernetes.io/projected/94e8d61b-991f-4f11-be8b-9e244df9e367-kube-api-access-dk9gc\") pod \"e2e-test-runtime-update-node-0-0-75zst\" (UID: \"94e8d61b-991f-4f11-be8b-9e244df9e367\") " pod="e2e-z272c/e2e-test-runtime-update-node-0-0-75zst" Nov 02 22:12:56.587426 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:56.587389 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk9gc\" (UniqueName: \"kubernetes.io/projected/94e8d61b-991f-4f11-be8b-9e244df9e367-kube-api-access-dk9gc\") pod \"e2e-test-runtime-update-node-0-0-75zst\" (UID: \"94e8d61b-991f-4f11-be8b-9e244df9e367\") " pod="e2e-z272c/e2e-test-runtime-update-node-0-0-75zst" Nov 02 22:12:56.603290 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:56.603259 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk9gc\" (UniqueName: \"kubernetes.io/projected/94e8d61b-991f-4f11-be8b-9e244df9e367-kube-api-access-dk9gc\") pod \"e2e-test-runtime-update-node-0-0-75zst\" (UID: \"94e8d61b-991f-4f11-be8b-9e244df9e367\") " pod="e2e-z272c/e2e-test-runtime-update-node-0-0-75zst" Nov 02 22:12:56.610704 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:56.610677 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-z272c/e2e-test-runtime-update-node-0-0-75zst"] Nov 02 22:12:56.610889 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:56.610875 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-z272c/e2e-test-runtime-update-node-0-0-75zst" Nov 02 22:12:56.883955 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:56.883876 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-z272c/e2e-test-runtime-update-node-0-0-75zst"] Nov 02 22:12:56.888308 ip-10-0-139-99 kubenswrapper[5963]: W1102 22:12:56.888273 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94e8d61b_991f_4f11_be8b_9e244df9e367.slice/crio-df17acd88af7a25c1c70f4ae45c719bbabea072e3c6978b992ae44cafb6b94e9 WatchSource:0}: Error finding container df17acd88af7a25c1c70f4ae45c719bbabea072e3c6978b992ae44cafb6b94e9: Status 404 returned error can't find the container with id df17acd88af7a25c1c70f4ae45c719bbabea072e3c6978b992ae44cafb6b94e9 Nov 02 22:12:56.997475 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:56.997437 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-z272c/e2e-test-runtime-update-node-0-0-h4xk6"] Nov 02 22:12:57.002143 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:57.002122 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-z272c/e2e-test-runtime-update-node-0-0-h4xk6" Nov 02 22:12:57.009953 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:57.009932 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-z272c/e2e-test-runtime-update-node-0-0-h4xk6"] Nov 02 22:12:57.191862 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:57.191767 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd9hk\" (UniqueName: \"kubernetes.io/projected/e7944351-52e9-4643-8f4a-00e7cc1dff22-kube-api-access-xd9hk\") pod \"e2e-test-runtime-update-node-0-0-h4xk6\" (UID: \"e7944351-52e9-4643-8f4a-00e7cc1dff22\") " pod="e2e-z272c/e2e-test-runtime-update-node-0-0-h4xk6" Nov 02 22:12:57.281111 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:57.281076 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-z272c/e2e-test-runtime-update-node-0-0-h4xk6"] Nov 02 22:12:57.281302 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:12:57.281284 5963 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-xd9hk], unattached volumes=[], failed to process volumes=[]: context canceled" pod="e2e-z272c/e2e-test-runtime-update-node-0-0-h4xk6" podUID="e7944351-52e9-4643-8f4a-00e7cc1dff22" Nov 02 22:12:57.292587 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:57.292553 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd9hk\" (UniqueName: \"kubernetes.io/projected/e7944351-52e9-4643-8f4a-00e7cc1dff22-kube-api-access-xd9hk\") pod \"e2e-test-runtime-update-node-0-0-h4xk6\" (UID: \"e7944351-52e9-4643-8f4a-00e7cc1dff22\") " pod="e2e-z272c/e2e-test-runtime-update-node-0-0-h4xk6" Nov 02 22:12:57.295469 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:12:57.295446 5963 projected.go:196] Error preparing data for projected volume kube-api-access-xd9hk for pod e2e-z272c/e2e-test-runtime-update-node-0-0-h4xk6: failed to fetch token: serviceaccounts "default" is forbidden: unable to create new content in namespace e2e-z272c because it is being terminated Nov 02 22:12:57.295582 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:12:57.295533 5963 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7944351-52e9-4643-8f4a-00e7cc1dff22-kube-api-access-xd9hk podName:e7944351-52e9-4643-8f4a-00e7cc1dff22 nodeName:}" failed. No retries permitted until 2026-11-02 22:12:57.795510516 +0000 UTC m=+1150.047508980 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xd9hk" (UniqueName: "kubernetes.io/projected/e7944351-52e9-4643-8f4a-00e7cc1dff22-kube-api-access-xd9hk") pod "e2e-test-runtime-update-node-0-0-h4xk6" (UID: "e7944351-52e9-4643-8f4a-00e7cc1dff22") : failed to fetch token: serviceaccounts "default" is forbidden: unable to create new content in namespace e2e-z272c because it is being terminated Nov 02 22:12:57.337641 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:57.337601 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:12:57.435212 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:57.435177 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:12:57.486676 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:57.486582 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-fpl2m/e2e-test-runtime-update-node-0-0-swl2l"] Nov 02 22:12:57.490145 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:57.490125 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-fpl2m/e2e-test-runtime-update-node-0-0-swl2l" Nov 02 22:12:57.493786 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:57.493749 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-fpl2m\"/\"openshift-service-ca.crt\"" Nov 02 22:12:57.493902 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:57.493822 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-fpl2m\"/\"default-dockercfg-jr8rh\"" Nov 02 22:12:57.493902 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:57.493847 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-fpl2m\"/\"kube-root-ca.crt\"" Nov 02 22:12:57.501313 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:57.501288 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-fpl2m/e2e-test-runtime-update-node-0-0-swl2l"] Nov 02 22:12:57.534918 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:57.534883 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:12:57.595138 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:57.595099 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztjd5\" (UniqueName: \"kubernetes.io/projected/b3408e79-c0ec-46e6-9fee-b2edd9b5ea9c-kube-api-access-ztjd5\") pod \"e2e-test-runtime-update-node-0-0-swl2l\" (UID: \"b3408e79-c0ec-46e6-9fee-b2edd9b5ea9c\") " pod="e2e-fpl2m/e2e-test-runtime-update-node-0-0-swl2l" Nov 02 22:12:57.695728 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:57.695699 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztjd5\" (UniqueName: \"kubernetes.io/projected/b3408e79-c0ec-46e6-9fee-b2edd9b5ea9c-kube-api-access-ztjd5\") pod \"e2e-test-runtime-update-node-0-0-swl2l\" (UID: \"b3408e79-c0ec-46e6-9fee-b2edd9b5ea9c\") " pod="e2e-fpl2m/e2e-test-runtime-update-node-0-0-swl2l" Nov 02 22:12:57.707583 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:57.707557 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztjd5\" (UniqueName: \"kubernetes.io/projected/b3408e79-c0ec-46e6-9fee-b2edd9b5ea9c-kube-api-access-ztjd5\") pod \"e2e-test-runtime-update-node-0-0-swl2l\" (UID: \"b3408e79-c0ec-46e6-9fee-b2edd9b5ea9c\") " pod="e2e-fpl2m/e2e-test-runtime-update-node-0-0-swl2l" Nov 02 22:12:57.785905 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:57.785813 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-fpl2m/e2e-test-runtime-update-node-0-0-swl2l"] Nov 02 22:12:57.786074 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:57.786056 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-fpl2m/e2e-test-runtime-update-node-0-0-swl2l" Nov 02 22:12:57.796563 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:57.796539 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd9hk\" (UniqueName: \"kubernetes.io/projected/e7944351-52e9-4643-8f4a-00e7cc1dff22-kube-api-access-xd9hk\") pod \"e2e-test-runtime-update-node-0-0-h4xk6\" (UID: \"e7944351-52e9-4643-8f4a-00e7cc1dff22\") " pod="e2e-z272c/e2e-test-runtime-update-node-0-0-h4xk6" Nov 02 22:12:57.799333 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:12:57.799307 5963 projected.go:196] Error preparing data for projected volume kube-api-access-xd9hk for pod e2e-z272c/e2e-test-runtime-update-node-0-0-h4xk6: failed to fetch token: serviceaccounts "default" is forbidden: unable to create new content in namespace e2e-z272c because it is being terminated Nov 02 22:12:57.799466 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:12:57.799384 5963 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7944351-52e9-4643-8f4a-00e7cc1dff22-kube-api-access-xd9hk podName:e7944351-52e9-4643-8f4a-00e7cc1dff22 nodeName:}" failed. No retries permitted until 2026-11-02 22:12:58.79936014 +0000 UTC m=+1151.051358586 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xd9hk" (UniqueName: "kubernetes.io/projected/e7944351-52e9-4643-8f4a-00e7cc1dff22-kube-api-access-xd9hk") pod "e2e-test-runtime-update-node-0-0-h4xk6" (UID: "e7944351-52e9-4643-8f4a-00e7cc1dff22") : failed to fetch token: serviceaccounts "default" is forbidden: unable to create new content in namespace e2e-z272c because it is being terminated Nov 02 22:12:57.857981 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:57.857950 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-z272c/e2e-test-runtime-update-node-0-0-75zst" event={"ID":"94e8d61b-991f-4f11-be8b-9e244df9e367","Type":"ContainerStarted","Data":"4e1d675e9165e9732ff1af4d7b735ac28428a744d5de439f0b3dc691e5e58abe"} Nov 02 22:12:57.857981 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:57.857982 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-z272c/e2e-test-runtime-update-node-0-0-h4xk6" Nov 02 22:12:57.858202 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:57.857984 5963 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-z272c/e2e-test-runtime-update-node-0-0-75zst" podUID="94e8d61b-991f-4f11-be8b-9e244df9e367" containerName="node" containerID="cri-o://4e1d675e9165e9732ff1af4d7b735ac28428a744d5de439f0b3dc691e5e58abe" gracePeriod=30 Nov 02 22:12:57.858202 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:57.857993 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-z272c/e2e-test-runtime-update-node-0-0-75zst" event={"ID":"94e8d61b-991f-4f11-be8b-9e244df9e367","Type":"ContainerStarted","Data":"df17acd88af7a25c1c70f4ae45c719bbabea072e3c6978b992ae44cafb6b94e9"} Nov 02 22:12:57.868394 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:57.868374 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-z272c/e2e-test-runtime-update-node-0-0-h4xk6" Nov 02 22:12:57.875751 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:57.875695 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-z272c/e2e-test-runtime-update-node-0-0-75zst" podStartSLOduration=1.129408605 podStartE2EDuration="1.875648757s" totalImagesPullingTime="746.240152ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:12:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:12:57.874893178 +0000 UTC m=+1150.126891644" watchObservedRunningTime="2026-11-02 22:12:57.875648757 +0000 UTC m=+1150.127647224" Nov 02 22:12:58.061903 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.061873 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-fpl2m/e2e-test-runtime-update-node-0-0-swl2l"] Nov 02 22:12:58.066631 ip-10-0-139-99 kubenswrapper[5963]: W1102 22:12:58.066605 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3408e79_c0ec_46e6_9fee_b2edd9b5ea9c.slice/crio-5ccfc6aa7b45808de3dec948abcd252a0df8a444368c17bf89c727e3734f34df WatchSource:0}: Error finding container 5ccfc6aa7b45808de3dec948abcd252a0df8a444368c17bf89c727e3734f34df: Status 404 returned error can't find the container with id 5ccfc6aa7b45808de3dec948abcd252a0df8a444368c17bf89c727e3734f34df Nov 02 22:12:58.103025 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.103003 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-z272c/e2e-test-runtime-update-node-0-0-75zst" Nov 02 22:12:58.157564 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.157530 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:12:58.168318 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.168292 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-fpl2m/e2e-test-runtime-update-node-0-0-xq2cl"] Nov 02 22:12:58.168626 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.168614 5963 cpu_manager.go:414] "containerMap: removing container" podUID="94e8d61b-991f-4f11-be8b-9e244df9e367" containerName="node" Nov 02 22:12:58.168714 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.168627 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="94e8d61b-991f-4f11-be8b-9e244df9e367" containerName="node" Nov 02 22:12:58.168756 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.168720 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="94e8d61b-991f-4f11-be8b-9e244df9e367" containerName="node" Nov 02 22:12:58.171676 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.171642 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-fpl2m/e2e-test-runtime-update-node-0-0-xq2cl" Nov 02 22:12:58.181060 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.181037 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-fpl2m/e2e-test-runtime-update-node-0-0-xq2cl"] Nov 02 22:12:58.199121 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.199086 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/94e8d61b-991f-4f11-be8b-9e244df9e367-kube-api-access-dk9gc\" (UniqueName: \"kubernetes.io/projected/94e8d61b-991f-4f11-be8b-9e244df9e367-kube-api-access-dk9gc\") pod \"94e8d61b-991f-4f11-be8b-9e244df9e367\" (UID: \"94e8d61b-991f-4f11-be8b-9e244df9e367\") " Nov 02 22:12:58.201527 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.201501 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94e8d61b-991f-4f11-be8b-9e244df9e367-kube-api-access-dk9gc" pod "94e8d61b-991f-4f11-be8b-9e244df9e367" (UID: "94e8d61b-991f-4f11-be8b-9e244df9e367"). InnerVolumeSpecName "kube-api-access-dk9gc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 22:12:58.302836 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.302797 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2l2h\" (UniqueName: \"kubernetes.io/projected/edc3076c-6e3f-4b4f-b9bc-296566f944b9-kube-api-access-d2l2h\") pod \"e2e-test-runtime-update-node-0-0-xq2cl\" (UID: \"edc3076c-6e3f-4b4f-b9bc-296566f944b9\") " pod="e2e-fpl2m/e2e-test-runtime-update-node-0-0-xq2cl" Nov 02 22:12:58.303047 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.303001 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dk9gc\" (UniqueName: \"kubernetes.io/projected/94e8d61b-991f-4f11-be8b-9e244df9e367-kube-api-access-dk9gc\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:12:58.404152 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.404058 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2l2h\" (UniqueName: \"kubernetes.io/projected/edc3076c-6e3f-4b4f-b9bc-296566f944b9-kube-api-access-d2l2h\") pod \"e2e-test-runtime-update-node-0-0-xq2cl\" (UID: \"edc3076c-6e3f-4b4f-b9bc-296566f944b9\") " pod="e2e-fpl2m/e2e-test-runtime-update-node-0-0-xq2cl" Nov 02 22:12:58.416925 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.416901 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2l2h\" (UniqueName: \"kubernetes.io/projected/edc3076c-6e3f-4b4f-b9bc-296566f944b9-kube-api-access-d2l2h\") pod \"e2e-test-runtime-update-node-0-0-xq2cl\" (UID: \"edc3076c-6e3f-4b4f-b9bc-296566f944b9\") " pod="e2e-fpl2m/e2e-test-runtime-update-node-0-0-xq2cl" Nov 02 22:12:58.440495 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.440461 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-fpl2m/e2e-test-runtime-update-node-0-0-xq2cl"] Nov 02 22:12:58.440698 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.440657 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-fpl2m/e2e-test-runtime-update-node-0-0-xq2cl" Nov 02 22:12:58.501208 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.501163 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:12:58.604678 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.604636 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:12:58.714285 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.714246 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-fpl2m/e2e-test-runtime-update-node-0-0-xq2cl"] Nov 02 22:12:58.714788 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.714446 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:12:58.717548 ip-10-0-139-99 kubenswrapper[5963]: W1102 22:12:58.717521 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podedc3076c_6e3f_4b4f_b9bc_296566f944b9.slice/crio-f24283e2cfe196cda0c4864623b5b232c8ac6cb3541d41618acd3d62c0ba4e69 WatchSource:0}: Error finding container f24283e2cfe196cda0c4864623b5b232c8ac6cb3541d41618acd3d62c0ba4e69: Status 404 returned error can't find the container with id f24283e2cfe196cda0c4864623b5b232c8ac6cb3541d41618acd3d62c0ba4e69 Nov 02 22:12:58.774743 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.774715 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-s9sfm/progression-enabled-node-0-0-h92jq"] Nov 02 22:12:58.778144 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.778124 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-s9sfm/progression-enabled-node-0-0-h92jq" Nov 02 22:12:58.781768 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.781749 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-s9sfm\"/\"kube-root-ca.crt\"" Nov 02 22:12:58.782755 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.782735 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-s9sfm\"/\"openshift-service-ca.crt\"" Nov 02 22:12:58.782860 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.782740 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-s9sfm\"/\"default-dockercfg-x2tr8\"" Nov 02 22:12:58.788962 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.788941 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-s9sfm/progression-enabled-node-0-0-h92jq"] Nov 02 22:12:58.808369 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.808337 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd9hk\" (UniqueName: \"kubernetes.io/projected/e7944351-52e9-4643-8f4a-00e7cc1dff22-kube-api-access-xd9hk\") pod \"e2e-test-runtime-update-node-0-0-h4xk6\" (UID: \"e7944351-52e9-4643-8f4a-00e7cc1dff22\") " pod="e2e-z272c/e2e-test-runtime-update-node-0-0-h4xk6" Nov 02 22:12:58.810924 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:12:58.810901 5963 projected.go:196] Error preparing data for projected volume kube-api-access-xd9hk for pod e2e-z272c/e2e-test-runtime-update-node-0-0-h4xk6: failed to fetch token: serviceaccounts "default" is forbidden: unable to create new content in namespace e2e-z272c because it is being terminated Nov 02 22:12:58.811042 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:12:58.810970 5963 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7944351-52e9-4643-8f4a-00e7cc1dff22-kube-api-access-xd9hk podName:e7944351-52e9-4643-8f4a-00e7cc1dff22 nodeName:}" failed. No retries permitted until 2026-11-02 22:13:00.810952625 +0000 UTC m=+1153.062951083 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xd9hk" (UniqueName: "kubernetes.io/projected/e7944351-52e9-4643-8f4a-00e7cc1dff22-kube-api-access-xd9hk") pod "e2e-test-runtime-update-node-0-0-h4xk6" (UID: "e7944351-52e9-4643-8f4a-00e7cc1dff22") : failed to fetch token: serviceaccounts "default" is forbidden: unable to create new content in namespace e2e-z272c because it is being terminated Nov 02 22:12:58.831143 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.831108 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:12:58.865360 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.865316 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-fpl2m/e2e-test-runtime-update-node-0-0-xq2cl" event={"ID":"edc3076c-6e3f-4b4f-b9bc-296566f944b9","Type":"ContainerStarted","Data":"4dd7d2f6751d55b0873bdf6e688a49ac0e99f95c2c536095fb0ad0fe26758d99"} Nov 02 22:12:58.865360 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.865339 5963 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-fpl2m/e2e-test-runtime-update-node-0-0-xq2cl" podUID="edc3076c-6e3f-4b4f-b9bc-296566f944b9" containerName="node" containerID="cri-o://4dd7d2f6751d55b0873bdf6e688a49ac0e99f95c2c536095fb0ad0fe26758d99" gracePeriod=30 Nov 02 22:12:58.865360 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.865367 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-fpl2m/e2e-test-runtime-update-node-0-0-xq2cl" event={"ID":"edc3076c-6e3f-4b4f-b9bc-296566f944b9","Type":"ContainerStarted","Data":"f24283e2cfe196cda0c4864623b5b232c8ac6cb3541d41618acd3d62c0ba4e69"} Nov 02 22:12:58.866774 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.866746 5963 generic.go:356] "Generic (PLEG): container finished" podID="94e8d61b-991f-4f11-be8b-9e244df9e367" containerID="4e1d675e9165e9732ff1af4d7b735ac28428a744d5de439f0b3dc691e5e58abe" exitCode=0 Nov 02 22:12:58.866905 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.866810 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-z272c/e2e-test-runtime-update-node-0-0-75zst" Nov 02 22:12:58.866905 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.866837 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-z272c/e2e-test-runtime-update-node-0-0-75zst" event={"ID":"94e8d61b-991f-4f11-be8b-9e244df9e367","Type":"ContainerDied","Data":"4e1d675e9165e9732ff1af4d7b735ac28428a744d5de439f0b3dc691e5e58abe"} Nov 02 22:12:58.866905 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.866868 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-z272c/e2e-test-runtime-update-node-0-0-75zst" event={"ID":"94e8d61b-991f-4f11-be8b-9e244df9e367","Type":"ContainerDied","Data":"df17acd88af7a25c1c70f4ae45c719bbabea072e3c6978b992ae44cafb6b94e9"} Nov 02 22:12:58.866905 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.866894 5963 scope.go:122] "RemoveContainer" containerID="4e1d675e9165e9732ff1af4d7b735ac28428a744d5de439f0b3dc691e5e58abe" Nov 02 22:12:58.868654 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.868634 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-z272c/e2e-test-runtime-update-node-0-0-h4xk6" Nov 02 22:12:58.868972 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.868945 5963 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-fpl2m/e2e-test-runtime-update-node-0-0-swl2l" podUID="b3408e79-c0ec-46e6-9fee-b2edd9b5ea9c" containerName="node" containerID="cri-o://311d2d3a7abb0b3a320a2c3e64561652ebb48401ab4fc5f7b600e3b06e2774d2" gracePeriod=30 Nov 02 22:12:58.869287 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.869260 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-fpl2m/e2e-test-runtime-update-node-0-0-swl2l" event={"ID":"b3408e79-c0ec-46e6-9fee-b2edd9b5ea9c","Type":"ContainerStarted","Data":"311d2d3a7abb0b3a320a2c3e64561652ebb48401ab4fc5f7b600e3b06e2774d2"} Nov 02 22:12:58.869287 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.869298 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-fpl2m/e2e-test-runtime-update-node-0-0-swl2l" event={"ID":"b3408e79-c0ec-46e6-9fee-b2edd9b5ea9c","Type":"ContainerStarted","Data":"5ccfc6aa7b45808de3dec948abcd252a0df8a444368c17bf89c727e3734f34df"} Nov 02 22:12:58.881433 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.881412 5963 scope.go:122] "RemoveContainer" containerID="4e1d675e9165e9732ff1af4d7b735ac28428a744d5de439f0b3dc691e5e58abe" Nov 02 22:12:58.882409 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:12:58.882386 5963 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e1d675e9165e9732ff1af4d7b735ac28428a744d5de439f0b3dc691e5e58abe\": container with ID starting with 4e1d675e9165e9732ff1af4d7b735ac28428a744d5de439f0b3dc691e5e58abe not found: ID does not exist" containerID="4e1d675e9165e9732ff1af4d7b735ac28428a744d5de439f0b3dc691e5e58abe" Nov 02 22:12:58.882508 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.882422 5963 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e1d675e9165e9732ff1af4d7b735ac28428a744d5de439f0b3dc691e5e58abe"} err="failed to get container status \"4e1d675e9165e9732ff1af4d7b735ac28428a744d5de439f0b3dc691e5e58abe\": rpc error: code = NotFound desc = could not find container \"4e1d675e9165e9732ff1af4d7b735ac28428a744d5de439f0b3dc691e5e58abe\": container with ID starting with 4e1d675e9165e9732ff1af4d7b735ac28428a744d5de439f0b3dc691e5e58abe not found: ID does not exist" Nov 02 22:12:58.882726 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.882681 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-fpl2m/e2e-test-runtime-update-node-0-0-xq2cl" podStartSLOduration=0.882649433 podStartE2EDuration="882.649433ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:12:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:12:58.881609764 +0000 UTC m=+1151.133608223" watchObservedRunningTime="2026-11-02 22:12:58.882649433 +0000 UTC m=+1151.134647899" Nov 02 22:12:58.902071 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.901982 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-fpl2m/e2e-test-runtime-update-node-0-0-swl2l" podStartSLOduration=1.901963734 podStartE2EDuration="1.901963734s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:12:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:12:58.901200232 +0000 UTC m=+1151.153198698" watchObservedRunningTime="2026-11-02 22:12:58.901963734 +0000 UTC m=+1151.153962202" Nov 02 22:12:58.908883 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.908829 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzjh6\" (UniqueName: \"kubernetes.io/projected/93b42983-fb9f-4514-92f6-a1e16b43fb6b-kube-api-access-gzjh6\") pod \"progression-enabled-node-0-0-h92jq\" (UID: \"93b42983-fb9f-4514-92f6-a1e16b43fb6b\") " pod="rhai-e2e-progression-s9sfm/progression-enabled-node-0-0-h92jq" Nov 02 22:12:58.984170 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.984143 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-z272c/e2e-test-runtime-update-node-0-0-75zst"] Nov 02 22:12:58.988230 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:58.988200 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-z272c/e2e-test-runtime-update-node-0-0-75zst"] Nov 02 22:12:59.010700 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:59.010642 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzjh6\" (UniqueName: \"kubernetes.io/projected/93b42983-fb9f-4514-92f6-a1e16b43fb6b-kube-api-access-gzjh6\") pod \"progression-enabled-node-0-0-h92jq\" (UID: \"93b42983-fb9f-4514-92f6-a1e16b43fb6b\") " pod="rhai-e2e-progression-s9sfm/progression-enabled-node-0-0-h92jq" Nov 02 22:12:59.012417 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:59.012393 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-z272c/e2e-test-runtime-update-node-0-0-h4xk6"] Nov 02 22:12:59.018012 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:59.017988 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-z272c/e2e-test-runtime-update-node-0-0-h4xk6"] Nov 02 22:12:59.024594 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:59.024574 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzjh6\" (UniqueName: \"kubernetes.io/projected/93b42983-fb9f-4514-92f6-a1e16b43fb6b-kube-api-access-gzjh6\") pod \"progression-enabled-node-0-0-h92jq\" (UID: \"93b42983-fb9f-4514-92f6-a1e16b43fb6b\") " pod="rhai-e2e-progression-s9sfm/progression-enabled-node-0-0-h92jq" Nov 02 22:12:59.094999 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:59.094966 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-s9sfm/progression-enabled-node-0-0-h92jq" Nov 02 22:12:59.108096 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:59.108072 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-fpl2m/e2e-test-runtime-update-node-0-0-xq2cl" Nov 02 22:12:59.132328 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:12:59.132294 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:12:59.143691 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:59.143642 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-fpl2m/e2e-test-runtime-update-node-0-0-swl2l" Nov 02 22:12:59.212256 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:59.212170 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/edc3076c-6e3f-4b4f-b9bc-296566f944b9-kube-api-access-d2l2h\" (UniqueName: \"kubernetes.io/projected/edc3076c-6e3f-4b4f-b9bc-296566f944b9-kube-api-access-d2l2h\") pod \"edc3076c-6e3f-4b4f-b9bc-296566f944b9\" (UID: \"edc3076c-6e3f-4b4f-b9bc-296566f944b9\") " Nov 02 22:12:59.212618 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:59.212407 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xd9hk\" (UniqueName: \"kubernetes.io/projected/e7944351-52e9-4643-8f4a-00e7cc1dff22-kube-api-access-xd9hk\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:12:59.214544 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:59.214516 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edc3076c-6e3f-4b4f-b9bc-296566f944b9-kube-api-access-d2l2h" pod "edc3076c-6e3f-4b4f-b9bc-296566f944b9" (UID: "edc3076c-6e3f-4b4f-b9bc-296566f944b9"). InnerVolumeSpecName "kube-api-access-d2l2h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 22:12:59.312770 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:59.312739 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b3408e79-c0ec-46e6-9fee-b2edd9b5ea9c-kube-api-access-ztjd5\" (UniqueName: \"kubernetes.io/projected/b3408e79-c0ec-46e6-9fee-b2edd9b5ea9c-kube-api-access-ztjd5\") pod \"b3408e79-c0ec-46e6-9fee-b2edd9b5ea9c\" (UID: \"b3408e79-c0ec-46e6-9fee-b2edd9b5ea9c\") " Nov 02 22:12:59.312969 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:59.312932 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2l2h\" (UniqueName: \"kubernetes.io/projected/edc3076c-6e3f-4b4f-b9bc-296566f944b9-kube-api-access-d2l2h\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:12:59.315066 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:59.315041 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3408e79-c0ec-46e6-9fee-b2edd9b5ea9c-kube-api-access-ztjd5" pod "b3408e79-c0ec-46e6-9fee-b2edd9b5ea9c" (UID: "b3408e79-c0ec-46e6-9fee-b2edd9b5ea9c"). InnerVolumeSpecName "kube-api-access-ztjd5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 22:12:59.374967 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:59.374925 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-s9sfm/progression-enabled-node-0-0-h92jq"] Nov 02 22:12:59.377952 ip-10-0-139-99 kubenswrapper[5963]: W1102 22:12:59.377920 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93b42983_fb9f_4514_92f6_a1e16b43fb6b.slice/crio-31f0a21d302cab1df929a0e14745504b00609ec467233726114a9358e16536ab WatchSource:0}: Error finding container 31f0a21d302cab1df929a0e14745504b00609ec467233726114a9358e16536ab: Status 404 returned error can't find the container with id 31f0a21d302cab1df929a0e14745504b00609ec467233726114a9358e16536ab Nov 02 22:12:59.414161 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:59.414127 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztjd5\" (UniqueName: \"kubernetes.io/projected/b3408e79-c0ec-46e6-9fee-b2edd9b5ea9c-kube-api-access-ztjd5\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:12:59.864180 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:59.864151 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="94e8d61b-991f-4f11-be8b-9e244df9e367" path="/var/lib/kubelet/pods/94e8d61b-991f-4f11-be8b-9e244df9e367/volumes" Nov 02 22:12:59.864476 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:59.864463 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e7944351-52e9-4643-8f4a-00e7cc1dff22" path="/var/lib/kubelet/pods/e7944351-52e9-4643-8f4a-00e7cc1dff22/volumes" Nov 02 22:12:59.874931 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:59.874896 5963 generic.go:356] "Generic (PLEG): container finished" podID="b3408e79-c0ec-46e6-9fee-b2edd9b5ea9c" containerID="311d2d3a7abb0b3a320a2c3e64561652ebb48401ab4fc5f7b600e3b06e2774d2" exitCode=0 Nov 02 22:12:59.875086 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:59.874952 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-fpl2m/e2e-test-runtime-update-node-0-0-swl2l" Nov 02 22:12:59.875086 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:59.874984 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-fpl2m/e2e-test-runtime-update-node-0-0-swl2l" event={"ID":"b3408e79-c0ec-46e6-9fee-b2edd9b5ea9c","Type":"ContainerDied","Data":"311d2d3a7abb0b3a320a2c3e64561652ebb48401ab4fc5f7b600e3b06e2774d2"} Nov 02 22:12:59.875086 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:59.875025 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-fpl2m/e2e-test-runtime-update-node-0-0-swl2l" event={"ID":"b3408e79-c0ec-46e6-9fee-b2edd9b5ea9c","Type":"ContainerDied","Data":"5ccfc6aa7b45808de3dec948abcd252a0df8a444368c17bf89c727e3734f34df"} Nov 02 22:12:59.875086 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:59.875043 5963 scope.go:122] "RemoveContainer" containerID="311d2d3a7abb0b3a320a2c3e64561652ebb48401ab4fc5f7b600e3b06e2774d2" Nov 02 22:12:59.877052 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:59.877019 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-s9sfm/progression-enabled-node-0-0-h92jq" event={"ID":"93b42983-fb9f-4514-92f6-a1e16b43fb6b","Type":"ContainerStarted","Data":"31f0a21d302cab1df929a0e14745504b00609ec467233726114a9358e16536ab"} Nov 02 22:12:59.878584 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:59.878512 5963 generic.go:356] "Generic (PLEG): container finished" podID="edc3076c-6e3f-4b4f-b9bc-296566f944b9" containerID="4dd7d2f6751d55b0873bdf6e688a49ac0e99f95c2c536095fb0ad0fe26758d99" exitCode=0 Nov 02 22:12:59.878584 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:59.878545 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-fpl2m/e2e-test-runtime-update-node-0-0-xq2cl" event={"ID":"edc3076c-6e3f-4b4f-b9bc-296566f944b9","Type":"ContainerDied","Data":"4dd7d2f6751d55b0873bdf6e688a49ac0e99f95c2c536095fb0ad0fe26758d99"} Nov 02 22:12:59.878584 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:59.878583 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-fpl2m/e2e-test-runtime-update-node-0-0-xq2cl" event={"ID":"edc3076c-6e3f-4b4f-b9bc-296566f944b9","Type":"ContainerDied","Data":"f24283e2cfe196cda0c4864623b5b232c8ac6cb3541d41618acd3d62c0ba4e69"} Nov 02 22:12:59.878819 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:59.878613 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-fpl2m/e2e-test-runtime-update-node-0-0-xq2cl" Nov 02 22:12:59.885499 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:59.885485 5963 scope.go:122] "RemoveContainer" containerID="311d2d3a7abb0b3a320a2c3e64561652ebb48401ab4fc5f7b600e3b06e2774d2" Nov 02 22:12:59.885756 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:12:59.885736 5963 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"311d2d3a7abb0b3a320a2c3e64561652ebb48401ab4fc5f7b600e3b06e2774d2\": container with ID starting with 311d2d3a7abb0b3a320a2c3e64561652ebb48401ab4fc5f7b600e3b06e2774d2 not found: ID does not exist" containerID="311d2d3a7abb0b3a320a2c3e64561652ebb48401ab4fc5f7b600e3b06e2774d2" Nov 02 22:12:59.885820 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:59.885765 5963 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"311d2d3a7abb0b3a320a2c3e64561652ebb48401ab4fc5f7b600e3b06e2774d2"} err="failed to get container status \"311d2d3a7abb0b3a320a2c3e64561652ebb48401ab4fc5f7b600e3b06e2774d2\": rpc error: code = NotFound desc = could not find container \"311d2d3a7abb0b3a320a2c3e64561652ebb48401ab4fc5f7b600e3b06e2774d2\": container with ID starting with 311d2d3a7abb0b3a320a2c3e64561652ebb48401ab4fc5f7b600e3b06e2774d2 not found: ID does not exist" Nov 02 22:12:59.885820 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:59.885787 5963 scope.go:122] "RemoveContainer" containerID="4dd7d2f6751d55b0873bdf6e688a49ac0e99f95c2c536095fb0ad0fe26758d99" Nov 02 22:12:59.893943 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:59.893913 5963 scope.go:122] "RemoveContainer" containerID="4dd7d2f6751d55b0873bdf6e688a49ac0e99f95c2c536095fb0ad0fe26758d99" Nov 02 22:12:59.894227 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:12:59.894203 5963 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4dd7d2f6751d55b0873bdf6e688a49ac0e99f95c2c536095fb0ad0fe26758d99\": container with ID starting with 4dd7d2f6751d55b0873bdf6e688a49ac0e99f95c2c536095fb0ad0fe26758d99 not found: ID does not exist" containerID="4dd7d2f6751d55b0873bdf6e688a49ac0e99f95c2c536095fb0ad0fe26758d99" Nov 02 22:12:59.894324 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:59.894232 5963 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dd7d2f6751d55b0873bdf6e688a49ac0e99f95c2c536095fb0ad0fe26758d99"} err="failed to get container status \"4dd7d2f6751d55b0873bdf6e688a49ac0e99f95c2c536095fb0ad0fe26758d99\": rpc error: code = NotFound desc = could not find container \"4dd7d2f6751d55b0873bdf6e688a49ac0e99f95c2c536095fb0ad0fe26758d99\": container with ID starting with 4dd7d2f6751d55b0873bdf6e688a49ac0e99f95c2c536095fb0ad0fe26758d99 not found: ID does not exist" Nov 02 22:12:59.894583 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:59.894568 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-fpl2m/e2e-test-runtime-update-node-0-0-swl2l"] Nov 02 22:12:59.899120 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:59.899101 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-fpl2m/e2e-test-runtime-update-node-0-0-swl2l"] Nov 02 22:12:59.910086 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:59.910025 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-fpl2m/e2e-test-runtime-update-node-0-0-xq2cl"] Nov 02 22:12:59.914041 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:12:59.914022 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-fpl2m/e2e-test-runtime-update-node-0-0-xq2cl"] Nov 02 22:13:01.256642 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:13:01.256603 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:13:01.868206 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:13:01.868172 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b3408e79-c0ec-46e6-9fee-b2edd9b5ea9c" path="/var/lib/kubelet/pods/b3408e79-c0ec-46e6-9fee-b2edd9b5ea9c/volumes" Nov 02 22:13:01.868862 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:13:01.868840 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="edc3076c-6e3f-4b4f-b9bc-296566f944b9" path="/var/lib/kubelet/pods/edc3076c-6e3f-4b4f-b9bc-296566f944b9/volumes" Nov 02 22:13:03.027946 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:13:03.027900 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:13:03.121117 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:13:03.121041 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:13:04.308018 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:13:04.307979 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:13:04.403986 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:13:04.403948 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:13:26.250682 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:13:26.250631 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-rksdj/e2e-deadline-job-node-0-0-n4kj9" Nov 02 22:13:26.356765 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:13:26.356731 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5622f1a3-f030-4238-bcdb-38b9754dbde4-kube-api-access-dgjgc\" (UniqueName: \"kubernetes.io/projected/5622f1a3-f030-4238-bcdb-38b9754dbde4-kube-api-access-dgjgc\") pod \"5622f1a3-f030-4238-bcdb-38b9754dbde4\" (UID: \"5622f1a3-f030-4238-bcdb-38b9754dbde4\") " Nov 02 22:13:26.359088 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:13:26.359057 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5622f1a3-f030-4238-bcdb-38b9754dbde4-kube-api-access-dgjgc" pod "5622f1a3-f030-4238-bcdb-38b9754dbde4" (UID: "5622f1a3-f030-4238-bcdb-38b9754dbde4"). InnerVolumeSpecName "kube-api-access-dgjgc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 22:13:26.458265 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:13:26.458208 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgjgc\" (UniqueName: \"kubernetes.io/projected/5622f1a3-f030-4238-bcdb-38b9754dbde4-kube-api-access-dgjgc\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:13:27.026742 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:13:27.026703 5963 generic.go:356] "Generic (PLEG): container finished" podID="5622f1a3-f030-4238-bcdb-38b9754dbde4" containerID="83f58ebf711c365254a0af8158a6050070ccf157ccb3b29633a3dc770ca67138" exitCode=137 Nov 02 22:13:27.026742 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:13:27.026745 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-rksdj/e2e-deadline-job-node-0-0-n4kj9" event={"ID":"5622f1a3-f030-4238-bcdb-38b9754dbde4","Type":"ContainerDied","Data":"83f58ebf711c365254a0af8158a6050070ccf157ccb3b29633a3dc770ca67138"} Nov 02 22:13:27.026965 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:13:27.026753 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-rksdj/e2e-deadline-job-node-0-0-n4kj9" Nov 02 22:13:27.026965 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:13:27.026772 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-rksdj/e2e-deadline-job-node-0-0-n4kj9" event={"ID":"5622f1a3-f030-4238-bcdb-38b9754dbde4","Type":"ContainerDied","Data":"29478e50ee313ac61edba358d7d13e33df2059ffb4f26350dcc78c17052d9e49"} Nov 02 22:13:27.026965 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:13:27.026787 5963 scope.go:122] "RemoveContainer" containerID="83f58ebf711c365254a0af8158a6050070ccf157ccb3b29633a3dc770ca67138" Nov 02 22:13:27.035784 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:13:27.035763 5963 scope.go:122] "RemoveContainer" containerID="83f58ebf711c365254a0af8158a6050070ccf157ccb3b29633a3dc770ca67138" Nov 02 22:13:27.036054 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:13:27.036037 5963 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83f58ebf711c365254a0af8158a6050070ccf157ccb3b29633a3dc770ca67138\": container with ID starting with 83f58ebf711c365254a0af8158a6050070ccf157ccb3b29633a3dc770ca67138 not found: ID does not exist" containerID="83f58ebf711c365254a0af8158a6050070ccf157ccb3b29633a3dc770ca67138" Nov 02 22:13:27.036100 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:13:27.036063 5963 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83f58ebf711c365254a0af8158a6050070ccf157ccb3b29633a3dc770ca67138"} err="failed to get container status \"83f58ebf711c365254a0af8158a6050070ccf157ccb3b29633a3dc770ca67138\": rpc error: code = NotFound desc = could not find container \"83f58ebf711c365254a0af8158a6050070ccf157ccb3b29633a3dc770ca67138\": container with ID starting with 83f58ebf711c365254a0af8158a6050070ccf157ccb3b29633a3dc770ca67138 not found: ID does not exist" Nov 02 22:13:27.047012 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:13:27.046989 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-rksdj/e2e-deadline-job-node-0-0-n4kj9"] Nov 02 22:13:27.051965 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:13:27.051934 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-rksdj/e2e-deadline-job-node-0-0-n4kj9"] Nov 02 22:13:27.863641 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:13:27.863608 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5622f1a3-f030-4238-bcdb-38b9754dbde4" path="/var/lib/kubelet/pods/5622f1a3-f030-4238-bcdb-38b9754dbde4/volumes" Nov 02 22:13:28.207805 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:13:28.207709 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:13:29.127265 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:13:29.127225 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:13:58.229066 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:13:58.229026 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:13:59.129724 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:13:59.129685 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:14:29.124491 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:14:29.124448 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:14:48.033509 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:14:48.033470 5963 scope.go:122] "RemoveContainer" containerID="5ec5ef3092e7e58337809f3fd27ecf3a901d099a096f09a4d931ca21bbb70845" Nov 02 22:14:58.269983 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:14:58.269888 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:14:59.128525 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:14:59.128447 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:15:14.342772 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:14.342732 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:15:14.561029 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:14.560989 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-s9sfm/progression-enabled-node-0-0-h92jq" event={"ID":"93b42983-fb9f-4514-92f6-a1e16b43fb6b","Type":"ContainerStarted","Data":"d82473f6eb5c6947c741bd56f3c90fd04bd5d401ec67aeb80c3121539d3219d0"} Nov 02 22:15:14.594009 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:14.593914 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="rhai-e2e-progression-s9sfm/progression-enabled-node-0-0-h92jq" podStartSLOduration=2.21673278 podStartE2EDuration="2m16.593898652s" totalImagesPullingTime="2m14.377165872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:12:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:15:14.591928556 +0000 UTC m=+1286.843927045" watchObservedRunningTime="2026-11-02 22:15:14.593898652 +0000 UTC m=+1286.845897117" Nov 02 22:15:29.123041 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:15:29.123000 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:15:36.660937 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:36.660904 5963 generic.go:356] "Generic (PLEG): container finished" podID="93b42983-fb9f-4514-92f6-a1e16b43fb6b" containerID="d82473f6eb5c6947c741bd56f3c90fd04bd5d401ec67aeb80c3121539d3219d0" exitCode=0 Nov 02 22:15:36.661365 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:36.660943 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-s9sfm/progression-enabled-node-0-0-h92jq" event={"ID":"93b42983-fb9f-4514-92f6-a1e16b43fb6b","Type":"ContainerDied","Data":"d82473f6eb5c6947c741bd56f3c90fd04bd5d401ec67aeb80c3121539d3219d0"} Nov 02 22:15:37.804365 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:37.804327 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-s9sfm/progression-enabled-node-0-0-h92jq" Nov 02 22:15:37.933987 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:37.933904 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/93b42983-fb9f-4514-92f6-a1e16b43fb6b-kube-api-access-gzjh6\" (UniqueName: \"kubernetes.io/projected/93b42983-fb9f-4514-92f6-a1e16b43fb6b-kube-api-access-gzjh6\") pod \"93b42983-fb9f-4514-92f6-a1e16b43fb6b\" (UID: \"93b42983-fb9f-4514-92f6-a1e16b43fb6b\") " Nov 02 22:15:37.936276 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:37.936256 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93b42983-fb9f-4514-92f6-a1e16b43fb6b-kube-api-access-gzjh6" pod "93b42983-fb9f-4514-92f6-a1e16b43fb6b" (UID: "93b42983-fb9f-4514-92f6-a1e16b43fb6b"). InnerVolumeSpecName "kube-api-access-gzjh6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 22:15:38.035029 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:38.034999 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzjh6\" (UniqueName: \"kubernetes.io/projected/93b42983-fb9f-4514-92f6-a1e16b43fb6b-kube-api-access-gzjh6\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:15:38.670540 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:38.670504 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-s9sfm/progression-enabled-node-0-0-h92jq" event={"ID":"93b42983-fb9f-4514-92f6-a1e16b43fb6b","Type":"ContainerDied","Data":"31f0a21d302cab1df929a0e14745504b00609ec467233726114a9358e16536ab"} Nov 02 22:15:38.670758 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:38.670569 5963 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="31f0a21d302cab1df929a0e14745504b00609ec467233726114a9358e16536ab" Nov 02 22:15:38.670758 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:38.670515 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-s9sfm/progression-enabled-node-0-0-h92jq" Nov 02 22:15:40.405250 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:40.405212 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:15:40.424823 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:40.424791 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-s9sfm/progression-disabled-node-0-0-m2qct"] Nov 02 22:15:40.425144 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:40.425131 5963 cpu_manager.go:414] "containerMap: removing container" podUID="b3408e79-c0ec-46e6-9fee-b2edd9b5ea9c" containerName="node" Nov 02 22:15:40.425184 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:40.425146 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b3408e79-c0ec-46e6-9fee-b2edd9b5ea9c" containerName="node" Nov 02 22:15:40.425184 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:40.425156 5963 cpu_manager.go:414] "containerMap: removing container" podUID="93b42983-fb9f-4514-92f6-a1e16b43fb6b" containerName="node" Nov 02 22:15:40.425184 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:40.425161 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="93b42983-fb9f-4514-92f6-a1e16b43fb6b" containerName="node" Nov 02 22:15:40.425184 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:40.425171 5963 cpu_manager.go:414] "containerMap: removing container" podUID="5622f1a3-f030-4238-bcdb-38b9754dbde4" containerName="node" Nov 02 22:15:40.425184 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:40.425177 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5622f1a3-f030-4238-bcdb-38b9754dbde4" containerName="node" Nov 02 22:15:40.425184 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:40.425186 5963 cpu_manager.go:414] "containerMap: removing container" podUID="edc3076c-6e3f-4b4f-b9bc-296566f944b9" containerName="node" Nov 02 22:15:40.425365 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:40.425191 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="edc3076c-6e3f-4b4f-b9bc-296566f944b9" containerName="node" Nov 02 22:15:40.425365 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:40.425258 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="b3408e79-c0ec-46e6-9fee-b2edd9b5ea9c" containerName="node" Nov 02 22:15:40.425365 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:40.425266 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="93b42983-fb9f-4514-92f6-a1e16b43fb6b" containerName="node" Nov 02 22:15:40.425365 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:40.425271 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="5622f1a3-f030-4238-bcdb-38b9754dbde4" containerName="node" Nov 02 22:15:40.425365 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:40.425277 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="edc3076c-6e3f-4b4f-b9bc-296566f944b9" containerName="node" Nov 02 22:15:40.437589 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:40.437561 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-s9sfm/progression-disabled-node-0-0-m2qct" Nov 02 22:15:40.440908 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:40.440885 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-s9sfm/progression-disabled-node-0-0-m2qct"] Nov 02 22:15:40.442120 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:40.442101 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-s9sfm\"/\"kube-root-ca.crt\"" Nov 02 22:15:40.443132 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:40.443113 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-s9sfm\"/\"openshift-service-ca.crt\"" Nov 02 22:15:40.443132 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:40.443115 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-s9sfm\"/\"default-dockercfg-x2tr8\"" Nov 02 22:15:40.553781 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:40.553744 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jztv8\" (UniqueName: \"kubernetes.io/projected/b68c11fa-2cf6-4e92-a1ea-c1a2fefc0930-kube-api-access-jztv8\") pod \"progression-disabled-node-0-0-m2qct\" (UID: \"b68c11fa-2cf6-4e92-a1ea-c1a2fefc0930\") " pod="rhai-e2e-progression-s9sfm/progression-disabled-node-0-0-m2qct" Nov 02 22:15:40.654987 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:40.654956 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jztv8\" (UniqueName: \"kubernetes.io/projected/b68c11fa-2cf6-4e92-a1ea-c1a2fefc0930-kube-api-access-jztv8\") pod \"progression-disabled-node-0-0-m2qct\" (UID: \"b68c11fa-2cf6-4e92-a1ea-c1a2fefc0930\") " pod="rhai-e2e-progression-s9sfm/progression-disabled-node-0-0-m2qct" Nov 02 22:15:40.667802 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:40.667739 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jztv8\" (UniqueName: \"kubernetes.io/projected/b68c11fa-2cf6-4e92-a1ea-c1a2fefc0930-kube-api-access-jztv8\") pod \"progression-disabled-node-0-0-m2qct\" (UID: \"b68c11fa-2cf6-4e92-a1ea-c1a2fefc0930\") " pod="rhai-e2e-progression-s9sfm/progression-disabled-node-0-0-m2qct" Nov 02 22:15:40.760036 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:40.759999 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-s9sfm/progression-disabled-node-0-0-m2qct" Nov 02 22:15:41.053590 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:41.053522 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-s9sfm/progression-disabled-node-0-0-m2qct"] Nov 02 22:15:41.056981 ip-10-0-139-99 kubenswrapper[5963]: W1102 22:15:41.056955 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb68c11fa_2cf6_4e92_a1ea_c1a2fefc0930.slice/crio-b1d208143b982589f5be8869c42c907b881554dffb095629ae77d0c77c4ac48e WatchSource:0}: Error finding container b1d208143b982589f5be8869c42c907b881554dffb095629ae77d0c77c4ac48e: Status 404 returned error can't find the container with id b1d208143b982589f5be8869c42c907b881554dffb095629ae77d0c77c4ac48e Nov 02 22:15:41.684938 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:41.684897 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-s9sfm/progression-disabled-node-0-0-m2qct" event={"ID":"b68c11fa-2cf6-4e92-a1ea-c1a2fefc0930","Type":"ContainerStarted","Data":"7fcd42847c46823ff8ec9dde210e36910835e3c57e8200f6caa65ad392600678"} Nov 02 22:15:41.685330 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:41.684955 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-s9sfm/progression-disabled-node-0-0-m2qct" event={"ID":"b68c11fa-2cf6-4e92-a1ea-c1a2fefc0930","Type":"ContainerStarted","Data":"b1d208143b982589f5be8869c42c907b881554dffb095629ae77d0c77c4ac48e"} Nov 02 22:15:41.705360 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:41.705316 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="rhai-e2e-progression-s9sfm/progression-disabled-node-0-0-m2qct" podStartSLOduration=1.7053040369999999 podStartE2EDuration="1.705304037s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:15:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:15:41.704575532 +0000 UTC m=+1313.956573997" watchObservedRunningTime="2026-11-02 22:15:41.705304037 +0000 UTC m=+1313.957302501" Nov 02 22:15:58.383573 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:15:58.383539 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:15:59.123413 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:15:59.123378 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:16:02.785146 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:02.785052 5963 generic.go:356] "Generic (PLEG): container finished" podID="b68c11fa-2cf6-4e92-a1ea-c1a2fefc0930" containerID="7fcd42847c46823ff8ec9dde210e36910835e3c57e8200f6caa65ad392600678" exitCode=0 Nov 02 22:16:02.785146 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:02.785126 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-s9sfm/progression-disabled-node-0-0-m2qct" event={"ID":"b68c11fa-2cf6-4e92-a1ea-c1a2fefc0930","Type":"ContainerDied","Data":"7fcd42847c46823ff8ec9dde210e36910835e3c57e8200f6caa65ad392600678"} Nov 02 22:16:03.921921 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:03.921895 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-s9sfm/progression-disabled-node-0-0-m2qct" Nov 02 22:16:03.956975 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:03.956942 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b68c11fa-2cf6-4e92-a1ea-c1a2fefc0930-kube-api-access-jztv8\" (UniqueName: \"kubernetes.io/projected/b68c11fa-2cf6-4e92-a1ea-c1a2fefc0930-kube-api-access-jztv8\") pod \"b68c11fa-2cf6-4e92-a1ea-c1a2fefc0930\" (UID: \"b68c11fa-2cf6-4e92-a1ea-c1a2fefc0930\") " Nov 02 22:16:03.959256 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:03.959222 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b68c11fa-2cf6-4e92-a1ea-c1a2fefc0930-kube-api-access-jztv8" pod "b68c11fa-2cf6-4e92-a1ea-c1a2fefc0930" (UID: "b68c11fa-2cf6-4e92-a1ea-c1a2fefc0930"). InnerVolumeSpecName "kube-api-access-jztv8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 22:16:04.057643 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:04.057613 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jztv8\" (UniqueName: \"kubernetes.io/projected/b68c11fa-2cf6-4e92-a1ea-c1a2fefc0930-kube-api-access-jztv8\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:16:04.795595 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:04.795568 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-s9sfm/progression-disabled-node-0-0-m2qct" Nov 02 22:16:04.795809 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:04.795592 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-s9sfm/progression-disabled-node-0-0-m2qct" event={"ID":"b68c11fa-2cf6-4e92-a1ea-c1a2fefc0930","Type":"ContainerDied","Data":"b1d208143b982589f5be8869c42c907b881554dffb095629ae77d0c77c4ac48e"} Nov 02 22:16:04.795809 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:04.795633 5963 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b1d208143b982589f5be8869c42c907b881554dffb095629ae77d0c77c4ac48e" Nov 02 22:16:15.420314 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:15.420281 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-s9sfm/progression-invalid-node-0-0-skq52"] Nov 02 22:16:15.420870 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:15.420709 5963 cpu_manager.go:414] "containerMap: removing container" podUID="b68c11fa-2cf6-4e92-a1ea-c1a2fefc0930" containerName="node" Nov 02 22:16:15.420870 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:15.420727 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b68c11fa-2cf6-4e92-a1ea-c1a2fefc0930" containerName="node" Nov 02 22:16:15.420870 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:15.420817 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="b68c11fa-2cf6-4e92-a1ea-c1a2fefc0930" containerName="node" Nov 02 22:16:15.423656 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:15.423637 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-s9sfm/progression-invalid-node-0-0-skq52" Nov 02 22:16:15.428431 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:15.428413 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-s9sfm\"/\"default-dockercfg-x2tr8\"" Nov 02 22:16:15.429204 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:15.429181 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-s9sfm\"/\"openshift-service-ca.crt\"" Nov 02 22:16:15.429299 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:15.429256 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-s9sfm\"/\"kube-root-ca.crt\"" Nov 02 22:16:15.436450 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:15.436426 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-s9sfm/progression-invalid-node-0-0-skq52"] Nov 02 22:16:15.451825 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:15.451791 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:16:15.563120 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:15.563081 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvqrm\" (UniqueName: \"kubernetes.io/projected/f52ada2d-ddba-4a8b-9cd6-bc691539d066-kube-api-access-nvqrm\") pod \"progression-invalid-node-0-0-skq52\" (UID: \"f52ada2d-ddba-4a8b-9cd6-bc691539d066\") " pod="rhai-e2e-progression-s9sfm/progression-invalid-node-0-0-skq52" Nov 02 22:16:15.664645 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:15.664607 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvqrm\" (UniqueName: \"kubernetes.io/projected/f52ada2d-ddba-4a8b-9cd6-bc691539d066-kube-api-access-nvqrm\") pod \"progression-invalid-node-0-0-skq52\" (UID: \"f52ada2d-ddba-4a8b-9cd6-bc691539d066\") " pod="rhai-e2e-progression-s9sfm/progression-invalid-node-0-0-skq52" Nov 02 22:16:15.677436 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:15.677361 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvqrm\" (UniqueName: \"kubernetes.io/projected/f52ada2d-ddba-4a8b-9cd6-bc691539d066-kube-api-access-nvqrm\") pod \"progression-invalid-node-0-0-skq52\" (UID: \"f52ada2d-ddba-4a8b-9cd6-bc691539d066\") " pod="rhai-e2e-progression-s9sfm/progression-invalid-node-0-0-skq52" Nov 02 22:16:15.735324 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:15.735287 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-s9sfm/progression-invalid-node-0-0-skq52" Nov 02 22:16:16.013778 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:16.013709 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-s9sfm/progression-invalid-node-0-0-skq52"] Nov 02 22:16:16.017148 ip-10-0-139-99 kubenswrapper[5963]: W1102 22:16:16.017119 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf52ada2d_ddba_4a8b_9cd6_bc691539d066.slice/crio-6341d021c11ca3313bd2a2731c7a788bb892820c33e0c49ec0d9c24a3b197605 WatchSource:0}: Error finding container 6341d021c11ca3313bd2a2731c7a788bb892820c33e0c49ec0d9c24a3b197605: Status 404 returned error can't find the container with id 6341d021c11ca3313bd2a2731c7a788bb892820c33e0c49ec0d9c24a3b197605 Nov 02 22:16:16.849054 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:16.849017 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-s9sfm/progression-invalid-node-0-0-skq52" event={"ID":"f52ada2d-ddba-4a8b-9cd6-bc691539d066","Type":"ContainerStarted","Data":"00d8361bbc764b53d8c21e98dd24d7c25379eb76c3cbcacf8c63c006f1f5eaa1"} Nov 02 22:16:16.849465 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:16.849067 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-s9sfm/progression-invalid-node-0-0-skq52" event={"ID":"f52ada2d-ddba-4a8b-9cd6-bc691539d066","Type":"ContainerStarted","Data":"6341d021c11ca3313bd2a2731c7a788bb892820c33e0c49ec0d9c24a3b197605"} Nov 02 22:16:16.869840 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:16.869788 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="rhai-e2e-progression-s9sfm/progression-invalid-node-0-0-skq52" podStartSLOduration=1.8697747630000001 podStartE2EDuration="1.869774763s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:16:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:16:16.868962697 +0000 UTC m=+1349.120961198" watchObservedRunningTime="2026-11-02 22:16:16.869774763 +0000 UTC m=+1349.121773234" Nov 02 22:16:29.123398 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:16:29.123291 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:16:30.495688 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:30.495632 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-s9sfm/progression-custom-config-node-0-0-ts4mx"] Nov 02 22:16:30.500134 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:30.500110 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-s9sfm/progression-custom-config-node-0-0-ts4mx" Nov 02 22:16:30.512156 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:30.512129 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-s9sfm/progression-custom-config-node-0-0-ts4mx"] Nov 02 22:16:30.600637 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:30.600601 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq67h\" (UniqueName: \"kubernetes.io/projected/c8796e46-c2e2-4912-aed4-4d6a5b526ded-kube-api-access-xq67h\") pod \"progression-custom-config-node-0-0-ts4mx\" (UID: \"c8796e46-c2e2-4912-aed4-4d6a5b526ded\") " pod="rhai-e2e-progression-s9sfm/progression-custom-config-node-0-0-ts4mx" Nov 02 22:16:30.702006 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:30.701963 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq67h\" (UniqueName: \"kubernetes.io/projected/c8796e46-c2e2-4912-aed4-4d6a5b526ded-kube-api-access-xq67h\") pod \"progression-custom-config-node-0-0-ts4mx\" (UID: \"c8796e46-c2e2-4912-aed4-4d6a5b526ded\") " pod="rhai-e2e-progression-s9sfm/progression-custom-config-node-0-0-ts4mx" Nov 02 22:16:30.715219 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:30.715190 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq67h\" (UniqueName: \"kubernetes.io/projected/c8796e46-c2e2-4912-aed4-4d6a5b526ded-kube-api-access-xq67h\") pod \"progression-custom-config-node-0-0-ts4mx\" (UID: \"c8796e46-c2e2-4912-aed4-4d6a5b526ded\") " pod="rhai-e2e-progression-s9sfm/progression-custom-config-node-0-0-ts4mx" Nov 02 22:16:30.812259 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:30.812230 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-s9sfm/progression-custom-config-node-0-0-ts4mx" Nov 02 22:16:31.091522 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:31.091431 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-s9sfm/progression-custom-config-node-0-0-ts4mx"] Nov 02 22:16:31.094810 ip-10-0-139-99 kubenswrapper[5963]: W1102 22:16:31.094783 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8796e46_c2e2_4912_aed4_4d6a5b526ded.slice/crio-f89782b2ee71457ee9fb7026dd79c2b9f2a5f46778fd4829c97b0f99424808ab WatchSource:0}: Error finding container f89782b2ee71457ee9fb7026dd79c2b9f2a5f46778fd4829c97b0f99424808ab: Status 404 returned error can't find the container with id f89782b2ee71457ee9fb7026dd79c2b9f2a5f46778fd4829c97b0f99424808ab Nov 02 22:16:31.700568 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:31.700531 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:16:31.919860 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:31.919821 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-s9sfm/progression-custom-config-node-0-0-ts4mx" event={"ID":"c8796e46-c2e2-4912-aed4-4d6a5b526ded","Type":"ContainerStarted","Data":"262250ca6d70edf2079272c2515474fe8773756d682d615c3d74b1087f3fcf2c"} Nov 02 22:16:31.920036 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:31.919879 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-s9sfm/progression-custom-config-node-0-0-ts4mx" event={"ID":"c8796e46-c2e2-4912-aed4-4d6a5b526ded","Type":"ContainerStarted","Data":"f89782b2ee71457ee9fb7026dd79c2b9f2a5f46778fd4829c97b0f99424808ab"} Nov 02 22:16:31.939881 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:31.939823 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="rhai-e2e-progression-s9sfm/progression-custom-config-node-0-0-ts4mx" podStartSLOduration=1.939809707 podStartE2EDuration="1.939809707s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:16:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:16:31.939335527 +0000 UTC m=+1364.191333994" watchObservedRunningTime="2026-11-02 22:16:31.939809707 +0000 UTC m=+1364.191808173" Nov 02 22:16:34.645170 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:34.645135 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-s9sfm/progression-min-interval-node-0-0-dpgc9"] Nov 02 22:16:34.648579 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:34.648557 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-s9sfm/progression-min-interval-node-0-0-dpgc9" Nov 02 22:16:34.660078 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:34.660015 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-s9sfm/progression-min-interval-node-0-0-dpgc9"] Nov 02 22:16:34.682816 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:34.682746 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:16:34.733082 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:34.733044 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt4zn\" (UniqueName: \"kubernetes.io/projected/d9e1dc47-a311-4003-afc0-2f583f2678aa-kube-api-access-wt4zn\") pod \"progression-min-interval-node-0-0-dpgc9\" (UID: \"d9e1dc47-a311-4003-afc0-2f583f2678aa\") " pod="rhai-e2e-progression-s9sfm/progression-min-interval-node-0-0-dpgc9" Nov 02 22:16:34.833929 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:34.833885 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt4zn\" (UniqueName: \"kubernetes.io/projected/d9e1dc47-a311-4003-afc0-2f583f2678aa-kube-api-access-wt4zn\") pod \"progression-min-interval-node-0-0-dpgc9\" (UID: \"d9e1dc47-a311-4003-afc0-2f583f2678aa\") " pod="rhai-e2e-progression-s9sfm/progression-min-interval-node-0-0-dpgc9" Nov 02 22:16:34.846887 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:34.846860 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt4zn\" (UniqueName: \"kubernetes.io/projected/d9e1dc47-a311-4003-afc0-2f583f2678aa-kube-api-access-wt4zn\") pod \"progression-min-interval-node-0-0-dpgc9\" (UID: \"d9e1dc47-a311-4003-afc0-2f583f2678aa\") " pod="rhai-e2e-progression-s9sfm/progression-min-interval-node-0-0-dpgc9" Nov 02 22:16:34.960578 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:34.960489 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-s9sfm/progression-min-interval-node-0-0-dpgc9" Nov 02 22:16:35.238609 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:35.238534 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-s9sfm/progression-min-interval-node-0-0-dpgc9"] Nov 02 22:16:35.241941 ip-10-0-139-99 kubenswrapper[5963]: W1102 22:16:35.241909 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9e1dc47_a311_4003_afc0_2f583f2678aa.slice/crio-d3d056cd907370dde5f49b09d16e5a4456cb97ceb5b04683bc80ad2f438ada78 WatchSource:0}: Error finding container d3d056cd907370dde5f49b09d16e5a4456cb97ceb5b04683bc80ad2f438ada78: Status 404 returned error can't find the container with id d3d056cd907370dde5f49b09d16e5a4456cb97ceb5b04683bc80ad2f438ada78 Nov 02 22:16:35.244481 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:35.244115 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:16:35.940088 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:35.940051 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-s9sfm/progression-min-interval-node-0-0-dpgc9" event={"ID":"d9e1dc47-a311-4003-afc0-2f583f2678aa","Type":"ContainerStarted","Data":"87a07cfb48d4c7f432e3124c4a66167b675e701a36bbdd0a25ce90cc716d98ea"} Nov 02 22:16:35.940493 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:35.940100 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-s9sfm/progression-min-interval-node-0-0-dpgc9" event={"ID":"d9e1dc47-a311-4003-afc0-2f583f2678aa","Type":"ContainerStarted","Data":"d3d056cd907370dde5f49b09d16e5a4456cb97ceb5b04683bc80ad2f438ada78"} Nov 02 22:16:35.961777 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:35.961722 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="rhai-e2e-progression-s9sfm/progression-min-interval-node-0-0-dpgc9" podStartSLOduration=1.961706007 podStartE2EDuration="1.961706007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:16:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:16:35.960614387 +0000 UTC m=+1368.212612857" watchObservedRunningTime="2026-11-02 22:16:35.961706007 +0000 UTC m=+1368.213704451" Nov 02 22:16:37.951837 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:37.951800 5963 generic.go:356] "Generic (PLEG): container finished" podID="f52ada2d-ddba-4a8b-9cd6-bc691539d066" containerID="00d8361bbc764b53d8c21e98dd24d7c25379eb76c3cbcacf8c63c006f1f5eaa1" exitCode=0 Nov 02 22:16:37.952340 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:37.951877 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-s9sfm/progression-invalid-node-0-0-skq52" event={"ID":"f52ada2d-ddba-4a8b-9cd6-bc691539d066","Type":"ContainerDied","Data":"00d8361bbc764b53d8c21e98dd24d7c25379eb76c3cbcacf8c63c006f1f5eaa1"} Nov 02 22:16:39.089250 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:39.089219 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-s9sfm/progression-invalid-node-0-0-skq52" Nov 02 22:16:39.170767 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:39.170726 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f52ada2d-ddba-4a8b-9cd6-bc691539d066-kube-api-access-nvqrm\" (UniqueName: \"kubernetes.io/projected/f52ada2d-ddba-4a8b-9cd6-bc691539d066-kube-api-access-nvqrm\") pod \"f52ada2d-ddba-4a8b-9cd6-bc691539d066\" (UID: \"f52ada2d-ddba-4a8b-9cd6-bc691539d066\") " Nov 02 22:16:39.173153 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:39.173118 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f52ada2d-ddba-4a8b-9cd6-bc691539d066-kube-api-access-nvqrm" pod "f52ada2d-ddba-4a8b-9cd6-bc691539d066" (UID: "f52ada2d-ddba-4a8b-9cd6-bc691539d066"). InnerVolumeSpecName "kube-api-access-nvqrm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 22:16:39.271458 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:39.271372 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvqrm\" (UniqueName: \"kubernetes.io/projected/f52ada2d-ddba-4a8b-9cd6-bc691539d066-kube-api-access-nvqrm\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:16:39.962739 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:39.962711 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-s9sfm/progression-invalid-node-0-0-skq52" Nov 02 22:16:39.962739 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:39.962722 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-s9sfm/progression-invalid-node-0-0-skq52" event={"ID":"f52ada2d-ddba-4a8b-9cd6-bc691539d066","Type":"ContainerDied","Data":"6341d021c11ca3313bd2a2731c7a788bb892820c33e0c49ec0d9c24a3b197605"} Nov 02 22:16:39.962949 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:39.962770 5963 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6341d021c11ca3313bd2a2731c7a788bb892820c33e0c49ec0d9c24a3b197605" Nov 02 22:16:53.025929 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:53.025893 5963 generic.go:356] "Generic (PLEG): container finished" podID="c8796e46-c2e2-4912-aed4-4d6a5b526ded" containerID="262250ca6d70edf2079272c2515474fe8773756d682d615c3d74b1087f3fcf2c" exitCode=0 Nov 02 22:16:53.026368 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:53.025963 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-s9sfm/progression-custom-config-node-0-0-ts4mx" event={"ID":"c8796e46-c2e2-4912-aed4-4d6a5b526ded","Type":"ContainerDied","Data":"262250ca6d70edf2079272c2515474fe8773756d682d615c3d74b1087f3fcf2c"} Nov 02 22:16:54.161373 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:54.161344 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-s9sfm/progression-custom-config-node-0-0-ts4mx" Nov 02 22:16:54.209122 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:54.209087 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c8796e46-c2e2-4912-aed4-4d6a5b526ded-kube-api-access-xq67h\" (UniqueName: \"kubernetes.io/projected/c8796e46-c2e2-4912-aed4-4d6a5b526ded-kube-api-access-xq67h\") pod \"c8796e46-c2e2-4912-aed4-4d6a5b526ded\" (UID: \"c8796e46-c2e2-4912-aed4-4d6a5b526ded\") " Nov 02 22:16:54.211570 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:54.211535 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8796e46-c2e2-4912-aed4-4d6a5b526ded-kube-api-access-xq67h" pod "c8796e46-c2e2-4912-aed4-4d6a5b526ded" (UID: "c8796e46-c2e2-4912-aed4-4d6a5b526ded"). InnerVolumeSpecName "kube-api-access-xq67h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 22:16:54.310154 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:54.310118 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xq67h\" (UniqueName: \"kubernetes.io/projected/c8796e46-c2e2-4912-aed4-4d6a5b526ded-kube-api-access-xq67h\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:16:55.036038 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:55.035944 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-s9sfm/progression-custom-config-node-0-0-ts4mx" Nov 02 22:16:55.036213 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:55.035958 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-s9sfm/progression-custom-config-node-0-0-ts4mx" event={"ID":"c8796e46-c2e2-4912-aed4-4d6a5b526ded","Type":"ContainerDied","Data":"f89782b2ee71457ee9fb7026dd79c2b9f2a5f46778fd4829c97b0f99424808ab"} Nov 02 22:16:55.036213 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:55.036131 5963 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f89782b2ee71457ee9fb7026dd79c2b9f2a5f46778fd4829c97b0f99424808ab" Nov 02 22:16:57.046453 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:57.046359 5963 generic.go:356] "Generic (PLEG): container finished" podID="d9e1dc47-a311-4003-afc0-2f583f2678aa" containerID="87a07cfb48d4c7f432e3124c4a66167b675e701a36bbdd0a25ce90cc716d98ea" exitCode=0 Nov 02 22:16:57.046453 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:57.046416 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-s9sfm/progression-min-interval-node-0-0-dpgc9" event={"ID":"d9e1dc47-a311-4003-afc0-2f583f2678aa","Type":"ContainerDied","Data":"87a07cfb48d4c7f432e3124c4a66167b675e701a36bbdd0a25ce90cc716d98ea"} Nov 02 22:16:58.182492 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:58.182467 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-s9sfm/progression-min-interval-node-0-0-dpgc9" Nov 02 22:16:58.244535 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:58.244501 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d9e1dc47-a311-4003-afc0-2f583f2678aa-kube-api-access-wt4zn\" (UniqueName: \"kubernetes.io/projected/d9e1dc47-a311-4003-afc0-2f583f2678aa-kube-api-access-wt4zn\") pod \"d9e1dc47-a311-4003-afc0-2f583f2678aa\" (UID: \"d9e1dc47-a311-4003-afc0-2f583f2678aa\") " Nov 02 22:16:58.246794 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:58.246766 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9e1dc47-a311-4003-afc0-2f583f2678aa-kube-api-access-wt4zn" pod "d9e1dc47-a311-4003-afc0-2f583f2678aa" (UID: "d9e1dc47-a311-4003-afc0-2f583f2678aa"). InnerVolumeSpecName "kube-api-access-wt4zn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 22:16:58.345507 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:58.345469 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wt4zn\" (UniqueName: \"kubernetes.io/projected/d9e1dc47-a311-4003-afc0-2f583f2678aa-kube-api-access-wt4zn\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:16:58.408932 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:58.408900 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:16:59.056844 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:59.056807 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-s9sfm/progression-min-interval-node-0-0-dpgc9" Nov 02 22:16:59.056844 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:59.056819 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-s9sfm/progression-min-interval-node-0-0-dpgc9" event={"ID":"d9e1dc47-a311-4003-afc0-2f583f2678aa","Type":"ContainerDied","Data":"d3d056cd907370dde5f49b09d16e5a4456cb97ceb5b04683bc80ad2f438ada78"} Nov 02 22:16:59.057080 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:16:59.056877 5963 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d3d056cd907370dde5f49b09d16e5a4456cb97ceb5b04683bc80ad2f438ada78" Nov 02 22:16:59.125379 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:16:59.125336 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:17:29.123495 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:17:29.123451 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:17:42.347361 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:17:42.347324 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:17:42.482401 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:17:42.482367 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:17:48.068790 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:17:48.068759 5963 scope.go:122] "RemoveContainer" containerID="9912c7d1883cd7744dcb6227dfa37d041cb77f59451760fc77813050d0699163" Nov 02 22:17:57.564714 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:17:57.564682 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:17:57.875102 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:17:57.875031 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-s9sfm/progression-no-metrics-node-0-0-ks46d"] Nov 02 22:17:57.875354 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:17:57.875342 5963 cpu_manager.go:414] "containerMap: removing container" podUID="f52ada2d-ddba-4a8b-9cd6-bc691539d066" containerName="node" Nov 02 22:17:57.875409 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:17:57.875356 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f52ada2d-ddba-4a8b-9cd6-bc691539d066" containerName="node" Nov 02 22:17:57.875409 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:17:57.875373 5963 cpu_manager.go:414] "containerMap: removing container" podUID="c8796e46-c2e2-4912-aed4-4d6a5b526ded" containerName="node" Nov 02 22:17:57.875409 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:17:57.875378 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c8796e46-c2e2-4912-aed4-4d6a5b526ded" containerName="node" Nov 02 22:17:57.875409 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:17:57.875392 5963 cpu_manager.go:414] "containerMap: removing container" podUID="d9e1dc47-a311-4003-afc0-2f583f2678aa" containerName="node" Nov 02 22:17:57.875409 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:17:57.875397 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d9e1dc47-a311-4003-afc0-2f583f2678aa" containerName="node" Nov 02 22:17:57.875560 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:17:57.875455 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="f52ada2d-ddba-4a8b-9cd6-bc691539d066" containerName="node" Nov 02 22:17:57.875560 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:17:57.875463 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="c8796e46-c2e2-4912-aed4-4d6a5b526ded" containerName="node" Nov 02 22:17:57.875560 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:17:57.875470 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="d9e1dc47-a311-4003-afc0-2f583f2678aa" containerName="node" Nov 02 22:17:57.879920 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:17:57.879902 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-s9sfm/progression-no-metrics-node-0-0-ks46d" Nov 02 22:17:57.899248 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:17:57.899226 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-s9sfm\"/\"openshift-service-ca.crt\"" Nov 02 22:17:57.899424 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:17:57.899332 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-s9sfm\"/\"default-dockercfg-x2tr8\"" Nov 02 22:17:57.899485 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:17:57.899464 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-s9sfm\"/\"kube-root-ca.crt\"" Nov 02 22:17:57.899644 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:17:57.899626 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-s9sfm/progression-no-metrics-node-0-0-ks46d"] Nov 02 22:17:57.953956 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:17:57.953922 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psdvs\" (UniqueName: \"kubernetes.io/projected/2e66941e-6901-43e2-8830-0a8e6857ceb8-kube-api-access-psdvs\") pod \"progression-no-metrics-node-0-0-ks46d\" (UID: \"2e66941e-6901-43e2-8830-0a8e6857ceb8\") " pod="rhai-e2e-progression-s9sfm/progression-no-metrics-node-0-0-ks46d" Nov 02 22:17:57.969965 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:17:57.969938 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:17:58.054512 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:17:58.054482 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psdvs\" (UniqueName: \"kubernetes.io/projected/2e66941e-6901-43e2-8830-0a8e6857ceb8-kube-api-access-psdvs\") pod \"progression-no-metrics-node-0-0-ks46d\" (UID: \"2e66941e-6901-43e2-8830-0a8e6857ceb8\") " pod="rhai-e2e-progression-s9sfm/progression-no-metrics-node-0-0-ks46d" Nov 02 22:17:58.072958 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:17:58.072934 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psdvs\" (UniqueName: \"kubernetes.io/projected/2e66941e-6901-43e2-8830-0a8e6857ceb8-kube-api-access-psdvs\") pod \"progression-no-metrics-node-0-0-ks46d\" (UID: \"2e66941e-6901-43e2-8830-0a8e6857ceb8\") " pod="rhai-e2e-progression-s9sfm/progression-no-metrics-node-0-0-ks46d" Nov 02 22:17:58.191017 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:17:58.190928 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-s9sfm/progression-no-metrics-node-0-0-ks46d" Nov 02 22:17:58.457319 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:17:58.457223 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:17:58.469214 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:17:58.469188 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-s9sfm/progression-no-metrics-node-0-0-ks46d"] Nov 02 22:17:58.472633 ip-10-0-139-99 kubenswrapper[5963]: W1102 22:17:58.472601 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e66941e_6901_43e2_8830_0a8e6857ceb8.slice/crio-6650dec80f21fd7d6a969646785c26c8dbfc93b8880411174286df4f75e0c271 WatchSource:0}: Error finding container 6650dec80f21fd7d6a969646785c26c8dbfc93b8880411174286df4f75e0c271: Status 404 returned error can't find the container with id 6650dec80f21fd7d6a969646785c26c8dbfc93b8880411174286df4f75e0c271 Nov 02 22:17:59.122540 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:17:59.122505 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:17:59.356584 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:17:59.356544 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-s9sfm/progression-no-metrics-node-0-0-ks46d" event={"ID":"2e66941e-6901-43e2-8830-0a8e6857ceb8","Type":"ContainerStarted","Data":"82c722f7b34a1ff6aba245d2666519fd4e82e2b714a927d187baa80668b7ee31"} Nov 02 22:17:59.356803 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:17:59.356595 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-s9sfm/progression-no-metrics-node-0-0-ks46d" event={"ID":"2e66941e-6901-43e2-8830-0a8e6857ceb8","Type":"ContainerStarted","Data":"6650dec80f21fd7d6a969646785c26c8dbfc93b8880411174286df4f75e0c271"} Nov 02 22:17:59.376483 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:17:59.376391 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="rhai-e2e-progression-s9sfm/progression-no-metrics-node-0-0-ks46d" podStartSLOduration=2.376377265 podStartE2EDuration="2.376377265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:17:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:17:59.375934878 +0000 UTC m=+1451.627933336" watchObservedRunningTime="2026-11-02 22:17:59.376377265 +0000 UTC m=+1451.628375809" Nov 02 22:18:04.383395 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:18:04.383363 5963 generic.go:356] "Generic (PLEG): container finished" podID="2e66941e-6901-43e2-8830-0a8e6857ceb8" containerID="82c722f7b34a1ff6aba245d2666519fd4e82e2b714a927d187baa80668b7ee31" exitCode=0 Nov 02 22:18:04.383864 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:18:04.383439 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-s9sfm/progression-no-metrics-node-0-0-ks46d" event={"ID":"2e66941e-6901-43e2-8830-0a8e6857ceb8","Type":"ContainerDied","Data":"82c722f7b34a1ff6aba245d2666519fd4e82e2b714a927d187baa80668b7ee31"} Nov 02 22:18:05.518358 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:18:05.518332 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-s9sfm/progression-no-metrics-node-0-0-ks46d" Nov 02 22:18:05.619679 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:18:05.619630 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2e66941e-6901-43e2-8830-0a8e6857ceb8-kube-api-access-psdvs\" (UniqueName: \"kubernetes.io/projected/2e66941e-6901-43e2-8830-0a8e6857ceb8-kube-api-access-psdvs\") pod \"2e66941e-6901-43e2-8830-0a8e6857ceb8\" (UID: \"2e66941e-6901-43e2-8830-0a8e6857ceb8\") " Nov 02 22:18:05.621891 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:18:05.621862 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e66941e-6901-43e2-8830-0a8e6857ceb8-kube-api-access-psdvs" pod "2e66941e-6901-43e2-8830-0a8e6857ceb8" (UID: "2e66941e-6901-43e2-8830-0a8e6857ceb8"). InnerVolumeSpecName "kube-api-access-psdvs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 22:18:05.720437 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:18:05.720347 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psdvs\" (UniqueName: \"kubernetes.io/projected/2e66941e-6901-43e2-8830-0a8e6857ceb8-kube-api-access-psdvs\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:18:06.393583 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:18:06.393551 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-s9sfm/progression-no-metrics-node-0-0-ks46d" Nov 02 22:18:06.393770 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:18:06.393555 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-s9sfm/progression-no-metrics-node-0-0-ks46d" event={"ID":"2e66941e-6901-43e2-8830-0a8e6857ceb8","Type":"ContainerDied","Data":"6650dec80f21fd7d6a969646785c26c8dbfc93b8880411174286df4f75e0c271"} Nov 02 22:18:06.393770 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:18:06.393658 5963 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6650dec80f21fd7d6a969646785c26c8dbfc93b8880411174286df4f75e0c271" Nov 02 22:18:08.235047 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:18:08.235002 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:18:13.192364 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:18:13.192327 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-s9sfm/progression-custom-config-node-0-0-ts4mx"] Nov 02 22:18:13.199496 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:18:13.199469 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-s9sfm/progression-custom-config-node-0-0-ts4mx"] Nov 02 22:18:13.204254 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:18:13.204229 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-s9sfm/progression-disabled-node-0-0-m2qct"] Nov 02 22:18:13.208905 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:18:13.208879 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-s9sfm/progression-disabled-node-0-0-m2qct"] Nov 02 22:18:13.216568 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:18:13.216542 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-s9sfm/progression-enabled-node-0-0-h92jq"] Nov 02 22:18:13.223388 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:18:13.223367 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-s9sfm/progression-enabled-node-0-0-h92jq"] Nov 02 22:18:13.229154 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:18:13.229129 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-s9sfm/progression-invalid-node-0-0-skq52"] Nov 02 22:18:13.233888 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:18:13.233866 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-s9sfm/progression-invalid-node-0-0-skq52"] Nov 02 22:18:13.255331 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:18:13.255295 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-s9sfm/progression-min-interval-node-0-0-dpgc9"] Nov 02 22:18:13.260271 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:18:13.260251 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-s9sfm/progression-min-interval-node-0-0-dpgc9"] Nov 02 22:18:13.265617 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:18:13.265596 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-s9sfm/progression-no-metrics-node-0-0-ks46d"] Nov 02 22:18:13.270121 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:18:13.270103 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-s9sfm/progression-no-metrics-node-0-0-ks46d"] Nov 02 22:18:13.498522 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:18:13.498428 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:18:13.598117 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:18:13.598084 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:18:13.868459 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:18:13.868424 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2e66941e-6901-43e2-8830-0a8e6857ceb8" path="/var/lib/kubelet/pods/2e66941e-6901-43e2-8830-0a8e6857ceb8/volumes" Nov 02 22:18:13.868760 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:18:13.868747 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="93b42983-fb9f-4514-92f6-a1e16b43fb6b" path="/var/lib/kubelet/pods/93b42983-fb9f-4514-92f6-a1e16b43fb6b/volumes" Nov 02 22:18:13.869025 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:18:13.869014 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b68c11fa-2cf6-4e92-a1ea-c1a2fefc0930" path="/var/lib/kubelet/pods/b68c11fa-2cf6-4e92-a1ea-c1a2fefc0930/volumes" Nov 02 22:18:13.869283 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:18:13.869273 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c8796e46-c2e2-4912-aed4-4d6a5b526ded" path="/var/lib/kubelet/pods/c8796e46-c2e2-4912-aed4-4d6a5b526ded/volumes" Nov 02 22:18:13.869907 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:18:13.869893 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d9e1dc47-a311-4003-afc0-2f583f2678aa" path="/var/lib/kubelet/pods/d9e1dc47-a311-4003-afc0-2f583f2678aa/volumes" Nov 02 22:18:13.870164 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:18:13.870153 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f52ada2d-ddba-4a8b-9cd6-bc691539d066" path="/var/lib/kubelet/pods/f52ada2d-ddba-4a8b-9cd6-bc691539d066/volumes" Nov 02 22:18:14.549974 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:18:14.549936 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:18:14.646044 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:18:14.646014 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:18:29.122446 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:18:29.122405 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:18:48.091755 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:18:48.091724 5963 scope.go:122] "RemoveContainer" containerID="bbb36f7f99e4fd1c70f275dd3732960cdb0eb20c930786d6264f8987ab5283c1" Nov 02 22:18:48.101787 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:18:48.101759 5963 scope.go:122] "RemoveContainer" containerID="74408e6f3e7ba9c1b4451138b3b3ed84e66c2d7395db2e938bda1d669f49838d" Nov 02 22:18:48.110655 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:18:48.110636 5963 scope.go:122] "RemoveContainer" containerID="2427855e6429299f76f5fe6afb3ba8a23660084b1fd71a43a5315e9998ca4940" Nov 02 22:18:56.011197 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:18:56.011156 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:18:56.113350 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:18:56.113319 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:18:57.201852 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:18:57.201821 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:18:58.509591 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:18:58.509548 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:18:59.123571 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:18:59.123538 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:19:00.061263 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:00.061229 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:19:00.104335 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:00.104300 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-cxrrt/test-trainjob-h89sl-node-0-0-lxb6t"] Nov 02 22:19:00.104743 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:00.104726 5963 cpu_manager.go:414] "containerMap: removing container" podUID="2e66941e-6901-43e2-8830-0a8e6857ceb8" containerName="node" Nov 02 22:19:00.104849 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:00.104745 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2e66941e-6901-43e2-8830-0a8e6857ceb8" containerName="node" Nov 02 22:19:00.104849 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:00.104842 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="2e66941e-6901-43e2-8830-0a8e6857ceb8" containerName="node" Nov 02 22:19:00.109447 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:00.109426 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-cxrrt/test-trainjob-h89sl-node-0-0-lxb6t" Nov 02 22:19:00.119622 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:00.119597 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-cxrrt\"/\"default-dockercfg-s7ckj\"" Nov 02 22:19:00.119940 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:00.119920 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-cxrrt/test-trainjob-h89sl-node-0-0-lxb6t"] Nov 02 22:19:00.124266 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:00.124248 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-cxrrt\"/\"openshift-service-ca.crt\"" Nov 02 22:19:00.129394 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:00.129375 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-cxrrt\"/\"kube-root-ca.crt\"" Nov 02 22:19:00.208755 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:00.208717 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:19:00.218875 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:00.218839 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9wlz\" (UniqueName: \"kubernetes.io/projected/4f7a9957-7f4c-4ff1-afbe-5ef00f22e830-kube-api-access-s9wlz\") pod \"test-trainjob-h89sl-node-0-0-lxb6t\" (UID: \"4f7a9957-7f4c-4ff1-afbe-5ef00f22e830\") " pod="test-ns-cxrrt/test-trainjob-h89sl-node-0-0-lxb6t" Nov 02 22:19:00.319768 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:00.319646 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9wlz\" (UniqueName: \"kubernetes.io/projected/4f7a9957-7f4c-4ff1-afbe-5ef00f22e830-kube-api-access-s9wlz\") pod \"test-trainjob-h89sl-node-0-0-lxb6t\" (UID: \"4f7a9957-7f4c-4ff1-afbe-5ef00f22e830\") " pod="test-ns-cxrrt/test-trainjob-h89sl-node-0-0-lxb6t" Nov 02 22:19:00.332140 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:00.332115 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9wlz\" (UniqueName: \"kubernetes.io/projected/4f7a9957-7f4c-4ff1-afbe-5ef00f22e830-kube-api-access-s9wlz\") pod \"test-trainjob-h89sl-node-0-0-lxb6t\" (UID: \"4f7a9957-7f4c-4ff1-afbe-5ef00f22e830\") " pod="test-ns-cxrrt/test-trainjob-h89sl-node-0-0-lxb6t" Nov 02 22:19:00.420760 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:00.420710 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-cxrrt/test-trainjob-h89sl-node-0-0-lxb6t" Nov 02 22:19:00.694433 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:00.694352 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-cxrrt/test-trainjob-h89sl-node-0-0-lxb6t"] Nov 02 22:19:00.698550 ip-10-0-139-99 kubenswrapper[5963]: W1102 22:19:00.698523 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f7a9957_7f4c_4ff1_afbe_5ef00f22e830.slice/crio-6b5efc5e484dd8ed21caaae4e432aca6617cc8c05af53e973a9fc19e62eabcd5 WatchSource:0}: Error finding container 6b5efc5e484dd8ed21caaae4e432aca6617cc8c05af53e973a9fc19e62eabcd5: Status 404 returned error can't find the container with id 6b5efc5e484dd8ed21caaae4e432aca6617cc8c05af53e973a9fc19e62eabcd5 Nov 02 22:19:01.644788 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:01.644753 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-cxrrt/test-trainjob-h89sl-node-0-0-lxb6t" event={"ID":"4f7a9957-7f4c-4ff1-afbe-5ef00f22e830","Type":"ContainerStarted","Data":"b092544be9140fade56f6dbbbe1aef3ebed8654c05ad5223e7ee26e33c09b616"} Nov 02 22:19:01.645211 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:01.644796 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-cxrrt/test-trainjob-h89sl-node-0-0-lxb6t" event={"ID":"4f7a9957-7f4c-4ff1-afbe-5ef00f22e830","Type":"ContainerStarted","Data":"6b5efc5e484dd8ed21caaae4e432aca6617cc8c05af53e973a9fc19e62eabcd5"} Nov 02 22:19:02.337807 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:02.337767 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:19:03.019253 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:03.019225 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:19:06.018446 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:06.018414 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:19:07.376550 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:07.376505 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:19:08.075770 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:08.075736 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:19:08.683347 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:08.683317 5963 generic.go:356] "Generic (PLEG): container finished" podID="4f7a9957-7f4c-4ff1-afbe-5ef00f22e830" containerID="b092544be9140fade56f6dbbbe1aef3ebed8654c05ad5223e7ee26e33c09b616" exitCode=0 Nov 02 22:19:08.683752 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:08.683389 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-cxrrt/test-trainjob-h89sl-node-0-0-lxb6t" event={"ID":"4f7a9957-7f4c-4ff1-afbe-5ef00f22e830","Type":"ContainerDied","Data":"b092544be9140fade56f6dbbbe1aef3ebed8654c05ad5223e7ee26e33c09b616"} Nov 02 22:19:09.019140 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:09.019114 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:19:09.820483 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:09.820449 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-cxrrt/test-trainjob-h89sl-node-0-0-lxb6t" Nov 02 22:19:10.008577 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:10.008499 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4f7a9957-7f4c-4ff1-afbe-5ef00f22e830-kube-api-access-s9wlz\" (UniqueName: \"kubernetes.io/projected/4f7a9957-7f4c-4ff1-afbe-5ef00f22e830-kube-api-access-s9wlz\") pod \"4f7a9957-7f4c-4ff1-afbe-5ef00f22e830\" (UID: \"4f7a9957-7f4c-4ff1-afbe-5ef00f22e830\") " Nov 02 22:19:10.010858 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:10.010827 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f7a9957-7f4c-4ff1-afbe-5ef00f22e830-kube-api-access-s9wlz" pod "4f7a9957-7f4c-4ff1-afbe-5ef00f22e830" (UID: "4f7a9957-7f4c-4ff1-afbe-5ef00f22e830"). InnerVolumeSpecName "kube-api-access-s9wlz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 22:19:10.109493 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:10.109452 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9wlz\" (UniqueName: \"kubernetes.io/projected/4f7a9957-7f4c-4ff1-afbe-5ef00f22e830-kube-api-access-s9wlz\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:19:10.693492 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:10.693456 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-cxrrt/test-trainjob-h89sl-node-0-0-lxb6t" event={"ID":"4f7a9957-7f4c-4ff1-afbe-5ef00f22e830","Type":"ContainerDied","Data":"6b5efc5e484dd8ed21caaae4e432aca6617cc8c05af53e973a9fc19e62eabcd5"} Nov 02 22:19:10.693492 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:10.693497 5963 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b5efc5e484dd8ed21caaae4e432aca6617cc8c05af53e973a9fc19e62eabcd5" Nov 02 22:19:10.693725 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:10.693466 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-cxrrt/test-trainjob-h89sl-node-0-0-lxb6t" Nov 02 22:19:11.331990 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:11.331959 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:19:11.371030 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:11.370995 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-zdbhw/test-trainjob-ccf5j-node-0-0-2cx9l"] Nov 02 22:19:11.371358 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:11.371344 5963 cpu_manager.go:414] "containerMap: removing container" podUID="4f7a9957-7f4c-4ff1-afbe-5ef00f22e830" containerName="node" Nov 02 22:19:11.371407 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:11.371361 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4f7a9957-7f4c-4ff1-afbe-5ef00f22e830" containerName="node" Nov 02 22:19:11.371446 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:11.371437 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="4f7a9957-7f4c-4ff1-afbe-5ef00f22e830" containerName="node" Nov 02 22:19:11.374440 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:11.374419 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-zdbhw/test-trainjob-ccf5j-node-0-0-2cx9l" Nov 02 22:19:11.379592 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:11.379569 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-zdbhw\"/\"kube-root-ca.crt\"" Nov 02 22:19:11.379725 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:11.379579 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-zdbhw\"/\"default-dockercfg-z4ftz\"" Nov 02 22:19:11.379725 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:11.379624 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-zdbhw\"/\"openshift-service-ca.crt\"" Nov 02 22:19:11.383898 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:11.383873 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-zdbhw/test-trainjob-ccf5j-node-0-0-2cx9l"] Nov 02 22:19:11.419041 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:11.419010 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9d7h\" (UniqueName: \"kubernetes.io/projected/5535be25-33ac-45f3-bb67-7f79c7bc2343-kube-api-access-p9d7h\") pod \"test-trainjob-ccf5j-node-0-0-2cx9l\" (UID: \"5535be25-33ac-45f3-bb67-7f79c7bc2343\") " pod="test-ns-zdbhw/test-trainjob-ccf5j-node-0-0-2cx9l" Nov 02 22:19:11.429224 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:11.429138 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:19:11.519969 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:11.519931 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9d7h\" (UniqueName: \"kubernetes.io/projected/5535be25-33ac-45f3-bb67-7f79c7bc2343-kube-api-access-p9d7h\") pod \"test-trainjob-ccf5j-node-0-0-2cx9l\" (UID: \"5535be25-33ac-45f3-bb67-7f79c7bc2343\") " pod="test-ns-zdbhw/test-trainjob-ccf5j-node-0-0-2cx9l" Nov 02 22:19:11.533582 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:11.533545 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9d7h\" (UniqueName: \"kubernetes.io/projected/5535be25-33ac-45f3-bb67-7f79c7bc2343-kube-api-access-p9d7h\") pod \"test-trainjob-ccf5j-node-0-0-2cx9l\" (UID: \"5535be25-33ac-45f3-bb67-7f79c7bc2343\") " pod="test-ns-zdbhw/test-trainjob-ccf5j-node-0-0-2cx9l" Nov 02 22:19:11.686710 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:11.686573 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-zdbhw/test-trainjob-ccf5j-node-0-0-2cx9l" Nov 02 22:19:11.963939 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:11.963861 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-zdbhw/test-trainjob-ccf5j-node-0-0-2cx9l"] Nov 02 22:19:11.967244 ip-10-0-139-99 kubenswrapper[5963]: W1102 22:19:11.967220 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5535be25_33ac_45f3_bb67_7f79c7bc2343.slice/crio-6590f9033a035fdffbb72c619f5b81aa40b8e7977f7f85b43606ac556090f732 WatchSource:0}: Error finding container 6590f9033a035fdffbb72c619f5b81aa40b8e7977f7f85b43606ac556090f732: Status 404 returned error can't find the container with id 6590f9033a035fdffbb72c619f5b81aa40b8e7977f7f85b43606ac556090f732 Nov 02 22:19:11.969354 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:11.969336 5963 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 02 22:19:12.026651 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:12.026622 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:19:12.703692 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:12.703637 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-zdbhw/test-trainjob-ccf5j-node-0-0-2cx9l" event={"ID":"5535be25-33ac-45f3-bb67-7f79c7bc2343","Type":"ContainerStarted","Data":"6590f9033a035fdffbb72c619f5b81aa40b8e7977f7f85b43606ac556090f732"} Nov 02 22:19:15.019966 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:15.019934 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:19:18.019891 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:18.019679 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:19:21.019506 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:21.019479 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:19:24.019646 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:24.019616 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:19:27.018787 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:27.018625 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:19:29.124365 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:19:29.124323 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:19:30.019917 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:30.019889 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:19:33.022372 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:33.022334 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:19:36.018996 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:36.018953 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:19:39.018729 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:39.018699 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:19:42.018395 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:42.018361 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:19:45.018065 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:45.018028 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:19:48.018699 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:48.018587 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:19:51.019124 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:51.019097 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:19:54.018989 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:54.018960 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:19:54.437890 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:54.437849 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:19:54.536138 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:54.536100 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:19:57.018605 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:57.018577 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:19:58.559645 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:19:58.559605 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:19:59.127828 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:19:59.127787 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:20:00.018914 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:20:00.018885 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:20:03.018947 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:20:03.018912 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:20:06.019043 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:20:06.019012 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:20:09.019676 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:20:09.019647 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:20:12.019424 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:20:12.019392 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:20:15.018819 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:20:15.018784 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:20:18.019639 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:20:18.019605 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:20:21.018959 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:20:21.018920 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:20:24.019269 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:20:24.019235 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:20:27.020438 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:20:27.020393 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:20:29.125247 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:20:29.125206 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:20:30.019321 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:20:30.019291 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:20:33.019150 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:20:33.019125 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:20:36.018636 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:20:36.018601 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:20:38.450634 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:20:38.450601 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:20:39.018301 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:20:39.018272 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:20:42.018936 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:20:42.018894 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:20:45.018603 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:20:45.018573 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:20:48.018267 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:20:48.018238 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:20:51.018492 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:20:51.018458 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:20:54.018871 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:20:54.018834 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:20:57.019166 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:20:57.019085 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:20:58.617506 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:20:58.617469 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:20:59.122732 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:20:59.122700 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:21:00.019560 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:21:00.018581 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:21:03.018242 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:21:03.018218 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:21:06.018356 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:21:06.018326 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:21:09.018944 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:21:09.018905 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:21:12.018797 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:21:12.018763 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:21:15.018806 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:21:15.018777 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:21:18.021658 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:21:18.021619 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:21:21.019002 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:21:21.018969 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:21:24.019213 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:21:24.019186 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:21:27.019139 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:21:27.019108 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:21:29.128607 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:21:29.128566 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:21:30.018852 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:21:30.018821 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:21:33.018827 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:21:33.018792 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:21:36.018264 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:21:36.018230 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:21:39.018587 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:21:39.018550 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:21:42.018527 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:21:42.018500 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:21:45.018337 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:21:45.018300 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:21:48.018265 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:21:48.018235 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:21:48.154887 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:21:48.154859 5963 scope.go:122] "RemoveContainer" containerID="7fcd42847c46823ff8ec9dde210e36910835e3c57e8200f6caa65ad392600678" Nov 02 22:21:48.163816 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:21:48.163792 5963 scope.go:122] "RemoveContainer" containerID="d82473f6eb5c6947c741bd56f3c90fd04bd5d401ec67aeb80c3121539d3219d0" Nov 02 22:21:51.019053 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:21:51.019022 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:21:54.018240 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:21:54.018171 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:21:57.018559 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:21:57.018527 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:21:58.668950 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:21:58.668917 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:21:59.129180 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:21:59.129144 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:22:00.018576 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:22:00.018547 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:22:03.018826 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:22:03.018794 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:22:06.020805 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:22:06.020765 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:22:09.019223 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:22:09.019189 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:22:12.018580 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:22:12.018543 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:22:15.018329 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:22:15.018298 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:22:18.018952 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:22:18.018914 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:22:21.019012 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:22:21.018983 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:22:24.019592 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:22:24.019563 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:22:27.018485 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:22:27.018400 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:22:29.126564 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:22:29.126524 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:22:30.019234 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:22:30.019198 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:22:33.019335 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:22:33.019296 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:22:36.018470 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:22:36.018434 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:22:39.018386 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:22:39.018349 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:22:42.018979 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:22:42.018947 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:22:45.018297 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:22:45.018263 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:22:48.018523 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:22:48.018494 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:22:48.186252 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:22:48.186213 5963 scope.go:122] "RemoveContainer" containerID="262250ca6d70edf2079272c2515474fe8773756d682d615c3d74b1087f3fcf2c" Nov 02 22:22:48.197197 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:22:48.197175 5963 scope.go:122] "RemoveContainer" containerID="00d8361bbc764b53d8c21e98dd24d7c25379eb76c3cbcacf8c63c006f1f5eaa1" Nov 02 22:22:48.208269 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:22:48.208248 5963 scope.go:122] "RemoveContainer" containerID="87a07cfb48d4c7f432e3124c4a66167b675e701a36bbdd0a25ce90cc716d98ea" Nov 02 22:22:51.019021 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:22:51.018987 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:22:54.018771 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:22:54.018741 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:22:57.018806 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:22:57.018773 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:22:58.726245 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:22:58.726199 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:22:59.127588 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:22:59.127549 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:23:00.018329 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:23:00.018267 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:23:03.018387 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:23:03.018354 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:23:06.022797 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:23:06.022764 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:23:09.022360 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:23:09.022333 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:23:12.022315 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:23:12.022163 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:23:15.023453 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:23:15.023420 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:23:18.018889 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:23:18.018857 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:23:21.022265 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:23:21.022218 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:23:24.024284 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:23:24.024254 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:23:27.019854 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:23:27.019819 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:23:29.129609 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:23:29.129570 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:23:30.020218 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:23:30.020167 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:23:33.020295 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:23:33.020265 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:23:36.020769 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:23:36.019218 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:23:39.019806 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:23:39.019771 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:23:42.019283 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:23:42.019135 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:23:45.019536 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:23:45.019499 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:23:48.019155 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:23:48.019120 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:23:51.019064 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:23:51.019030 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:23:54.019386 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:23:54.019355 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:23:57.019431 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:23:57.019342 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:23:58.787312 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:23:58.787261 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:23:59.128095 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:23:59.128046 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:24:00.018802 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:24:00.018767 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:24:03.018854 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:24:03.018825 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:24:06.019208 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:24:06.019178 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:24:09.019591 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:24:09.019551 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:24:12.019479 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:24:12.019446 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:24:15.018793 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:24:15.018759 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:24:18.018358 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:24:18.018327 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:24:21.019168 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:24:21.019137 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:24:24.018916 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:24:24.018890 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:24:27.019258 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:24:27.019225 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:24:29.124404 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:24:29.124365 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:24:30.019310 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:24:30.019251 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:24:33.019142 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:24:33.019110 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:24:36.019293 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:24:36.019253 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:24:39.018793 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:24:39.018749 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:24:42.018579 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:24:42.018551 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:24:45.018640 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:24:45.018609 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:24:48.018761 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:24:48.018731 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:24:48.247535 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:24:48.247505 5963 scope.go:122] "RemoveContainer" containerID="82c722f7b34a1ff6aba245d2666519fd4e82e2b714a927d187baa80668b7ee31" Nov 02 22:24:51.019020 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:24:51.018991 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:24:54.018885 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:24:54.018855 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:24:57.018936 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:24:57.018903 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:24:58.810166 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:24:58.810127 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:24:59.127205 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:24:59.127120 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:25:00.018980 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:25:00.018947 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:25:03.019258 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:25:03.019204 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:25:06.019549 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:25:06.019518 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:25:09.019804 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:25:09.019765 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:25:12.024351 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:25:12.024317 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:25:15.019681 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:25:15.019632 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:25:18.018991 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:25:18.018956 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:25:21.019446 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:25:21.019411 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:25:24.019197 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:25:24.019165 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:25:27.019632 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:25:27.019540 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:25:29.127729 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:25:29.127691 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:25:30.019003 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:25:30.018973 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:25:33.018829 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:25:33.018797 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:25:35.074841 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:25:35.074807 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:25:36.018918 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:25:36.018891 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:25:39.018861 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:25:39.018818 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:25:42.019234 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:25:42.019201 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:25:45.018900 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:25:45.018871 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:25:48.021130 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:25:48.021036 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:25:50.621243 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:25:50.621204 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:25:51.019241 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:25:51.019162 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:25:54.018509 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:25:54.018479 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:25:57.018466 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:25:57.018440 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:25:58.885067 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:25:58.885027 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:25:59.123965 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:25:59.123928 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:26:00.018980 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:26:00.018947 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:26:03.019762 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:26:03.019707 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:26:06.018990 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:26:06.018959 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:26:09.019966 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:26:09.019933 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:26:12.019381 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:26:12.019339 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:26:15.019479 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:26:15.019447 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:26:18.018584 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:26:18.018524 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:26:21.018906 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:26:21.018878 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:26:24.019022 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:26:24.018986 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:26:27.019103 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:26:27.019071 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:26:29.125064 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:26:29.125025 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:26:30.019058 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:26:30.019028 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:26:33.019067 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:26:33.019035 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:26:34.533509 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:26:34.533472 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:26:34.634788 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:26:34.634747 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:26:36.018577 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:26:36.018547 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:26:39.018756 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:26:39.018713 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:26:42.018840 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:26:42.018803 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:26:45.018723 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:26:45.018691 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:26:48.019433 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:26:48.019405 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:26:51.019433 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:26:51.019395 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:26:54.019185 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:26:54.019150 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:26:56.963629 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:26:56.963548 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-zdbhw/test-trainjob-ccf5j-node-0-0-2cx9l" event={"ID":"5535be25-33ac-45f3-bb67-7f79c7bc2343","Type":"ContainerStarted","Data":"c2f47c448cb9cb3c296e9efa2790c49d5999604561f067484b82c0d940ac09cc"} Nov 02 22:26:56.966541 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:26:56.966524 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-zdbhw\"/\"default-dockercfg-z4ftz\"" Nov 02 22:26:56.993568 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:26:56.993517 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-zdbhw/test-trainjob-ccf5j-node-0-0-2cx9l" podStartSLOduration=1.7553512420000001 podStartE2EDuration="7m45.993502939s" totalImagesPullingTime="7m44.238151697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:19:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:26:56.99297619 +0000 UTC m=+1989.244974680" watchObservedRunningTime="2026-11-02 22:26:56.993502939 +0000 UTC m=+1989.245501405" Nov 02 22:26:57.018786 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:26:57.018761 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:26:57.055961 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:26:57.055933 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-zdbhw\"/\"kube-root-ca.crt\"" Nov 02 22:26:57.066898 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:26:57.066876 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-zdbhw\"/\"openshift-service-ca.crt\"" Nov 02 22:26:58.949555 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:26:58.949517 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:26:59.125081 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:26:59.125041 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:26:59.288314 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:26:59.288225 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-zdbhw_test-trainjob-ccf5j-node-0-0-2cx9l_5535be25-33ac-45f3-bb67-7f79c7bc2343/node/0.log" Nov 02 22:27:00.019512 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:00.019481 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:27:01.986726 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:01.986693 5963 generic.go:356] "Generic (PLEG): container finished" podID="5535be25-33ac-45f3-bb67-7f79c7bc2343" containerID="c2f47c448cb9cb3c296e9efa2790c49d5999604561f067484b82c0d940ac09cc" exitCode=0 Nov 02 22:27:01.987130 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:01.986732 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-zdbhw/test-trainjob-ccf5j-node-0-0-2cx9l" event={"ID":"5535be25-33ac-45f3-bb67-7f79c7bc2343","Type":"ContainerDied","Data":"c2f47c448cb9cb3c296e9efa2790c49d5999604561f067484b82c0d940ac09cc"} Nov 02 22:27:02.288926 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:02.288842 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-zdbhw_test-trainjob-ccf5j-node-0-0-2cx9l_5535be25-33ac-45f3-bb67-7f79c7bc2343/node/0.log" Nov 02 22:27:03.021225 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:03.021202 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:27:03.132794 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:03.132769 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-zdbhw/test-trainjob-ccf5j-node-0-0-2cx9l" Nov 02 22:27:03.212402 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:03.212370 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5535be25-33ac-45f3-bb67-7f79c7bc2343-kube-api-access-p9d7h\" (UniqueName: \"kubernetes.io/projected/5535be25-33ac-45f3-bb67-7f79c7bc2343-kube-api-access-p9d7h\") pod \"5535be25-33ac-45f3-bb67-7f79c7bc2343\" (UID: \"5535be25-33ac-45f3-bb67-7f79c7bc2343\") " Nov 02 22:27:03.214788 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:03.214759 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5535be25-33ac-45f3-bb67-7f79c7bc2343-kube-api-access-p9d7h" pod "5535be25-33ac-45f3-bb67-7f79c7bc2343" (UID: "5535be25-33ac-45f3-bb67-7f79c7bc2343"). InnerVolumeSpecName "kube-api-access-p9d7h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 22:27:03.313220 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:03.313197 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9d7h\" (UniqueName: \"kubernetes.io/projected/5535be25-33ac-45f3-bb67-7f79c7bc2343-kube-api-access-p9d7h\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:27:03.996090 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:03.996050 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-zdbhw/test-trainjob-ccf5j-node-0-0-2cx9l" event={"ID":"5535be25-33ac-45f3-bb67-7f79c7bc2343","Type":"ContainerDied","Data":"6590f9033a035fdffbb72c619f5b81aa40b8e7977f7f85b43606ac556090f732"} Nov 02 22:27:03.996090 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:03.996088 5963 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6590f9033a035fdffbb72c619f5b81aa40b8e7977f7f85b43606ac556090f732" Nov 02 22:27:03.996090 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:03.996061 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-zdbhw/test-trainjob-ccf5j-node-0-0-2cx9l" Nov 02 22:27:04.385718 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:04.385681 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:27:04.643107 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:04.643015 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:27:04.696304 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:04.696247 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-86skg/test-trainjob-848ks-node-0-0-fs8ql"] Nov 02 22:27:04.697382 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:04.697351 5963 cpu_manager.go:414] "containerMap: removing container" podUID="5535be25-33ac-45f3-bb67-7f79c7bc2343" containerName="node" Nov 02 22:27:04.697382 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:04.697377 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5535be25-33ac-45f3-bb67-7f79c7bc2343" containerName="node" Nov 02 22:27:04.697588 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:04.697556 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="5535be25-33ac-45f3-bb67-7f79c7bc2343" containerName="node" Nov 02 22:27:04.756952 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:04.756916 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:27:04.761924 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:04.761897 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-86skg/test-trainjob-848ks-node-0-0-fs8ql"] Nov 02 22:27:04.762053 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:04.762003 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-86skg/test-trainjob-848ks-node-0-0-fs8ql" Nov 02 22:27:04.767117 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:04.767095 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-86skg\"/\"kube-root-ca.crt\"" Nov 02 22:27:04.767117 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:04.767109 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-86skg\"/\"openshift-service-ca.crt\"" Nov 02 22:27:04.767299 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:04.767183 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-86skg\"/\"default-dockercfg-nd24d\"" Nov 02 22:27:04.827239 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:04.827200 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l65r6\" (UniqueName: \"kubernetes.io/projected/b0130f56-4227-4a6b-b412-c0228f3d3283-kube-api-access-l65r6\") pod \"test-trainjob-848ks-node-0-0-fs8ql\" (UID: \"b0130f56-4227-4a6b-b412-c0228f3d3283\") " pod="test-ns-86skg/test-trainjob-848ks-node-0-0-fs8ql" Nov 02 22:27:04.928453 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:04.928371 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l65r6\" (UniqueName: \"kubernetes.io/projected/b0130f56-4227-4a6b-b412-c0228f3d3283-kube-api-access-l65r6\") pod \"test-trainjob-848ks-node-0-0-fs8ql\" (UID: \"b0130f56-4227-4a6b-b412-c0228f3d3283\") " pod="test-ns-86skg/test-trainjob-848ks-node-0-0-fs8ql" Nov 02 22:27:04.941338 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:04.941314 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l65r6\" (UniqueName: \"kubernetes.io/projected/b0130f56-4227-4a6b-b412-c0228f3d3283-kube-api-access-l65r6\") pod \"test-trainjob-848ks-node-0-0-fs8ql\" (UID: \"b0130f56-4227-4a6b-b412-c0228f3d3283\") " pod="test-ns-86skg/test-trainjob-848ks-node-0-0-fs8ql" Nov 02 22:27:05.102382 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:05.102344 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-86skg/test-trainjob-848ks-node-0-0-fs8ql" Nov 02 22:27:05.288626 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:05.288598 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-zdbhw_test-trainjob-ccf5j-node-0-0-2cx9l_5535be25-33ac-45f3-bb67-7f79c7bc2343/node/0.log" Nov 02 22:27:05.415249 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:05.415219 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-86skg/test-trainjob-848ks-node-0-0-fs8ql"] Nov 02 22:27:05.422289 ip-10-0-139-99 kubenswrapper[5963]: W1102 22:27:05.418899 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0130f56_4227_4a6b_b412_c0228f3d3283.slice/crio-d55114dcbeb44ba0e9a2c9818eeb3216b16a0cd6c3905544dff1616c9a55cf73 WatchSource:0}: Error finding container d55114dcbeb44ba0e9a2c9818eeb3216b16a0cd6c3905544dff1616c9a55cf73: Status 404 returned error can't find the container with id d55114dcbeb44ba0e9a2c9818eeb3216b16a0cd6c3905544dff1616c9a55cf73 Nov 02 22:27:06.006289 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:06.006250 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-86skg/test-trainjob-848ks-node-0-0-fs8ql" event={"ID":"b0130f56-4227-4a6b-b412-c0228f3d3283","Type":"ContainerStarted","Data":"4c7330c08cba877b46e8cbdeb0c6bdd6ab54e560ec8187c83844ebf460229299"} Nov 02 22:27:06.006471 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:06.006309 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-86skg/test-trainjob-848ks-node-0-0-fs8ql" event={"ID":"b0130f56-4227-4a6b-b412-c0228f3d3283","Type":"ContainerStarted","Data":"d55114dcbeb44ba0e9a2c9818eeb3216b16a0cd6c3905544dff1616c9a55cf73"} Nov 02 22:27:06.018277 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:06.018249 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:27:06.026016 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:06.025975 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-86skg/test-trainjob-848ks-node-0-0-fs8ql" podStartSLOduration=2.025961045 podStartE2EDuration="2.025961045s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:27:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:27:06.024459325 +0000 UTC m=+1998.276457792" watchObservedRunningTime="2026-11-02 22:27:06.025961045 +0000 UTC m=+1998.277959513" Nov 02 22:27:07.345401 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:07.345369 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-86skg_test-trainjob-848ks-node-0-0-fs8ql_b0130f56-4227-4a6b-b412-c0228f3d3283/node/0.log" Nov 02 22:27:08.289273 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:08.289239 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-zdbhw_test-trainjob-ccf5j-node-0-0-2cx9l_5535be25-33ac-45f3-bb67-7f79c7bc2343/node/0.log" Nov 02 22:27:09.018752 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:09.018725 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:27:10.344699 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:10.344655 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-86skg_test-trainjob-848ks-node-0-0-fs8ql_b0130f56-4227-4a6b-b412-c0228f3d3283/node/0.log" Nov 02 22:27:11.288658 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:11.288626 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-zdbhw_test-trainjob-ccf5j-node-0-0-2cx9l_5535be25-33ac-45f3-bb67-7f79c7bc2343/node/0.log" Nov 02 22:27:12.019421 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:12.019390 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:27:13.344526 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:13.344447 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-86skg_test-trainjob-848ks-node-0-0-fs8ql_b0130f56-4227-4a6b-b412-c0228f3d3283/node/0.log" Nov 02 22:27:14.289114 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:14.289076 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-zdbhw_test-trainjob-ccf5j-node-0-0-2cx9l_5535be25-33ac-45f3-bb67-7f79c7bc2343/node/0.log" Nov 02 22:27:15.019811 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:15.019776 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:27:16.345213 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:16.345179 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-86skg_test-trainjob-848ks-node-0-0-fs8ql_b0130f56-4227-4a6b-b412-c0228f3d3283/node/0.log" Nov 02 22:27:17.054936 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:17.054900 5963 generic.go:356] "Generic (PLEG): container finished" podID="b0130f56-4227-4a6b-b412-c0228f3d3283" containerID="4c7330c08cba877b46e8cbdeb0c6bdd6ab54e560ec8187c83844ebf460229299" exitCode=0 Nov 02 22:27:17.055133 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:17.054942 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-86skg/test-trainjob-848ks-node-0-0-fs8ql" event={"ID":"b0130f56-4227-4a6b-b412-c0228f3d3283","Type":"ContainerDied","Data":"4c7330c08cba877b46e8cbdeb0c6bdd6ab54e560ec8187c83844ebf460229299"} Nov 02 22:27:17.288109 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:17.288065 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-zdbhw_test-trainjob-ccf5j-node-0-0-2cx9l_5535be25-33ac-45f3-bb67-7f79c7bc2343/node/0.log" Nov 02 22:27:18.019088 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:18.019049 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:27:18.213631 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:18.213606 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-86skg/test-trainjob-848ks-node-0-0-fs8ql" Nov 02 22:27:18.352968 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:18.352942 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b0130f56-4227-4a6b-b412-c0228f3d3283-kube-api-access-l65r6\" (UniqueName: \"kubernetes.io/projected/b0130f56-4227-4a6b-b412-c0228f3d3283-kube-api-access-l65r6\") pod \"b0130f56-4227-4a6b-b412-c0228f3d3283\" (UID: \"b0130f56-4227-4a6b-b412-c0228f3d3283\") " Nov 02 22:27:18.355285 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:18.355255 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0130f56-4227-4a6b-b412-c0228f3d3283-kube-api-access-l65r6" pod "b0130f56-4227-4a6b-b412-c0228f3d3283" (UID: "b0130f56-4227-4a6b-b412-c0228f3d3283"). InnerVolumeSpecName "kube-api-access-l65r6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 22:27:18.454516 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:18.454474 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l65r6\" (UniqueName: \"kubernetes.io/projected/b0130f56-4227-4a6b-b412-c0228f3d3283-kube-api-access-l65r6\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:27:19.064652 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:19.064624 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-86skg/test-trainjob-848ks-node-0-0-fs8ql" Nov 02 22:27:19.065065 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:19.064655 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-86skg/test-trainjob-848ks-node-0-0-fs8ql" event={"ID":"b0130f56-4227-4a6b-b412-c0228f3d3283","Type":"ContainerDied","Data":"d55114dcbeb44ba0e9a2c9818eeb3216b16a0cd6c3905544dff1616c9a55cf73"} Nov 02 22:27:19.065065 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:19.064705 5963 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d55114dcbeb44ba0e9a2c9818eeb3216b16a0cd6c3905544dff1616c9a55cf73" Nov 02 22:27:19.369348 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:19.369261 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-86skg_test-trainjob-848ks-node-0-0-fs8ql_b0130f56-4227-4a6b-b412-c0228f3d3283/node/0.log" Nov 02 22:27:19.694514 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:19.694435 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-86skg_test-trainjob-848ks-node-0-0-fs8ql_b0130f56-4227-4a6b-b412-c0228f3d3283/node/0.log" Nov 02 22:27:19.795182 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:19.795150 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-zdbhw_test-trainjob-ccf5j-node-0-0-2cx9l_5535be25-33ac-45f3-bb67-7f79c7bc2343/node/0.log" Nov 02 22:27:19.795471 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:19.795437 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:27:19.891361 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:19.891312 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:27:19.895238 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:19.895218 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cxrrt_test-trainjob-h89sl-node-0-0-lxb6t_4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/node/0.log" Nov 02 22:27:20.003822 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:20.003731 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:27:20.109183 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:20.109137 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:27:20.213502 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:20.213465 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:27:20.307806 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:20.307771 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:27:22.405878 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:22.405847 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:27:22.501209 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:22.501174 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:27:23.176450 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:23.176394 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-dj9tb/test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x"] Nov 02 22:27:23.176748 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:23.176735 5963 cpu_manager.go:414] "containerMap: removing container" podUID="b0130f56-4227-4a6b-b412-c0228f3d3283" containerName="node" Nov 02 22:27:23.176797 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:23.176750 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b0130f56-4227-4a6b-b412-c0228f3d3283" containerName="node" Nov 02 22:27:23.176839 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:23.176830 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="b0130f56-4227-4a6b-b412-c0228f3d3283" containerName="node" Nov 02 22:27:23.191372 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:23.191346 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-dj9tb/test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x"] Nov 02 22:27:23.191543 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:23.191448 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-dj9tb/test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x" Nov 02 22:27:23.195223 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:23.195192 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-dj9tb\"/\"kube-root-ca.crt\"" Nov 02 22:27:23.196382 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:23.196356 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-dj9tb\"/\"openshift-service-ca.crt\"" Nov 02 22:27:23.196540 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:23.196522 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-dj9tb\"/\"default-dockercfg-d4sxf\"" Nov 02 22:27:23.296034 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:23.296000 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xjgs\" (UniqueName: \"kubernetes.io/projected/9cdf2e56-5477-4731-aa2b-c70db70e9103-kube-api-access-6xjgs\") pod \"test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x\" (UID: \"9cdf2e56-5477-4731-aa2b-c70db70e9103\") " pod="test-ns-dj9tb/test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x" Nov 02 22:27:23.302939 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:23.302912 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:27:23.396942 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:23.396910 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xjgs\" (UniqueName: \"kubernetes.io/projected/9cdf2e56-5477-4731-aa2b-c70db70e9103-kube-api-access-6xjgs\") pod \"test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x\" (UID: \"9cdf2e56-5477-4731-aa2b-c70db70e9103\") " pod="test-ns-dj9tb/test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x" Nov 02 22:27:23.409873 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:23.409841 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xjgs\" (UniqueName: \"kubernetes.io/projected/9cdf2e56-5477-4731-aa2b-c70db70e9103-kube-api-access-6xjgs\") pod \"test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x\" (UID: \"9cdf2e56-5477-4731-aa2b-c70db70e9103\") " pod="test-ns-dj9tb/test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x" Nov 02 22:27:24.748584 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:24.748527 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-86skg/test-trainjob-848ks-node-0-0-fs8ql"] Nov 02 22:27:24.753745 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:24.753722 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-86skg/test-trainjob-848ks-node-0-0-fs8ql"] Nov 02 22:27:24.955059 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:24.954975 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-zdbhw/test-trainjob-ccf5j-node-0-0-2cx9l"] Nov 02 22:27:24.959774 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:24.959751 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-zdbhw/test-trainjob-ccf5j-node-0-0-2cx9l"] Nov 02 22:27:24.963380 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:24.963346 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:27:24.967314 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:24.967286 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-cxrrt/test-trainjob-h89sl-node-0-0-lxb6t"] Nov 02 22:27:24.972368 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:24.972342 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-cxrrt/test-trainjob-h89sl-node-0-0-lxb6t"] Nov 02 22:27:25.400890 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:25.400844 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:27:25.863745 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:25.863717 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4f7a9957-7f4c-4ff1-afbe-5ef00f22e830" path="/var/lib/kubelet/pods/4f7a9957-7f4c-4ff1-afbe-5ef00f22e830/volumes" Nov 02 22:27:25.864125 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:25.864031 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5535be25-33ac-45f3-bb67-7f79c7bc2343" path="/var/lib/kubelet/pods/5535be25-33ac-45f3-bb67-7f79c7bc2343/volumes" Nov 02 22:27:25.864307 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:25.864295 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b0130f56-4227-4a6b-b412-c0228f3d3283" path="/var/lib/kubelet/pods/b0130f56-4227-4a6b-b412-c0228f3d3283/volumes" Nov 02 22:27:26.020050 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:26.020013 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:27:26.278715 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:26.278602 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:27:26.380098 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:26.380060 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:27:26.688109 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:26.688071 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:27:26.780724 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:26.780691 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:27:29.123698 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:27:29.123638 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:27:29.451765 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:29.451726 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-d0a83b36-7044-47aa-8599-21cd7800b0e4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-056081ebe87124a73\") pod \"test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x\" (UID: \"9cdf2e56-5477-4731-aa2b-c70db70e9103\") " pod="test-ns-dj9tb/test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x" Nov 02 22:27:29.458804 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:29.458780 5963 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-d0a83b36-7044-47aa-8599-21cd7800b0e4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-056081ebe87124a73\") pod \"test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x\" (UID: \"9cdf2e56-5477-4731-aa2b-c70db70e9103\") device path: \"\"" pod="test-ns-dj9tb/test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x" Nov 02 22:27:29.552685 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:29.552622 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-d0a83b36-7044-47aa-8599-21cd7800b0e4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-056081ebe87124a73\") pod \"test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x\" (UID: \"9cdf2e56-5477-4731-aa2b-c70db70e9103\") " pod="test-ns-dj9tb/test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x" Nov 02 22:27:29.552848 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:29.552778 5963 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-d0a83b36-7044-47aa-8599-21cd7800b0e4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-056081ebe87124a73\") pod \"test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x\" (UID: \"9cdf2e56-5477-4731-aa2b-c70db70e9103\") DevicePath \"\"" pod="test-ns-dj9tb/test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x" Nov 02 22:27:29.556270 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:29.556250 5963 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-d0a83b36-7044-47aa-8599-21cd7800b0e4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-056081ebe87124a73\") pod \"test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x\" (UID: \"9cdf2e56-5477-4731-aa2b-c70db70e9103\") DevicePath \"csi-7908883ecf0381ef01bc9a9631f2c9b2bacad3a0b2b49eb15709dfbfd3bc07b6\"" pod="test-ns-dj9tb/test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x" Nov 02 22:27:29.734564 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:29.734536 5963 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-d0a83b36-7044-47aa-8599-21cd7800b0e4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-056081ebe87124a73\") pod \"test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x\" (UID: \"9cdf2e56-5477-4731-aa2b-c70db70e9103\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/cde3835c30960d0ec5330222466b466ac29c0563203b64b304067b00e528725a/globalmount\"" pod="test-ns-dj9tb/test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x" Nov 02 22:27:29.748413 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:29.748385 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-d0a83b36-7044-47aa-8599-21cd7800b0e4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-056081ebe87124a73\") pod \"test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x\" (UID: \"9cdf2e56-5477-4731-aa2b-c70db70e9103\") " pod="test-ns-dj9tb/test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x" Nov 02 22:27:29.819538 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:29.819505 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-dj9tb/test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x" Nov 02 22:27:30.100834 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:30.100801 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-dj9tb/test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x"] Nov 02 22:27:30.104407 ip-10-0-139-99 kubenswrapper[5963]: W1102 22:27:30.104379 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cdf2e56_5477_4731_aa2b_c70db70e9103.slice/crio-0da8a8fa9865b708936c7e2f67fafe1e917ab913582108ee53d420fb291a7829 WatchSource:0}: Error finding container 0da8a8fa9865b708936c7e2f67fafe1e917ab913582108ee53d420fb291a7829: Status 404 returned error can't find the container with id 0da8a8fa9865b708936c7e2f67fafe1e917ab913582108ee53d420fb291a7829 Nov 02 22:27:30.106633 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:30.106613 5963 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 02 22:27:30.115920 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:30.115868 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-dj9tb/test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x" event={"ID":"9cdf2e56-5477-4731-aa2b-c70db70e9103","Type":"ContainerStarted","Data":"0da8a8fa9865b708936c7e2f67fafe1e917ab913582108ee53d420fb291a7829"} Nov 02 22:27:36.148380 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:36.148342 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-dj9tb/test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x" event={"ID":"9cdf2e56-5477-4731-aa2b-c70db70e9103","Type":"ContainerStarted","Data":"29074cda51b994d94bd9a7bcb5064e07b8bccfaaa8df4738a152d72e13e9c20d"} Nov 02 22:27:36.169645 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:36.169597 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-dj9tb/test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x" podStartSLOduration=10.851927322 podStartE2EDuration="16.169583698s" totalImagesPullingTime="5.317656376s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 22:27:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:27:36.167698875 +0000 UTC m=+2028.419697342" watchObservedRunningTime="2026-11-02 22:27:36.169583698 +0000 UTC m=+2028.421582161" Nov 02 22:27:37.978894 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:37.978864 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:27:40.978635 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:40.978545 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:27:41.171634 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:41.171599 5963 generic.go:356] "Generic (PLEG): container finished" podID="9cdf2e56-5477-4731-aa2b-c70db70e9103" containerID="29074cda51b994d94bd9a7bcb5064e07b8bccfaaa8df4738a152d72e13e9c20d" exitCode=0 Nov 02 22:27:41.171824 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:41.171649 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-dj9tb/test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x" event={"ID":"9cdf2e56-5477-4731-aa2b-c70db70e9103","Type":"ContainerDied","Data":"29074cda51b994d94bd9a7bcb5064e07b8bccfaaa8df4738a152d72e13e9c20d"} Nov 02 22:27:42.330084 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:42.330051 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-dj9tb/test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x" Nov 02 22:27:42.469926 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:42.469845 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-056081ebe87124a73\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-056081ebe87124a73\") pod \"9cdf2e56-5477-4731-aa2b-c70db70e9103\" (UID: \"9cdf2e56-5477-4731-aa2b-c70db70e9103\") " Nov 02 22:27:42.469926 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:42.469896 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9cdf2e56-5477-4731-aa2b-c70db70e9103-kube-api-access-6xjgs\" (UniqueName: \"kubernetes.io/projected/9cdf2e56-5477-4731-aa2b-c70db70e9103-kube-api-access-6xjgs\") pod \"9cdf2e56-5477-4731-aa2b-c70db70e9103\" (UID: \"9cdf2e56-5477-4731-aa2b-c70db70e9103\") " Nov 02 22:27:42.472242 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:42.472210 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cdf2e56-5477-4731-aa2b-c70db70e9103-kube-api-access-6xjgs" pod "9cdf2e56-5477-4731-aa2b-c70db70e9103" (UID: "9cdf2e56-5477-4731-aa2b-c70db70e9103"). InnerVolumeSpecName "kube-api-access-6xjgs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 22:27:42.491399 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:42.491373 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-056081ebe87124a73" pod "9cdf2e56-5477-4731-aa2b-c70db70e9103" (UID: "9cdf2e56-5477-4731-aa2b-c70db70e9103"). InnerVolumeSpecName "pvc-d0a83b36-7044-47aa-8599-21cd7800b0e4". PluginName "kubernetes.io/csi", VolumeGIDValue "" Nov 02 22:27:42.570894 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:42.570855 5963 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-d0a83b36-7044-47aa-8599-21cd7800b0e4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-056081ebe87124a73\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" " Nov 02 22:27:42.570894 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:42.570887 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xjgs\" (UniqueName: \"kubernetes.io/projected/9cdf2e56-5477-4731-aa2b-c70db70e9103-kube-api-access-6xjgs\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:27:42.594507 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:42.594488 5963 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-d0a83b36-7044-47aa-8599-21cd7800b0e4" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-056081ebe87124a73") on node "ip-10-0-139-99.us-east-2.compute.internal" Nov 02 22:27:42.671880 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:42.671844 5963 reconciler_common.go:299] "Volume detached for volume \"pvc-d0a83b36-7044-47aa-8599-21cd7800b0e4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-056081ebe87124a73\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"csi-7908883ecf0381ef01bc9a9631f2c9b2bacad3a0b2b49eb15709dfbfd3bc07b6\"" Nov 02 22:27:43.181374 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:43.181343 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-dj9tb/test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x" Nov 02 22:27:43.181374 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:43.181366 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-dj9tb/test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x" event={"ID":"9cdf2e56-5477-4731-aa2b-c70db70e9103","Type":"ContainerDied","Data":"0da8a8fa9865b708936c7e2f67fafe1e917ab913582108ee53d420fb291a7829"} Nov 02 22:27:43.181690 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:43.181409 5963 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0da8a8fa9865b708936c7e2f67fafe1e917ab913582108ee53d420fb291a7829" Nov 02 22:27:43.278566 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:43.278529 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-dj9tb/test-trainjob-dwmv7-model-initializer-0-0-vbvjm"] Nov 02 22:27:43.278957 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:43.278941 5963 cpu_manager.go:414] "containerMap: removing container" podUID="9cdf2e56-5477-4731-aa2b-c70db70e9103" containerName="dataset-initializer" Nov 02 22:27:43.279003 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:43.278960 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9cdf2e56-5477-4731-aa2b-c70db70e9103" containerName="dataset-initializer" Nov 02 22:27:43.279045 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:43.279031 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="9cdf2e56-5477-4731-aa2b-c70db70e9103" containerName="dataset-initializer" Nov 02 22:27:43.296872 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:43.296838 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-dj9tb/test-trainjob-dwmv7-model-initializer-0-0-vbvjm"] Nov 02 22:27:43.297048 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:43.296952 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-dj9tb/test-trainjob-dwmv7-model-initializer-0-0-vbvjm" Nov 02 22:27:43.300818 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:43.300797 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-dj9tb\"/\"kube-root-ca.crt\"" Nov 02 22:27:43.300818 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:43.300797 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-dj9tb\"/\"openshift-service-ca.crt\"" Nov 02 22:27:43.300973 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:43.300917 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-dj9tb\"/\"default-dockercfg-d4sxf\"" Nov 02 22:27:43.480314 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:43.480221 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lf8l\" (UniqueName: \"kubernetes.io/projected/10eaaf0a-924d-4d9a-991b-228411620771-kube-api-access-4lf8l\") pod \"test-trainjob-dwmv7-model-initializer-0-0-vbvjm\" (UID: \"10eaaf0a-924d-4d9a-991b-228411620771\") " pod="test-ns-dj9tb/test-trainjob-dwmv7-model-initializer-0-0-vbvjm" Nov 02 22:27:43.581567 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:43.581536 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lf8l\" (UniqueName: \"kubernetes.io/projected/10eaaf0a-924d-4d9a-991b-228411620771-kube-api-access-4lf8l\") pod \"test-trainjob-dwmv7-model-initializer-0-0-vbvjm\" (UID: \"10eaaf0a-924d-4d9a-991b-228411620771\") " pod="test-ns-dj9tb/test-trainjob-dwmv7-model-initializer-0-0-vbvjm" Nov 02 22:27:43.593978 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:43.593951 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lf8l\" (UniqueName: \"kubernetes.io/projected/10eaaf0a-924d-4d9a-991b-228411620771-kube-api-access-4lf8l\") pod \"test-trainjob-dwmv7-model-initializer-0-0-vbvjm\" (UID: \"10eaaf0a-924d-4d9a-991b-228411620771\") " pod="test-ns-dj9tb/test-trainjob-dwmv7-model-initializer-0-0-vbvjm" Nov 02 22:27:43.993046 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:43.993014 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:27:46.989343 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:46.989307 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:27:48.312546 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:48.312513 5963 scope.go:122] "RemoveContainer" containerID="b092544be9140fade56f6dbbbe1aef3ebed8654c05ad5223e7ee26e33c09b616" Nov 02 22:27:49.989555 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:49.989521 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:27:50.134004 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:50.133972 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-d0a83b36-7044-47aa-8599-21cd7800b0e4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-056081ebe87124a73\") pod \"test-trainjob-dwmv7-model-initializer-0-0-vbvjm\" (UID: \"10eaaf0a-924d-4d9a-991b-228411620771\") " pod="test-ns-dj9tb/test-trainjob-dwmv7-model-initializer-0-0-vbvjm" Nov 02 22:27:50.140644 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:50.140621 5963 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-d0a83b36-7044-47aa-8599-21cd7800b0e4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-056081ebe87124a73\") pod \"test-trainjob-dwmv7-model-initializer-0-0-vbvjm\" (UID: \"10eaaf0a-924d-4d9a-991b-228411620771\") device path: \"\"" pod="test-ns-dj9tb/test-trainjob-dwmv7-model-initializer-0-0-vbvjm" Nov 02 22:27:50.234570 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:50.234534 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-d0a83b36-7044-47aa-8599-21cd7800b0e4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-056081ebe87124a73\") pod \"test-trainjob-dwmv7-model-initializer-0-0-vbvjm\" (UID: \"10eaaf0a-924d-4d9a-991b-228411620771\") " pod="test-ns-dj9tb/test-trainjob-dwmv7-model-initializer-0-0-vbvjm" Nov 02 22:27:50.234776 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:50.234703 5963 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-d0a83b36-7044-47aa-8599-21cd7800b0e4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-056081ebe87124a73\") pod \"test-trainjob-dwmv7-model-initializer-0-0-vbvjm\" (UID: \"10eaaf0a-924d-4d9a-991b-228411620771\") DevicePath \"\"" pod="test-ns-dj9tb/test-trainjob-dwmv7-model-initializer-0-0-vbvjm" Nov 02 22:27:50.238149 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:50.238128 5963 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-d0a83b36-7044-47aa-8599-21cd7800b0e4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-056081ebe87124a73\") pod \"test-trainjob-dwmv7-model-initializer-0-0-vbvjm\" (UID: \"10eaaf0a-924d-4d9a-991b-228411620771\") DevicePath \"csi-7908883ecf0381ef01bc9a9631f2c9b2bacad3a0b2b49eb15709dfbfd3bc07b6\"" pod="test-ns-dj9tb/test-trainjob-dwmv7-model-initializer-0-0-vbvjm" Nov 02 22:27:50.377865 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:50.377826 5963 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-d0a83b36-7044-47aa-8599-21cd7800b0e4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-056081ebe87124a73\") pod \"test-trainjob-dwmv7-model-initializer-0-0-vbvjm\" (UID: \"10eaaf0a-924d-4d9a-991b-228411620771\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/cde3835c30960d0ec5330222466b466ac29c0563203b64b304067b00e528725a/globalmount\"" pod="test-ns-dj9tb/test-trainjob-dwmv7-model-initializer-0-0-vbvjm" Nov 02 22:27:50.392906 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:50.392849 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-d0a83b36-7044-47aa-8599-21cd7800b0e4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-056081ebe87124a73\") pod \"test-trainjob-dwmv7-model-initializer-0-0-vbvjm\" (UID: \"10eaaf0a-924d-4d9a-991b-228411620771\") " pod="test-ns-dj9tb/test-trainjob-dwmv7-model-initializer-0-0-vbvjm" Nov 02 22:27:50.530804 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:50.530768 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-dj9tb\"/\"default-dockercfg-d4sxf\"" Nov 02 22:27:50.538890 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:50.538869 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-dj9tb/test-trainjob-dwmv7-model-initializer-0-0-vbvjm" Nov 02 22:27:50.840898 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:50.840867 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-dj9tb/test-trainjob-dwmv7-model-initializer-0-0-vbvjm"] Nov 02 22:27:50.844783 ip-10-0-139-99 kubenswrapper[5963]: W1102 22:27:50.844748 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10eaaf0a_924d_4d9a_991b_228411620771.slice/crio-c755edebdb958a8d6f199af9d9ada0e70709f0b9a5cd273818d33712794f0a5f WatchSource:0}: Error finding container c755edebdb958a8d6f199af9d9ada0e70709f0b9a5cd273818d33712794f0a5f: Status 404 returned error can't find the container with id c755edebdb958a8d6f199af9d9ada0e70709f0b9a5cd273818d33712794f0a5f Nov 02 22:27:51.218702 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:51.218644 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-dj9tb/test-trainjob-dwmv7-model-initializer-0-0-vbvjm" event={"ID":"10eaaf0a-924d-4d9a-991b-228411620771","Type":"ContainerStarted","Data":"c755edebdb958a8d6f199af9d9ada0e70709f0b9a5cd273818d33712794f0a5f"} Nov 02 22:27:52.978177 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:52.978145 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:27:55.978326 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:55.978294 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:27:58.978420 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:58.978383 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:27:58.995548 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:27:58.995521 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:27:59.124711 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:27:59.124654 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:28:01.991248 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:28:01.991210 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:28:04.990503 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:28:04.990462 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:28:07.991267 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:28:07.991234 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:28:10.990168 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:28:10.990128 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:28:13.989957 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:28:13.989925 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:28:16.990282 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:28:16.990179 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:28:19.990017 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:28:19.989986 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:28:22.991226 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:28:22.991193 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:28:25.992539 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:28:25.992506 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:28:28.989471 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:28:28.989391 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:28:29.127020 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:28:29.126987 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:28:31.989823 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:28:31.989788 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:28:34.978599 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:28:34.978561 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:28:37.978538 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:28:37.978511 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:28:40.987573 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:28:40.987536 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:28:43.989331 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:28:43.989304 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:28:46.989921 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:28:46.989890 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:28:49.989973 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:28:49.989922 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:28:52.990690 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:28:52.990620 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:28:55.989799 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:28:55.989759 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:28:58.993040 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:28:58.993007 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:28:59.089819 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:28:59.089785 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:28:59.123250 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:28:59.123215 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:29:01.990331 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:29:01.990298 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:29:04.989916 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:29:04.989884 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:29:07.991075 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:29:07.991044 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:29:10.990652 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:29:10.990621 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:29:13.978843 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:29:13.978806 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:29:16.979209 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:29:16.979175 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:29:19.979729 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:29:19.979693 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:29:22.991164 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:29:22.991134 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:29:25.989802 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:29:25.989772 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:29:28.990135 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:29:28.990092 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:29:29.124340 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:29:29.124302 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:29:31.989511 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:29:31.989479 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:29:34.990166 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:29:34.990136 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:29:37.992035 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:29:37.992005 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:29:40.990528 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:29:40.990491 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:29:43.994895 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:29:43.994868 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:29:46.990293 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:29:46.990263 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:29:49.990134 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:29:49.990102 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:29:52.978753 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:29:52.978718 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:29:55.978459 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:29:55.978416 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:29:58.977971 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:29:58.977875 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:29:59.111712 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:29:59.111629 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:29:59.131760 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:29:59.131722 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:30:00.817492 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:00.817453 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-dj9tb/test-trainjob-dwmv7-model-initializer-0-0-vbvjm" event={"ID":"10eaaf0a-924d-4d9a-991b-228411620771","Type":"ContainerStarted","Data":"7eb50abe8b32ea7f9534b8b7df22b0931e5a253cc1edb038ebeb4fef019d96cf"} Nov 02 22:30:00.851159 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:00.851100 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-dj9tb/test-trainjob-dwmv7-model-initializer-0-0-vbvjm" podStartSLOduration=8.437492581 podStartE2EDuration="2m17.851085841s" totalImagesPullingTime="2m9.41359326s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 22:27:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:30:00.84960718 +0000 UTC m=+2173.101605658" watchObservedRunningTime="2026-11-02 22:30:00.851085841 +0000 UTC m=+2173.103084307" Nov 02 22:30:01.990389 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:01.990358 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:30:02.014150 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:02.014118 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-model-initializer-0-0-vbvjm_10eaaf0a-924d-4d9a-991b-228411620771/model-initializer/0.log" Nov 02 22:30:04.990603 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:04.990572 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:30:05.008718 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:05.008687 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-model-initializer-0-0-vbvjm_10eaaf0a-924d-4d9a-991b-228411620771/model-initializer/0.log" Nov 02 22:30:07.990970 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:07.990942 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:30:08.009747 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:08.009722 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-model-initializer-0-0-vbvjm_10eaaf0a-924d-4d9a-991b-228411620771/model-initializer/0.log" Nov 02 22:30:10.991016 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:10.990983 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:30:11.009712 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:11.009684 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-model-initializer-0-0-vbvjm_10eaaf0a-924d-4d9a-991b-228411620771/model-initializer/0.log" Nov 02 22:30:11.868380 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:11.868352 5963 generic.go:356] "Generic (PLEG): container finished" podID="10eaaf0a-924d-4d9a-991b-228411620771" containerID="7eb50abe8b32ea7f9534b8b7df22b0931e5a253cc1edb038ebeb4fef019d96cf" exitCode=0 Nov 02 22:30:11.868570 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:11.868396 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-dj9tb/test-trainjob-dwmv7-model-initializer-0-0-vbvjm" event={"ID":"10eaaf0a-924d-4d9a-991b-228411620771","Type":"ContainerDied","Data":"7eb50abe8b32ea7f9534b8b7df22b0931e5a253cc1edb038ebeb4fef019d96cf"} Nov 02 22:30:13.004065 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:13.004040 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-dj9tb/test-trainjob-dwmv7-model-initializer-0-0-vbvjm" Nov 02 22:30:13.075984 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:13.075945 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/10eaaf0a-924d-4d9a-991b-228411620771-kube-api-access-4lf8l\" (UniqueName: \"kubernetes.io/projected/10eaaf0a-924d-4d9a-991b-228411620771-kube-api-access-4lf8l\") pod \"10eaaf0a-924d-4d9a-991b-228411620771\" (UID: \"10eaaf0a-924d-4d9a-991b-228411620771\") " Nov 02 22:30:13.076197 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:13.076099 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-056081ebe87124a73\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-056081ebe87124a73\") pod \"10eaaf0a-924d-4d9a-991b-228411620771\" (UID: \"10eaaf0a-924d-4d9a-991b-228411620771\") " Nov 02 22:30:13.078291 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:13.078261 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10eaaf0a-924d-4d9a-991b-228411620771-kube-api-access-4lf8l" pod "10eaaf0a-924d-4d9a-991b-228411620771" (UID: "10eaaf0a-924d-4d9a-991b-228411620771"). InnerVolumeSpecName "kube-api-access-4lf8l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 22:30:13.078985 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:13.078963 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-056081ebe87124a73" pod "10eaaf0a-924d-4d9a-991b-228411620771" (UID: "10eaaf0a-924d-4d9a-991b-228411620771"). InnerVolumeSpecName "pvc-d0a83b36-7044-47aa-8599-21cd7800b0e4". PluginName "kubernetes.io/csi", VolumeGIDValue "" Nov 02 22:30:13.177775 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:13.177655 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lf8l\" (UniqueName: \"kubernetes.io/projected/10eaaf0a-924d-4d9a-991b-228411620771-kube-api-access-4lf8l\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:30:13.177775 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:13.177735 5963 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-d0a83b36-7044-47aa-8599-21cd7800b0e4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-056081ebe87124a73\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" " Nov 02 22:30:13.241410 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:13.241388 5963 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-d0a83b36-7044-47aa-8599-21cd7800b0e4" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-056081ebe87124a73") on node "ip-10-0-139-99.us-east-2.compute.internal" Nov 02 22:30:13.278224 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:13.278190 5963 reconciler_common.go:299] "Volume detached for volume \"pvc-d0a83b36-7044-47aa-8599-21cd7800b0e4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-056081ebe87124a73\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"csi-7908883ecf0381ef01bc9a9631f2c9b2bacad3a0b2b49eb15709dfbfd3bc07b6\"" Nov 02 22:30:13.877107 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:13.877077 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-dj9tb/test-trainjob-dwmv7-model-initializer-0-0-vbvjm" event={"ID":"10eaaf0a-924d-4d9a-991b-228411620771","Type":"ContainerDied","Data":"c755edebdb958a8d6f199af9d9ada0e70709f0b9a5cd273818d33712794f0a5f"} Nov 02 22:30:13.877237 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:13.877126 5963 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c755edebdb958a8d6f199af9d9ada0e70709f0b9a5cd273818d33712794f0a5f" Nov 02 22:30:13.877237 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:13.877085 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-dj9tb/test-trainjob-dwmv7-model-initializer-0-0-vbvjm" Nov 02 22:30:13.990083 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:13.990057 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:30:14.011079 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:14.011053 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-model-initializer-0-0-vbvjm_10eaaf0a-924d-4d9a-991b-228411620771/model-initializer/0.log" Nov 02 22:30:14.030711 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:14.030657 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-dj9tb/test-trainjob-dwmv7-node-0-0-5cwrj"] Nov 02 22:30:14.031049 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:14.031036 5963 cpu_manager.go:414] "containerMap: removing container" podUID="10eaaf0a-924d-4d9a-991b-228411620771" containerName="model-initializer" Nov 02 22:30:14.031106 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:14.031050 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="10eaaf0a-924d-4d9a-991b-228411620771" containerName="model-initializer" Nov 02 22:30:14.031147 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:14.031105 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="10eaaf0a-924d-4d9a-991b-228411620771" containerName="model-initializer" Nov 02 22:30:14.034020 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:14.034006 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-dj9tb/test-trainjob-dwmv7-node-0-0-5cwrj" Nov 02 22:30:14.037988 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:14.037968 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-dj9tb\"/\"kube-root-ca.crt\"" Nov 02 22:30:14.038099 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:14.037999 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-dj9tb\"/\"openshift-service-ca.crt\"" Nov 02 22:30:14.038099 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:14.038035 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-dj9tb\"/\"default-dockercfg-d4sxf\"" Nov 02 22:30:14.044565 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:14.044542 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-dj9tb/test-trainjob-dwmv7-node-0-0-5cwrj"] Nov 02 22:30:14.086011 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:14.085978 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49dbr\" (UniqueName: \"kubernetes.io/projected/7330d339-3e2b-4c87-ad53-68a58605ccd7-kube-api-access-49dbr\") pod \"test-trainjob-dwmv7-node-0-0-5cwrj\" (UID: \"7330d339-3e2b-4c87-ad53-68a58605ccd7\") " pod="test-ns-dj9tb/test-trainjob-dwmv7-node-0-0-5cwrj" Nov 02 22:30:14.186720 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:14.186633 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49dbr\" (UniqueName: \"kubernetes.io/projected/7330d339-3e2b-4c87-ad53-68a58605ccd7-kube-api-access-49dbr\") pod \"test-trainjob-dwmv7-node-0-0-5cwrj\" (UID: \"7330d339-3e2b-4c87-ad53-68a58605ccd7\") " pod="test-ns-dj9tb/test-trainjob-dwmv7-node-0-0-5cwrj" Nov 02 22:30:14.199677 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:14.199642 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49dbr\" (UniqueName: \"kubernetes.io/projected/7330d339-3e2b-4c87-ad53-68a58605ccd7-kube-api-access-49dbr\") pod \"test-trainjob-dwmv7-node-0-0-5cwrj\" (UID: \"7330d339-3e2b-4c87-ad53-68a58605ccd7\") " pod="test-ns-dj9tb/test-trainjob-dwmv7-node-0-0-5cwrj" Nov 02 22:30:16.990100 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:16.990067 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:30:17.008524 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:17.008497 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-model-initializer-0-0-vbvjm_10eaaf0a-924d-4d9a-991b-228411620771/model-initializer/0.log" Nov 02 22:30:19.989885 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:19.989853 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:30:20.008424 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:20.008397 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-model-initializer-0-0-vbvjm_10eaaf0a-924d-4d9a-991b-228411620771/model-initializer/0.log" Nov 02 22:30:22.563677 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:22.563636 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-d0a83b36-7044-47aa-8599-21cd7800b0e4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-056081ebe87124a73\") pod \"test-trainjob-dwmv7-node-0-0-5cwrj\" (UID: \"7330d339-3e2b-4c87-ad53-68a58605ccd7\") " pod="test-ns-dj9tb/test-trainjob-dwmv7-node-0-0-5cwrj" Nov 02 22:30:22.570545 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:22.570518 5963 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-d0a83b36-7044-47aa-8599-21cd7800b0e4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-056081ebe87124a73\") pod \"test-trainjob-dwmv7-node-0-0-5cwrj\" (UID: \"7330d339-3e2b-4c87-ad53-68a58605ccd7\") device path: \"\"" pod="test-ns-dj9tb/test-trainjob-dwmv7-node-0-0-5cwrj" Nov 02 22:30:22.664716 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:22.664657 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-d0a83b36-7044-47aa-8599-21cd7800b0e4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-056081ebe87124a73\") pod \"test-trainjob-dwmv7-node-0-0-5cwrj\" (UID: \"7330d339-3e2b-4c87-ad53-68a58605ccd7\") " pod="test-ns-dj9tb/test-trainjob-dwmv7-node-0-0-5cwrj" Nov 02 22:30:22.664887 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:22.664829 5963 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-d0a83b36-7044-47aa-8599-21cd7800b0e4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-056081ebe87124a73\") pod \"test-trainjob-dwmv7-node-0-0-5cwrj\" (UID: \"7330d339-3e2b-4c87-ad53-68a58605ccd7\") DevicePath \"\"" pod="test-ns-dj9tb/test-trainjob-dwmv7-node-0-0-5cwrj" Nov 02 22:30:22.668400 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:22.668381 5963 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-d0a83b36-7044-47aa-8599-21cd7800b0e4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-056081ebe87124a73\") pod \"test-trainjob-dwmv7-node-0-0-5cwrj\" (UID: \"7330d339-3e2b-4c87-ad53-68a58605ccd7\") DevicePath \"csi-7908883ecf0381ef01bc9a9631f2c9b2bacad3a0b2b49eb15709dfbfd3bc07b6\"" pod="test-ns-dj9tb/test-trainjob-dwmv7-node-0-0-5cwrj" Nov 02 22:30:22.758806 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:22.758775 5963 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-d0a83b36-7044-47aa-8599-21cd7800b0e4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-056081ebe87124a73\") pod \"test-trainjob-dwmv7-node-0-0-5cwrj\" (UID: \"7330d339-3e2b-4c87-ad53-68a58605ccd7\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/cde3835c30960d0ec5330222466b466ac29c0563203b64b304067b00e528725a/globalmount\"" pod="test-ns-dj9tb/test-trainjob-dwmv7-node-0-0-5cwrj" Nov 02 22:30:22.774912 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:22.774886 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-d0a83b36-7044-47aa-8599-21cd7800b0e4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-056081ebe87124a73\") pod \"test-trainjob-dwmv7-node-0-0-5cwrj\" (UID: \"7330d339-3e2b-4c87-ad53-68a58605ccd7\") " pod="test-ns-dj9tb/test-trainjob-dwmv7-node-0-0-5cwrj" Nov 02 22:30:22.991024 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:22.990992 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:30:23.009245 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:23.009216 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-model-initializer-0-0-vbvjm_10eaaf0a-924d-4d9a-991b-228411620771/model-initializer/0.log" Nov 02 22:30:23.047769 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:23.047741 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-dj9tb/test-trainjob-dwmv7-node-0-0-5cwrj" Nov 02 22:30:23.349174 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:23.349151 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-dj9tb/test-trainjob-dwmv7-node-0-0-5cwrj"] Nov 02 22:30:23.351477 ip-10-0-139-99 kubenswrapper[5963]: W1102 22:30:23.351448 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7330d339_3e2b_4c87_ad53_68a58605ccd7.slice/crio-735c256e7fc95a821a29111433fa0e848ef72a308d41d1ee35cbaf0df2f9c573 WatchSource:0}: Error finding container 735c256e7fc95a821a29111433fa0e848ef72a308d41d1ee35cbaf0df2f9c573: Status 404 returned error can't find the container with id 735c256e7fc95a821a29111433fa0e848ef72a308d41d1ee35cbaf0df2f9c573 Nov 02 22:30:23.921680 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:23.921636 5963 generic.go:356] "Generic (PLEG): container finished" podID="7330d339-3e2b-4c87-ad53-68a58605ccd7" containerID="40ab212d206591b94f10d640c94b543a316b402f48846edc1d49afa73c340746" exitCode=0 Nov 02 22:30:23.922114 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:23.921732 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-dj9tb/test-trainjob-dwmv7-node-0-0-5cwrj" event={"ID":"7330d339-3e2b-4c87-ad53-68a58605ccd7","Type":"ContainerDied","Data":"40ab212d206591b94f10d640c94b543a316b402f48846edc1d49afa73c340746"} Nov 02 22:30:23.922114 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:23.921793 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-dj9tb/test-trainjob-dwmv7-node-0-0-5cwrj" event={"ID":"7330d339-3e2b-4c87-ad53-68a58605ccd7","Type":"ContainerStarted","Data":"735c256e7fc95a821a29111433fa0e848ef72a308d41d1ee35cbaf0df2f9c573"} Nov 02 22:30:25.074127 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:25.074102 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-dj9tb/test-trainjob-dwmv7-node-0-0-5cwrj" Nov 02 22:30:25.188290 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:25.188210 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-056081ebe87124a73\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-056081ebe87124a73\") pod \"7330d339-3e2b-4c87-ad53-68a58605ccd7\" (UID: \"7330d339-3e2b-4c87-ad53-68a58605ccd7\") " Nov 02 22:30:25.188452 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:25.188331 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7330d339-3e2b-4c87-ad53-68a58605ccd7-kube-api-access-49dbr\" (UniqueName: \"kubernetes.io/projected/7330d339-3e2b-4c87-ad53-68a58605ccd7-kube-api-access-49dbr\") pod \"7330d339-3e2b-4c87-ad53-68a58605ccd7\" (UID: \"7330d339-3e2b-4c87-ad53-68a58605ccd7\") " Nov 02 22:30:25.190738 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:25.190708 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7330d339-3e2b-4c87-ad53-68a58605ccd7-kube-api-access-49dbr" pod "7330d339-3e2b-4c87-ad53-68a58605ccd7" (UID: "7330d339-3e2b-4c87-ad53-68a58605ccd7"). InnerVolumeSpecName "kube-api-access-49dbr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 22:30:25.191047 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:25.191026 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-056081ebe87124a73" pod "7330d339-3e2b-4c87-ad53-68a58605ccd7" (UID: "7330d339-3e2b-4c87-ad53-68a58605ccd7"). InnerVolumeSpecName "pvc-d0a83b36-7044-47aa-8599-21cd7800b0e4". PluginName "kubernetes.io/csi", VolumeGIDValue "" Nov 02 22:30:25.289891 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:25.289860 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49dbr\" (UniqueName: \"kubernetes.io/projected/7330d339-3e2b-4c87-ad53-68a58605ccd7-kube-api-access-49dbr\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:30:25.290029 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:25.289907 5963 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-d0a83b36-7044-47aa-8599-21cd7800b0e4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-056081ebe87124a73\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" " Nov 02 22:30:25.299458 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:25.299439 5963 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-d0a83b36-7044-47aa-8599-21cd7800b0e4" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-056081ebe87124a73") on node "ip-10-0-139-99.us-east-2.compute.internal" Nov 02 22:30:25.390408 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:25.390372 5963 reconciler_common.go:299] "Volume detached for volume \"pvc-d0a83b36-7044-47aa-8599-21cd7800b0e4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-056081ebe87124a73\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"csi-7908883ecf0381ef01bc9a9631f2c9b2bacad3a0b2b49eb15709dfbfd3bc07b6\"" Nov 02 22:30:25.932277 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:25.932244 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-dj9tb/test-trainjob-dwmv7-node-0-0-5cwrj" Nov 02 22:30:25.932437 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:25.932271 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-dj9tb/test-trainjob-dwmv7-node-0-0-5cwrj" event={"ID":"7330d339-3e2b-4c87-ad53-68a58605ccd7","Type":"ContainerDied","Data":"735c256e7fc95a821a29111433fa0e848ef72a308d41d1ee35cbaf0df2f9c573"} Nov 02 22:30:25.932437 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:25.932319 5963 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="735c256e7fc95a821a29111433fa0e848ef72a308d41d1ee35cbaf0df2f9c573" Nov 02 22:30:25.990478 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:25.990446 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:30:26.009049 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:26.009004 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-model-initializer-0-0-vbvjm_10eaaf0a-924d-4d9a-991b-228411620771/model-initializer/0.log" Nov 02 22:30:26.027160 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:26.027139 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-node-0-0-5cwrj_7330d339-3e2b-4c87-ad53-68a58605ccd7/node/0.log" Nov 02 22:30:26.557405 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:26.557365 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x_9cdf2e56-5477-4731-aa2b-c70db70e9103/dataset-initializer/0.log" Nov 02 22:30:26.575742 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:26.575713 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-model-initializer-0-0-vbvjm_10eaaf0a-924d-4d9a-991b-228411620771/model-initializer/0.log" Nov 02 22:30:26.593829 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:26.593809 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dj9tb_test-trainjob-dwmv7-node-0-0-5cwrj_7330d339-3e2b-4c87-ad53-68a58605ccd7/node/0.log" Nov 02 22:30:26.681756 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:26.681720 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:30:26.796320 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:26.796282 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:30:26.937476 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:26.937393 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:30:26.980335 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:26.980303 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-x7wjn/dw-deployment-8fqc8-69445c46bc-ppr74"] Nov 02 22:30:26.980690 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:26.980677 5963 cpu_manager.go:414] "containerMap: removing container" podUID="7330d339-3e2b-4c87-ad53-68a58605ccd7" containerName="node" Nov 02 22:30:26.980743 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:26.980692 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7330d339-3e2b-4c87-ad53-68a58605ccd7" containerName="node" Nov 02 22:30:26.980782 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:26.980768 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="7330d339-3e2b-4c87-ad53-68a58605ccd7" containerName="node" Nov 02 22:30:26.995405 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:26.995381 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-x7wjn/dw-deployment-8fqc8-69445c46bc-ppr74" Nov 02 22:30:26.997814 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:26.997791 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-x7wjn/dw-deployment-8fqc8-69445c46bc-ppr74"] Nov 02 22:30:27.004883 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:27.004864 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-x7wjn\"/\"openshift-service-ca.crt\"" Nov 02 22:30:27.005022 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:27.004860 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-x7wjn\"/\"kube-root-ca.crt\"" Nov 02 22:30:27.005022 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:27.004884 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-x7wjn\"/\"config-mjxdc\"" Nov 02 22:30:27.005022 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:27.004894 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-x7wjn\"/\"default-dockercfg-ffw7m\"" Nov 02 22:30:27.048235 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:27.048186 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:30:27.105860 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:27.105828 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-3219e6c1-b212-4279-8656-462791397648\" (UniqueName: \"kubernetes.io/nfs/7a4229f0-8c2c-4fbb-8556-9c70383d8b14-pvc-3219e6c1-b212-4279-8656-462791397648\") pod \"dw-deployment-8fqc8-69445c46bc-ppr74\" (UID: \"7a4229f0-8c2c-4fbb-8556-9c70383d8b14\") " pod="test-ns-x7wjn/dw-deployment-8fqc8-69445c46bc-ppr74" Nov 02 22:30:27.106036 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:27.105866 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/7a4229f0-8c2c-4fbb-8556-9c70383d8b14-notebook-config\") pod \"dw-deployment-8fqc8-69445c46bc-ppr74\" (UID: \"7a4229f0-8c2c-4fbb-8556-9c70383d8b14\") " pod="test-ns-x7wjn/dw-deployment-8fqc8-69445c46bc-ppr74" Nov 02 22:30:27.106036 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:27.105903 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7jpr\" (UniqueName: \"kubernetes.io/projected/7a4229f0-8c2c-4fbb-8556-9c70383d8b14-kube-api-access-s7jpr\") pod \"dw-deployment-8fqc8-69445c46bc-ppr74\" (UID: \"7a4229f0-8c2c-4fbb-8556-9c70383d8b14\") " pod="test-ns-x7wjn/dw-deployment-8fqc8-69445c46bc-ppr74" Nov 02 22:30:27.147648 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:27.147617 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:30:27.207241 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:27.207166 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-3219e6c1-b212-4279-8656-462791397648\" (UniqueName: \"kubernetes.io/nfs/7a4229f0-8c2c-4fbb-8556-9c70383d8b14-pvc-3219e6c1-b212-4279-8656-462791397648\") pod \"dw-deployment-8fqc8-69445c46bc-ppr74\" (UID: \"7a4229f0-8c2c-4fbb-8556-9c70383d8b14\") " pod="test-ns-x7wjn/dw-deployment-8fqc8-69445c46bc-ppr74" Nov 02 22:30:27.207241 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:27.207198 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/7a4229f0-8c2c-4fbb-8556-9c70383d8b14-notebook-config\") pod \"dw-deployment-8fqc8-69445c46bc-ppr74\" (UID: \"7a4229f0-8c2c-4fbb-8556-9c70383d8b14\") " pod="test-ns-x7wjn/dw-deployment-8fqc8-69445c46bc-ppr74" Nov 02 22:30:27.207430 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:27.207326 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7jpr\" (UniqueName: \"kubernetes.io/projected/7a4229f0-8c2c-4fbb-8556-9c70383d8b14-kube-api-access-s7jpr\") pod \"dw-deployment-8fqc8-69445c46bc-ppr74\" (UID: \"7a4229f0-8c2c-4fbb-8556-9c70383d8b14\") " pod="test-ns-x7wjn/dw-deployment-8fqc8-69445c46bc-ppr74" Nov 02 22:30:27.208004 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:27.207988 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/7a4229f0-8c2c-4fbb-8556-9c70383d8b14-notebook-config\") pod \"dw-deployment-8fqc8-69445c46bc-ppr74\" (UID: \"7a4229f0-8c2c-4fbb-8556-9c70383d8b14\") " pod="test-ns-x7wjn/dw-deployment-8fqc8-69445c46bc-ppr74" Nov 02 22:30:27.220074 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:27.220051 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7jpr\" (UniqueName: \"kubernetes.io/projected/7a4229f0-8c2c-4fbb-8556-9c70383d8b14-kube-api-access-s7jpr\") pod \"dw-deployment-8fqc8-69445c46bc-ppr74\" (UID: \"7a4229f0-8c2c-4fbb-8556-9c70383d8b14\") " pod="test-ns-x7wjn/dw-deployment-8fqc8-69445c46bc-ppr74" Nov 02 22:30:27.763629 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:27.763597 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-3219e6c1-b212-4279-8656-462791397648\" (UniqueName: \"kubernetes.io/nfs/7a4229f0-8c2c-4fbb-8556-9c70383d8b14-pvc-3219e6c1-b212-4279-8656-462791397648\") pod \"dw-deployment-8fqc8-69445c46bc-ppr74\" (UID: \"7a4229f0-8c2c-4fbb-8556-9c70383d8b14\") " pod="test-ns-x7wjn/dw-deployment-8fqc8-69445c46bc-ppr74" Nov 02 22:30:27.918467 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:27.918429 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-x7wjn/dw-deployment-8fqc8-69445c46bc-ppr74" Nov 02 22:30:28.200241 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:28.200207 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-x7wjn/dw-deployment-8fqc8-69445c46bc-ppr74"] Nov 02 22:30:28.203932 ip-10-0-139-99 kubenswrapper[5963]: W1102 22:30:28.203902 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a4229f0_8c2c_4fbb_8556_9c70383d8b14.slice/crio-83b045e3095783fab89aacc7d55037281dff1c01caee1fc809b5a4d2a5fa230d WatchSource:0}: Error finding container 83b045e3095783fab89aacc7d55037281dff1c01caee1fc809b5a4d2a5fa230d: Status 404 returned error can't find the container with id 83b045e3095783fab89aacc7d55037281dff1c01caee1fc809b5a4d2a5fa230d Nov 02 22:30:28.948258 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:28.948228 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-x7wjn/dw-deployment-8fqc8-69445c46bc-ppr74" event={"ID":"7a4229f0-8c2c-4fbb-8556-9c70383d8b14","Type":"ContainerStarted","Data":"83b045e3095783fab89aacc7d55037281dff1c01caee1fc809b5a4d2a5fa230d"} Nov 02 22:30:29.124149 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:30:29.124102 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:30:31.651995 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:31.651955 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-dj9tb/test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x"] Nov 02 22:30:31.656532 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:31.656500 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-dj9tb/test-trainjob-dwmv7-dataset-initializer-0-0-hpz6x"] Nov 02 22:30:31.663443 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:31.663414 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-dj9tb/test-trainjob-dwmv7-model-initializer-0-0-vbvjm"] Nov 02 22:30:31.671099 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:31.671070 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-dj9tb/test-trainjob-dwmv7-model-initializer-0-0-vbvjm"] Nov 02 22:30:31.676717 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:31.676696 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-dj9tb/test-trainjob-dwmv7-node-0-0-5cwrj"] Nov 02 22:30:31.682285 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:31.682263 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-dj9tb/test-trainjob-dwmv7-node-0-0-5cwrj"] Nov 02 22:30:31.863260 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:31.863219 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="10eaaf0a-924d-4d9a-991b-228411620771" path="/var/lib/kubelet/pods/10eaaf0a-924d-4d9a-991b-228411620771/volumes" Nov 02 22:30:31.863577 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:31.863565 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7330d339-3e2b-4c87-ad53-68a58605ccd7" path="/var/lib/kubelet/pods/7330d339-3e2b-4c87-ad53-68a58605ccd7/volumes" Nov 02 22:30:31.863895 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:31.863883 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9cdf2e56-5477-4731-aa2b-c70db70e9103" path="/var/lib/kubelet/pods/9cdf2e56-5477-4731-aa2b-c70db70e9103/volumes" Nov 02 22:30:31.888554 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:31.888518 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:30:32.003981 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:32.003863 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:30:32.645571 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:32.645538 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:30:38.177756 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:38.177705 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:30:38.278553 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:38.278498 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:30:39.048186 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:39.048140 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:30:39.144592 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:39.144555 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:30:59.123423 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:30:59.123386 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:30:59.172593 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:30:59.172554 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:31:29.127322 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:31:29.127228 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:31:59.132328 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:31:59.132286 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:31:59.225163 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:31:59.225112 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:32:11.440852 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:11.440806 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-x7wjn/dw-deployment-8fqc8-69445c46bc-ppr74" event={"ID":"7a4229f0-8c2c-4fbb-8556-9c70383d8b14","Type":"ContainerStarted","Data":"debffde319cd8897f07cf3bf46f1bee96ea977c8a8633cc462779b7d488f2e9d"} Nov 02 22:32:11.471949 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:11.471901 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-x7wjn/dw-deployment-8fqc8-69445c46bc-ppr74" podStartSLOduration=3.047080151 podStartE2EDuration="1m45.471887324s" totalImagesPullingTime="1m42.424807173s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 22:30:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:32:11.471793902 +0000 UTC m=+2303.723792369" watchObservedRunningTime="2026-11-02 22:32:11.471887324 +0000 UTC m=+2303.723885787" Nov 02 22:32:11.659522 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:11.659489 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:11.675746 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:11.675716 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:12.677536 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:12.677511 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:13.695703 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:13.695653 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:14.677056 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:14.677021 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:14.714122 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:14.714093 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:15.732680 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:15.732636 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:16.751059 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:16.751019 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:17.677720 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:17.677685 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:17.770167 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:17.770133 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:18.788815 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:18.788776 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:19.807358 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:19.807321 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:20.677439 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:20.677411 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:20.826677 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:20.826631 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:21.845637 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:21.845586 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:22.865148 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:22.865122 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:23.680319 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:23.680277 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:23.884732 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:23.884701 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:24.616284 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:24.616247 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:32:24.667833 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:24.667801 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-x7wjn/k5793184a09e-node-0-1-shff7"] Nov 02 22:32:24.904366 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:24.904273 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:25.177148 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:25.177069 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-x7wjn/k5793184a09e-node-0-1-shff7"] Nov 02 22:32:25.177308 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:25.177190 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-x7wjn/k5793184a09e-node-0-1-shff7" Nov 02 22:32:25.211594 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:25.211565 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-3219e6c1-b212-4279-8656-462791397648\" (UniqueName: \"kubernetes.io/nfs/4cca3cc0-3937-4745-863b-dcca5bbdbf11-pvc-3219e6c1-b212-4279-8656-462791397648\") pod \"k5793184a09e-node-0-1-shff7\" (UID: \"4cca3cc0-3937-4745-863b-dcca5bbdbf11\") " pod="test-ns-x7wjn/k5793184a09e-node-0-1-shff7" Nov 02 22:32:25.211758 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:25.211620 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wftph\" (UniqueName: \"kubernetes.io/projected/4cca3cc0-3937-4745-863b-dcca5bbdbf11-kube-api-access-wftph\") pod \"k5793184a09e-node-0-1-shff7\" (UID: \"4cca3cc0-3937-4745-863b-dcca5bbdbf11\") " pod="test-ns-x7wjn/k5793184a09e-node-0-1-shff7" Nov 02 22:32:25.312687 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:25.312628 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-3219e6c1-b212-4279-8656-462791397648\" (UniqueName: \"kubernetes.io/nfs/4cca3cc0-3937-4745-863b-dcca5bbdbf11-pvc-3219e6c1-b212-4279-8656-462791397648\") pod \"k5793184a09e-node-0-1-shff7\" (UID: \"4cca3cc0-3937-4745-863b-dcca5bbdbf11\") " pod="test-ns-x7wjn/k5793184a09e-node-0-1-shff7" Nov 02 22:32:25.312888 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:25.312727 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wftph\" (UniqueName: \"kubernetes.io/projected/4cca3cc0-3937-4745-863b-dcca5bbdbf11-kube-api-access-wftph\") pod \"k5793184a09e-node-0-1-shff7\" (UID: \"4cca3cc0-3937-4745-863b-dcca5bbdbf11\") " pod="test-ns-x7wjn/k5793184a09e-node-0-1-shff7" Nov 02 22:32:25.325922 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:25.325894 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wftph\" (UniqueName: \"kubernetes.io/projected/4cca3cc0-3937-4745-863b-dcca5bbdbf11-kube-api-access-wftph\") pod \"k5793184a09e-node-0-1-shff7\" (UID: \"4cca3cc0-3937-4745-863b-dcca5bbdbf11\") " pod="test-ns-x7wjn/k5793184a09e-node-0-1-shff7" Nov 02 22:32:25.353541 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:25.353515 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-3219e6c1-b212-4279-8656-462791397648\" (UniqueName: \"kubernetes.io/nfs/4cca3cc0-3937-4745-863b-dcca5bbdbf11-pvc-3219e6c1-b212-4279-8656-462791397648\") pod \"k5793184a09e-node-0-1-shff7\" (UID: \"4cca3cc0-3937-4745-863b-dcca5bbdbf11\") " pod="test-ns-x7wjn/k5793184a09e-node-0-1-shff7" Nov 02 22:32:25.502229 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:25.502144 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-x7wjn/k5793184a09e-node-0-1-shff7" Nov 02 22:32:25.804829 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:25.804798 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-x7wjn/k5793184a09e-node-0-1-shff7"] Nov 02 22:32:25.807859 ip-10-0-139-99 kubenswrapper[5963]: W1102 22:32:25.807835 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4cca3cc0_3937_4745_863b_dcca5bbdbf11.slice/crio-bbefa56dafc2a147bb99ce8b4341a374b9f0779b3bacd5df2f0a0ea40e6e39a7 WatchSource:0}: Error finding container bbefa56dafc2a147bb99ce8b4341a374b9f0779b3bacd5df2f0a0ea40e6e39a7: Status 404 returned error can't find the container with id bbefa56dafc2a147bb99ce8b4341a374b9f0779b3bacd5df2f0a0ea40e6e39a7 Nov 02 22:32:25.924449 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:25.924417 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:26.512546 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:26.512500 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-x7wjn/k5793184a09e-node-0-1-shff7" event={"ID":"4cca3cc0-3937-4745-863b-dcca5bbdbf11","Type":"ContainerStarted","Data":"7f78582738982e2b2a02e69b385ce80e68f01f0b0305049f5ff7c1f9578b9c74"} Nov 02 22:32:26.512787 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:26.512574 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-x7wjn/k5793184a09e-node-0-1-shff7" event={"ID":"4cca3cc0-3937-4745-863b-dcca5bbdbf11","Type":"ContainerStarted","Data":"bbefa56dafc2a147bb99ce8b4341a374b9f0779b3bacd5df2f0a0ea40e6e39a7"} Nov 02 22:32:26.691531 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:26.691492 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:26.759140 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:26.759110 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_k5793184a09e-node-0-1-shff7_4cca3cc0-3937-4745-863b-dcca5bbdbf11/node/0.log" Nov 02 22:32:26.945488 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:26.945460 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:27.966071 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:27.966038 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:28.986897 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:28.986869 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:29.124380 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:32:29.124345 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:32:29.693114 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:29.693077 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:29.731127 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:29.731102 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_k5793184a09e-node-0-1-shff7_4cca3cc0-3937-4745-863b-dcca5bbdbf11/node/0.log" Nov 02 22:32:30.007323 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:30.007252 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:31.028676 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:31.028626 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:32.061847 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:32.061817 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:32.693037 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:32.693002 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:32.730573 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:32.730543 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_k5793184a09e-node-0-1-shff7_4cca3cc0-3937-4745-863b-dcca5bbdbf11/node/0.log" Nov 02 22:32:33.091492 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:33.091446 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:34.113293 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:34.113265 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:35.144823 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:35.144791 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:35.692160 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:35.692130 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:35.728865 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:35.728837 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_k5793184a09e-node-0-1-shff7_4cca3cc0-3937-4745-863b-dcca5bbdbf11/node/0.log" Nov 02 22:32:36.176239 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:36.176210 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:37.197488 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:37.197459 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:38.228338 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:38.228307 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:38.718365 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:38.718338 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:38.772723 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:38.772695 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_k5793184a09e-node-0-1-shff7_4cca3cc0-3937-4745-863b-dcca5bbdbf11/node/0.log" Nov 02 22:32:39.260411 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:39.260373 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:40.291797 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:40.291766 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:41.322448 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:41.322416 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:41.693401 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:41.693285 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:41.729811 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:41.729780 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_k5793184a09e-node-0-1-shff7_4cca3cc0-3937-4745-863b-dcca5bbdbf11/node/0.log" Nov 02 22:32:42.355131 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:42.355096 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:43.386238 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:43.386207 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:44.417537 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:44.417502 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:44.694478 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:44.694370 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:44.731163 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:44.731127 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_k5793184a09e-node-0-1-shff7_4cca3cc0-3937-4745-863b-dcca5bbdbf11/node/0.log" Nov 02 22:32:45.450382 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:45.450350 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:46.482526 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:46.482476 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:47.512625 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:47.512594 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:47.682354 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:47.682322 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:47.719996 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:47.719958 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_k5793184a09e-node-0-1-shff7_4cca3cc0-3937-4745-863b-dcca5bbdbf11/node/0.log" Nov 02 22:32:48.546182 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:48.546144 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:49.583940 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:49.583901 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:50.621388 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:50.621324 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:50.681594 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:50.681559 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:50.722529 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:50.722492 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_k5793184a09e-node-0-1-shff7_4cca3cc0-3937-4745-863b-dcca5bbdbf11/node/0.log" Nov 02 22:32:51.664055 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:51.664018 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:52.696293 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:52.696256 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:53.695241 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:53.695206 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:53.729620 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:53.729587 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:53.732459 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:53.732432 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_k5793184a09e-node-0-1-shff7_4cca3cc0-3937-4745-863b-dcca5bbdbf11/node/0.log" Nov 02 22:32:54.753549 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:54.753518 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:55.786761 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:55.786716 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:56.695358 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:56.695264 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:56.733106 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:56.733074 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_k5793184a09e-node-0-1-shff7_4cca3cc0-3937-4745-863b-dcca5bbdbf11/node/0.log" Nov 02 22:32:56.818715 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:56.818676 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:57.841814 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:57.841775 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:58.875065 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:58.875029 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:59.128828 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:32:59.128727 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:32:59.281364 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:59.281333 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:32:59.695606 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:59.695555 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:32:59.732625 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:59.732592 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_k5793184a09e-node-0-1-shff7_4cca3cc0-3937-4745-863b-dcca5bbdbf11/node/0.log" Nov 02 22:32:59.909139 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:32:59.909099 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:33:00.935908 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:00.935854 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:33:01.967867 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:01.967837 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:33:02.695352 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:02.695309 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:33:02.733434 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:02.733407 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_k5793184a09e-node-0-1-shff7_4cca3cc0-3937-4745-863b-dcca5bbdbf11/node/0.log" Nov 02 22:33:03.000198 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:03.000110 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:33:03.719987 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:03.719957 5963 generic.go:356] "Generic (PLEG): container finished" podID="4cca3cc0-3937-4745-863b-dcca5bbdbf11" containerID="7f78582738982e2b2a02e69b385ce80e68f01f0b0305049f5ff7c1f9578b9c74" exitCode=0 Nov 02 22:33:03.720158 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:03.720032 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-x7wjn/k5793184a09e-node-0-1-shff7" event={"ID":"4cca3cc0-3937-4745-863b-dcca5bbdbf11","Type":"ContainerDied","Data":"7f78582738982e2b2a02e69b385ce80e68f01f0b0305049f5ff7c1f9578b9c74"} Nov 02 22:33:04.031208 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:04.031129 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:33:04.865169 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:04.865144 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-x7wjn/k5793184a09e-node-0-1-shff7" Nov 02 22:33:04.991539 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:04.991449 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/nfs/4cca3cc0-3937-4745-863b-dcca5bbdbf11-pvc-3219e6c1-b212-4279-8656-462791397648\" (UniqueName: \"kubernetes.io/nfs/4cca3cc0-3937-4745-863b-dcca5bbdbf11-pvc-3219e6c1-b212-4279-8656-462791397648\") pod \"4cca3cc0-3937-4745-863b-dcca5bbdbf11\" (UID: \"4cca3cc0-3937-4745-863b-dcca5bbdbf11\") " Nov 02 22:33:04.991539 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:04.991531 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4cca3cc0-3937-4745-863b-dcca5bbdbf11-kube-api-access-wftph\" (UniqueName: \"kubernetes.io/projected/4cca3cc0-3937-4745-863b-dcca5bbdbf11-kube-api-access-wftph\") pod \"4cca3cc0-3937-4745-863b-dcca5bbdbf11\" (UID: \"4cca3cc0-3937-4745-863b-dcca5bbdbf11\") " Nov 02 22:33:04.993866 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:04.993832 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cca3cc0-3937-4745-863b-dcca5bbdbf11-kube-api-access-wftph" pod "4cca3cc0-3937-4745-863b-dcca5bbdbf11" (UID: "4cca3cc0-3937-4745-863b-dcca5bbdbf11"). InnerVolumeSpecName "kube-api-access-wftph". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 22:33:05.002213 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:05.002175 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/nfs/4cca3cc0-3937-4745-863b-dcca5bbdbf11-pvc-3219e6c1-b212-4279-8656-462791397648" pod "4cca3cc0-3937-4745-863b-dcca5bbdbf11" (UID: "4cca3cc0-3937-4745-863b-dcca5bbdbf11"). InnerVolumeSpecName "pvc-3219e6c1-b212-4279-8656-462791397648". PluginName "kubernetes.io/nfs", VolumeGIDValue "" Nov 02 22:33:05.063148 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:05.063111 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:33:05.092090 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:05.092063 5963 reconciler_common.go:299] "Volume detached for volume \"pvc-3219e6c1-b212-4279-8656-462791397648\" (UniqueName: \"kubernetes.io/nfs/4cca3cc0-3937-4745-863b-dcca5bbdbf11-pvc-3219e6c1-b212-4279-8656-462791397648\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:33:05.092090 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:05.092088 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wftph\" (UniqueName: \"kubernetes.io/projected/4cca3cc0-3937-4745-863b-dcca5bbdbf11-kube-api-access-wftph\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:33:05.695088 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:05.695058 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:33:05.729859 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:05.729833 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-x7wjn/k5793184a09e-node-0-1-shff7" Nov 02 22:33:05.729859 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:05.729849 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-x7wjn/k5793184a09e-node-0-1-shff7" event={"ID":"4cca3cc0-3937-4745-863b-dcca5bbdbf11","Type":"ContainerDied","Data":"bbefa56dafc2a147bb99ce8b4341a374b9f0779b3bacd5df2f0a0ea40e6e39a7"} Nov 02 22:33:05.730059 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:05.729921 5963 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bbefa56dafc2a147bb99ce8b4341a374b9f0779b3bacd5df2f0a0ea40e6e39a7" Nov 02 22:33:05.732835 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:05.732807 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_k5793184a09e-node-0-1-shff7_4cca3cc0-3937-4745-863b-dcca5bbdbf11/node/0.log" Nov 02 22:33:06.096110 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:06.096059 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:33:07.127626 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:07.127595 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:33:07.432747 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:07.432640 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-x7wjn/k5793184a09e-node-0-1-shff7"] Nov 02 22:33:07.435898 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:07.435869 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-x7wjn/k5793184a09e-node-0-1-shff7"] Nov 02 22:33:07.481588 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:07.481529 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:33:07.865168 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:07.865126 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4cca3cc0-3937-4745-863b-dcca5bbdbf11" path="/var/lib/kubelet/pods/4cca3cc0-3937-4745-863b-dcca5bbdbf11/volumes" Nov 02 22:33:08.161995 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:08.161900 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:33:08.213576 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:08.213532 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-x7wjn/dw-deployment-8fqc8-69445c46bc-ppr74"] Nov 02 22:33:08.213809 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:08.213761 5963 kuberuntime_container.go:898] "Killing container with a grace period" pod="test-ns-x7wjn/dw-deployment-8fqc8-69445c46bc-ppr74" podUID="7a4229f0-8c2c-4fbb-8556-9c70383d8b14" containerName="notebook" containerID="cri-o://debffde319cd8897f07cf3bf46f1bee96ea977c8a8633cc462779b7d488f2e9d" gracePeriod=30 Nov 02 22:33:08.296429 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:08.296391 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-x7wjn_dw-deployment-8fqc8-69445c46bc-ppr74_7a4229f0-8c2c-4fbb-8556-9c70383d8b14/notebook/0.log" Nov 02 22:33:08.396572 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:08.396536 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:33:08.519567 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:08.519450 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:33:08.624656 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:08.624618 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:33:08.861456 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:08.861409 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:33:08.970377 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:08.970337 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:33:09.193714 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:09.193618 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-tvsb4/dw-deployment-9grqw-77bdcccd94-r6sb7"] Nov 02 22:33:09.194103 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:09.193956 5963 cpu_manager.go:414] "containerMap: removing container" podUID="4cca3cc0-3937-4745-863b-dcca5bbdbf11" containerName="node" Nov 02 22:33:09.194103 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:09.193967 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4cca3cc0-3937-4745-863b-dcca5bbdbf11" containerName="node" Nov 02 22:33:09.194103 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:09.194040 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="4cca3cc0-3937-4745-863b-dcca5bbdbf11" containerName="node" Nov 02 22:33:09.197013 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:09.196995 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-tvsb4/dw-deployment-9grqw-77bdcccd94-r6sb7" Nov 02 22:33:09.201165 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:09.201147 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-tvsb4\"/\"kube-root-ca.crt\"" Nov 02 22:33:09.202008 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:09.201992 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-tvsb4\"/\"openshift-service-ca.crt\"" Nov 02 22:33:09.202056 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:09.202002 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-tvsb4\"/\"default-dockercfg-gr8b9\"" Nov 02 22:33:09.203228 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:09.203208 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-tvsb4\"/\"config-9t6pw\"" Nov 02 22:33:09.207442 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:09.207419 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-tvsb4/dw-deployment-9grqw-77bdcccd94-r6sb7"] Nov 02 22:33:09.324730 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:09.324686 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/73dfec5c-99b7-496e-8877-6ae3d15eb933-notebook-config\") pod \"dw-deployment-9grqw-77bdcccd94-r6sb7\" (UID: \"73dfec5c-99b7-496e-8877-6ae3d15eb933\") " pod="test-ns-tvsb4/dw-deployment-9grqw-77bdcccd94-r6sb7" Nov 02 22:33:09.324918 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:09.324742 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhgkw\" (UniqueName: \"kubernetes.io/projected/73dfec5c-99b7-496e-8877-6ae3d15eb933-kube-api-access-rhgkw\") pod \"dw-deployment-9grqw-77bdcccd94-r6sb7\" (UID: \"73dfec5c-99b7-496e-8877-6ae3d15eb933\") " pod="test-ns-tvsb4/dw-deployment-9grqw-77bdcccd94-r6sb7" Nov 02 22:33:09.324918 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:09.324824 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-23cbc96a-2b0b-4eed-84f1-c5895c6effa6\" (UniqueName: \"kubernetes.io/nfs/73dfec5c-99b7-496e-8877-6ae3d15eb933-pvc-23cbc96a-2b0b-4eed-84f1-c5895c6effa6\") pod \"dw-deployment-9grqw-77bdcccd94-r6sb7\" (UID: \"73dfec5c-99b7-496e-8877-6ae3d15eb933\") " pod="test-ns-tvsb4/dw-deployment-9grqw-77bdcccd94-r6sb7" Nov 02 22:33:09.426212 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:09.426174 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-23cbc96a-2b0b-4eed-84f1-c5895c6effa6\" (UniqueName: \"kubernetes.io/nfs/73dfec5c-99b7-496e-8877-6ae3d15eb933-pvc-23cbc96a-2b0b-4eed-84f1-c5895c6effa6\") pod \"dw-deployment-9grqw-77bdcccd94-r6sb7\" (UID: \"73dfec5c-99b7-496e-8877-6ae3d15eb933\") " pod="test-ns-tvsb4/dw-deployment-9grqw-77bdcccd94-r6sb7" Nov 02 22:33:09.426395 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:09.426260 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/73dfec5c-99b7-496e-8877-6ae3d15eb933-notebook-config\") pod \"dw-deployment-9grqw-77bdcccd94-r6sb7\" (UID: \"73dfec5c-99b7-496e-8877-6ae3d15eb933\") " pod="test-ns-tvsb4/dw-deployment-9grqw-77bdcccd94-r6sb7" Nov 02 22:33:09.426395 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:09.426291 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhgkw\" (UniqueName: \"kubernetes.io/projected/73dfec5c-99b7-496e-8877-6ae3d15eb933-kube-api-access-rhgkw\") pod \"dw-deployment-9grqw-77bdcccd94-r6sb7\" (UID: \"73dfec5c-99b7-496e-8877-6ae3d15eb933\") " pod="test-ns-tvsb4/dw-deployment-9grqw-77bdcccd94-r6sb7" Nov 02 22:33:09.427037 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:09.427010 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/73dfec5c-99b7-496e-8877-6ae3d15eb933-notebook-config\") pod \"dw-deployment-9grqw-77bdcccd94-r6sb7\" (UID: \"73dfec5c-99b7-496e-8877-6ae3d15eb933\") " pod="test-ns-tvsb4/dw-deployment-9grqw-77bdcccd94-r6sb7" Nov 02 22:33:09.448716 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:09.448615 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhgkw\" (UniqueName: \"kubernetes.io/projected/73dfec5c-99b7-496e-8877-6ae3d15eb933-kube-api-access-rhgkw\") pod \"dw-deployment-9grqw-77bdcccd94-r6sb7\" (UID: \"73dfec5c-99b7-496e-8877-6ae3d15eb933\") " pod="test-ns-tvsb4/dw-deployment-9grqw-77bdcccd94-r6sb7" Nov 02 22:33:09.449474 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:09.449454 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-23cbc96a-2b0b-4eed-84f1-c5895c6effa6\" (UniqueName: \"kubernetes.io/nfs/73dfec5c-99b7-496e-8877-6ae3d15eb933-pvc-23cbc96a-2b0b-4eed-84f1-c5895c6effa6\") pod \"dw-deployment-9grqw-77bdcccd94-r6sb7\" (UID: \"73dfec5c-99b7-496e-8877-6ae3d15eb933\") " pod="test-ns-tvsb4/dw-deployment-9grqw-77bdcccd94-r6sb7" Nov 02 22:33:09.510928 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:09.510893 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-tvsb4/dw-deployment-9grqw-77bdcccd94-r6sb7" Nov 02 22:33:09.793708 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:09.793598 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-tvsb4/dw-deployment-9grqw-77bdcccd94-r6sb7"] Nov 02 22:33:09.797469 ip-10-0-139-99 kubenswrapper[5963]: W1102 22:33:09.797431 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73dfec5c_99b7_496e_8877_6ae3d15eb933.slice/crio-2bd5d76ed71c95517ea94d954c8027378da21a83d04f6892561a521a6e4b6c0b WatchSource:0}: Error finding container 2bd5d76ed71c95517ea94d954c8027378da21a83d04f6892561a521a6e4b6c0b: Status 404 returned error can't find the container with id 2bd5d76ed71c95517ea94d954c8027378da21a83d04f6892561a521a6e4b6c0b Nov 02 22:33:09.798842 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:09.798823 5963 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 02 22:33:10.754957 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:10.754913 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-tvsb4/dw-deployment-9grqw-77bdcccd94-r6sb7" event={"ID":"73dfec5c-99b7-496e-8877-6ae3d15eb933","Type":"ContainerStarted","Data":"ae7552484039a04932139910e59939fab3c48d8deb188e4df6c90c56d9ed735b"} Nov 02 22:33:10.755379 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:10.754980 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-tvsb4/dw-deployment-9grqw-77bdcccd94-r6sb7" event={"ID":"73dfec5c-99b7-496e-8877-6ae3d15eb933","Type":"ContainerStarted","Data":"2bd5d76ed71c95517ea94d954c8027378da21a83d04f6892561a521a6e4b6c0b"} Nov 02 22:33:10.775579 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:10.775523 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-tvsb4/dw-deployment-9grqw-77bdcccd94-r6sb7" podStartSLOduration=2.328020908 podStartE2EDuration="2.77550967s" totalImagesPullingTime="447.488762ms" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 22:33:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:33:10.77438399 +0000 UTC m=+2363.026382456" watchObservedRunningTime="2026-11-02 22:33:10.77550967 +0000 UTC m=+2363.027508136" Nov 02 22:33:11.442749 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:11.442715 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:13.454849 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:13.454812 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:33:14.443251 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:14.443226 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:17.442688 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:17.442632 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:20.442871 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:20.442839 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:23.442931 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:23.442890 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:26.443629 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:26.443589 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:27.973498 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:27.973462 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:33:28.269501 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:28.269398 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:28.354375 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:28.354338 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-tvsb4/u65ca6d7cff5-node-0-1-fm448"] Nov 02 22:33:28.359637 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:28.359615 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-tvsb4/u65ca6d7cff5-node-0-1-fm448" Nov 02 22:33:28.369852 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:28.369826 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-tvsb4/u65ca6d7cff5-node-0-1-fm448"] Nov 02 22:33:28.486573 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:28.486533 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-23cbc96a-2b0b-4eed-84f1-c5895c6effa6\" (UniqueName: \"kubernetes.io/nfs/46e3023d-a408-4f7e-9f3b-8d1c83840bb8-pvc-23cbc96a-2b0b-4eed-84f1-c5895c6effa6\") pod \"u65ca6d7cff5-node-0-1-fm448\" (UID: \"46e3023d-a408-4f7e-9f3b-8d1c83840bb8\") " pod="test-ns-tvsb4/u65ca6d7cff5-node-0-1-fm448" Nov 02 22:33:28.486789 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:28.486589 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp9xm\" (UniqueName: \"kubernetes.io/projected/46e3023d-a408-4f7e-9f3b-8d1c83840bb8-kube-api-access-vp9xm\") pod \"u65ca6d7cff5-node-0-1-fm448\" (UID: \"46e3023d-a408-4f7e-9f3b-8d1c83840bb8\") " pod="test-ns-tvsb4/u65ca6d7cff5-node-0-1-fm448" Nov 02 22:33:28.587893 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:28.587854 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-23cbc96a-2b0b-4eed-84f1-c5895c6effa6\" (UniqueName: \"kubernetes.io/nfs/46e3023d-a408-4f7e-9f3b-8d1c83840bb8-pvc-23cbc96a-2b0b-4eed-84f1-c5895c6effa6\") pod \"u65ca6d7cff5-node-0-1-fm448\" (UID: \"46e3023d-a408-4f7e-9f3b-8d1c83840bb8\") " pod="test-ns-tvsb4/u65ca6d7cff5-node-0-1-fm448" Nov 02 22:33:28.588090 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:28.587912 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp9xm\" (UniqueName: \"kubernetes.io/projected/46e3023d-a408-4f7e-9f3b-8d1c83840bb8-kube-api-access-vp9xm\") pod \"u65ca6d7cff5-node-0-1-fm448\" (UID: \"46e3023d-a408-4f7e-9f3b-8d1c83840bb8\") " pod="test-ns-tvsb4/u65ca6d7cff5-node-0-1-fm448" Nov 02 22:33:28.600640 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:28.600610 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp9xm\" (UniqueName: \"kubernetes.io/projected/46e3023d-a408-4f7e-9f3b-8d1c83840bb8-kube-api-access-vp9xm\") pod \"u65ca6d7cff5-node-0-1-fm448\" (UID: \"46e3023d-a408-4f7e-9f3b-8d1c83840bb8\") " pod="test-ns-tvsb4/u65ca6d7cff5-node-0-1-fm448" Nov 02 22:33:28.633528 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:28.633496 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-23cbc96a-2b0b-4eed-84f1-c5895c6effa6\" (UniqueName: \"kubernetes.io/nfs/46e3023d-a408-4f7e-9f3b-8d1c83840bb8-pvc-23cbc96a-2b0b-4eed-84f1-c5895c6effa6\") pod \"u65ca6d7cff5-node-0-1-fm448\" (UID: \"46e3023d-a408-4f7e-9f3b-8d1c83840bb8\") " pod="test-ns-tvsb4/u65ca6d7cff5-node-0-1-fm448" Nov 02 22:33:28.673068 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:28.673038 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-tvsb4/u65ca6d7cff5-node-0-1-fm448" Nov 02 22:33:28.955930 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:28.955857 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-tvsb4/u65ca6d7cff5-node-0-1-fm448"] Nov 02 22:33:28.959726 ip-10-0-139-99 kubenswrapper[5963]: W1102 22:33:28.959699 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod46e3023d_a408_4f7e_9f3b_8d1c83840bb8.slice/crio-c543f44e791adc43a860aabf5d9918ff7bdcd99dfaa426e2116d2018be39ff2b WatchSource:0}: Error finding container c543f44e791adc43a860aabf5d9918ff7bdcd99dfaa426e2116d2018be39ff2b: Status 404 returned error can't find the container with id c543f44e791adc43a860aabf5d9918ff7bdcd99dfaa426e2116d2018be39ff2b Nov 02 22:33:29.124113 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:33:29.124073 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:33:29.289335 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:29.289243 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:29.456562 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:29.456536 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:29.842874 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:29.842824 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-tvsb4/u65ca6d7cff5-node-0-1-fm448" event={"ID":"46e3023d-a408-4f7e-9f3b-8d1c83840bb8","Type":"ContainerStarted","Data":"27ee3339fc9bf0bcec3eee3240a00453a00f00959fc5677e403773b6627d1e9a"} Nov 02 22:33:29.843127 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:29.842920 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-tvsb4/u65ca6d7cff5-node-0-1-fm448" event={"ID":"46e3023d-a408-4f7e-9f3b-8d1c83840bb8","Type":"ContainerStarted","Data":"c543f44e791adc43a860aabf5d9918ff7bdcd99dfaa426e2116d2018be39ff2b"} Nov 02 22:33:29.864953 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:29.864899 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-tvsb4/u65ca6d7cff5-node-0-1-fm448" podStartSLOduration=1.86488509 podStartE2EDuration="1.86488509s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 22:33:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:33:29.864846763 +0000 UTC m=+2382.116845271" watchObservedRunningTime="2026-11-02 22:33:29.86488509 +0000 UTC m=+2382.116883556" Nov 02 22:33:30.311790 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:30.311756 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:31.332319 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:31.332288 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:32.353066 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:32.353036 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:32.456536 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:32.456507 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:32.493644 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:32.493610 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_u65ca6d7cff5-node-0-1-fm448_46e3023d-a408-4f7e-9f3b-8d1c83840bb8/node/0.log" Nov 02 22:33:33.374033 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:33.374001 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:34.394351 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:34.394311 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:35.415450 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:35.415399 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:35.459474 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:35.459427 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:35.497386 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:35.497349 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_u65ca6d7cff5-node-0-1-fm448_46e3023d-a408-4f7e-9f3b-8d1c83840bb8/node/0.log" Nov 02 22:33:36.438133 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:36.438075 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:37.468391 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:37.468352 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:38.440324 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:38.440290 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-x7wjn/dw-deployment-8fqc8-69445c46bc-ppr74" Nov 02 22:33:38.458112 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:38.458078 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:38.483135 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:38.483044 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/nfs/7a4229f0-8c2c-4fbb-8556-9c70383d8b14-pvc-3219e6c1-b212-4279-8656-462791397648\" (UniqueName: \"kubernetes.io/nfs/7a4229f0-8c2c-4fbb-8556-9c70383d8b14-pvc-3219e6c1-b212-4279-8656-462791397648\") pod \"7a4229f0-8c2c-4fbb-8556-9c70383d8b14\" (UID: \"7a4229f0-8c2c-4fbb-8556-9c70383d8b14\") " Nov 02 22:33:38.483641 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:38.483191 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7a4229f0-8c2c-4fbb-8556-9c70383d8b14-notebook-config\" (UniqueName: \"kubernetes.io/configmap/7a4229f0-8c2c-4fbb-8556-9c70383d8b14-notebook-config\") pod \"7a4229f0-8c2c-4fbb-8556-9c70383d8b14\" (UID: \"7a4229f0-8c2c-4fbb-8556-9c70383d8b14\") " Nov 02 22:33:38.483641 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:38.483259 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7a4229f0-8c2c-4fbb-8556-9c70383d8b14-kube-api-access-s7jpr\" (UniqueName: \"kubernetes.io/projected/7a4229f0-8c2c-4fbb-8556-9c70383d8b14-kube-api-access-s7jpr\") pod \"7a4229f0-8c2c-4fbb-8556-9c70383d8b14\" (UID: \"7a4229f0-8c2c-4fbb-8556-9c70383d8b14\") " Nov 02 22:33:38.483818 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:38.483649 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a4229f0-8c2c-4fbb-8556-9c70383d8b14-notebook-config" pod "7a4229f0-8c2c-4fbb-8556-9c70383d8b14" (UID: "7a4229f0-8c2c-4fbb-8556-9c70383d8b14"). InnerVolumeSpecName "notebook-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 22:33:38.485902 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:38.485863 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a4229f0-8c2c-4fbb-8556-9c70383d8b14-kube-api-access-s7jpr" pod "7a4229f0-8c2c-4fbb-8556-9c70383d8b14" (UID: "7a4229f0-8c2c-4fbb-8556-9c70383d8b14"). InnerVolumeSpecName "kube-api-access-s7jpr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 22:33:38.497065 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:38.497044 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_u65ca6d7cff5-node-0-1-fm448_46e3023d-a408-4f7e-9f3b-8d1c83840bb8/node/0.log" Nov 02 22:33:38.500494 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:38.500464 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:38.514953 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:38.514925 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/nfs/7a4229f0-8c2c-4fbb-8556-9c70383d8b14-pvc-3219e6c1-b212-4279-8656-462791397648" pod "7a4229f0-8c2c-4fbb-8556-9c70383d8b14" (UID: "7a4229f0-8c2c-4fbb-8556-9c70383d8b14"). InnerVolumeSpecName "pvc-3219e6c1-b212-4279-8656-462791397648". PluginName "kubernetes.io/nfs", VolumeGIDValue "" Nov 02 22:33:38.584578 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:38.584540 5963 reconciler_common.go:299] "Volume detached for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/7a4229f0-8c2c-4fbb-8556-9c70383d8b14-notebook-config\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:33:38.584578 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:38.584574 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7jpr\" (UniqueName: \"kubernetes.io/projected/7a4229f0-8c2c-4fbb-8556-9c70383d8b14-kube-api-access-s7jpr\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:33:38.584578 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:38.584587 5963 reconciler_common.go:299] "Volume detached for volume \"pvc-3219e6c1-b212-4279-8656-462791397648\" (UniqueName: \"kubernetes.io/nfs/7a4229f0-8c2c-4fbb-8556-9c70383d8b14-pvc-3219e6c1-b212-4279-8656-462791397648\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:33:38.890541 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:38.890506 5963 generic.go:356] "Generic (PLEG): container finished" podID="7a4229f0-8c2c-4fbb-8556-9c70383d8b14" containerID="debffde319cd8897f07cf3bf46f1bee96ea977c8a8633cc462779b7d488f2e9d" exitCode=137 Nov 02 22:33:38.890743 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:38.890557 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-x7wjn/dw-deployment-8fqc8-69445c46bc-ppr74" Nov 02 22:33:38.890743 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:38.890611 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-x7wjn/dw-deployment-8fqc8-69445c46bc-ppr74" event={"ID":"7a4229f0-8c2c-4fbb-8556-9c70383d8b14","Type":"ContainerDied","Data":"debffde319cd8897f07cf3bf46f1bee96ea977c8a8633cc462779b7d488f2e9d"} Nov 02 22:33:38.890743 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:38.890699 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-x7wjn/dw-deployment-8fqc8-69445c46bc-ppr74" event={"ID":"7a4229f0-8c2c-4fbb-8556-9c70383d8b14","Type":"ContainerDied","Data":"83b045e3095783fab89aacc7d55037281dff1c01caee1fc809b5a4d2a5fa230d"} Nov 02 22:33:38.890743 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:38.890734 5963 scope.go:122] "RemoveContainer" containerID="debffde319cd8897f07cf3bf46f1bee96ea977c8a8633cc462779b7d488f2e9d" Nov 02 22:33:38.912044 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:38.911936 5963 scope.go:122] "RemoveContainer" containerID="debffde319cd8897f07cf3bf46f1bee96ea977c8a8633cc462779b7d488f2e9d" Nov 02 22:33:38.912634 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:33:38.912604 5963 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"debffde319cd8897f07cf3bf46f1bee96ea977c8a8633cc462779b7d488f2e9d\": container with ID starting with debffde319cd8897f07cf3bf46f1bee96ea977c8a8633cc462779b7d488f2e9d not found: ID does not exist" containerID="debffde319cd8897f07cf3bf46f1bee96ea977c8a8633cc462779b7d488f2e9d" Nov 02 22:33:38.912805 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:38.912643 5963 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"debffde319cd8897f07cf3bf46f1bee96ea977c8a8633cc462779b7d488f2e9d"} err="failed to get container status \"debffde319cd8897f07cf3bf46f1bee96ea977c8a8633cc462779b7d488f2e9d\": rpc error: code = NotFound desc = could not find container \"debffde319cd8897f07cf3bf46f1bee96ea977c8a8633cc462779b7d488f2e9d\": container with ID starting with debffde319cd8897f07cf3bf46f1bee96ea977c8a8633cc462779b7d488f2e9d not found: ID does not exist" Nov 02 22:33:38.913258 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:38.913236 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-x7wjn/dw-deployment-8fqc8-69445c46bc-ppr74"] Nov 02 22:33:38.916823 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:38.916796 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-x7wjn/dw-deployment-8fqc8-69445c46bc-ppr74"] Nov 02 22:33:39.521854 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:39.521812 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:39.865535 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:39.865487 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7a4229f0-8c2c-4fbb-8556-9c70383d8b14" path="/var/lib/kubelet/pods/7a4229f0-8c2c-4fbb-8556-9c70383d8b14/volumes" Nov 02 22:33:40.553528 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:40.553487 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:41.457345 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:41.457312 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:41.494633 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:41.494597 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_u65ca6d7cff5-node-0-1-fm448_46e3023d-a408-4f7e-9f3b-8d1c83840bb8/node/0.log" Nov 02 22:33:41.584839 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:41.584795 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:42.606562 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:42.606527 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:43.637006 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:43.636979 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:43.914540 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:43.914428 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:33:44.071612 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:44.071581 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:33:44.385883 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:44.385852 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:33:44.458363 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:44.458322 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:44.494577 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:44.494530 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_u65ca6d7cff5-node-0-1-fm448_46e3023d-a408-4f7e-9f3b-8d1c83840bb8/node/0.log" Nov 02 22:33:44.669281 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:44.669171 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:45.691868 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:45.691833 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:46.725735 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:46.725692 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:47.457895 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:47.457847 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:47.497204 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:47.497169 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_u65ca6d7cff5-node-0-1-fm448_46e3023d-a408-4f7e-9f3b-8d1c83840bb8/node/0.log" Nov 02 22:33:47.756144 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:47.756046 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:48.390640 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:48.390607 5963 scope.go:122] "RemoveContainer" containerID="29074cda51b994d94bd9a7bcb5064e07b8bccfaaa8df4738a152d72e13e9c20d" Nov 02 22:33:48.401539 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:48.401514 5963 scope.go:122] "RemoveContainer" containerID="4c7330c08cba877b46e8cbdeb0c6bdd6ab54e560ec8187c83844ebf460229299" Nov 02 22:33:48.417850 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:48.417825 5963 scope.go:122] "RemoveContainer" containerID="c2f47c448cb9cb3c296e9efa2790c49d5999604561f067484b82c0d940ac09cc" Nov 02 22:33:48.779225 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:48.779132 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:49.810474 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:49.810431 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:49.913095 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:49.913056 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:33:50.006964 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:50.006917 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:33:50.470290 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:50.470253 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:50.507814 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:50.507783 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_u65ca6d7cff5-node-0-1-fm448_46e3023d-a408-4f7e-9f3b-8d1c83840bb8/node/0.log" Nov 02 22:33:50.842147 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:50.842114 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:51.875940 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:51.875896 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:52.904296 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:52.904247 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:53.458056 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:53.458023 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:53.495295 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:53.495254 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_u65ca6d7cff5-node-0-1-fm448_46e3023d-a408-4f7e-9f3b-8d1c83840bb8/node/0.log" Nov 02 22:33:53.938743 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:53.938710 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:54.961574 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:54.961545 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:55.985657 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:55.985622 5963 generic.go:356] "Generic (PLEG): container finished" podID="46e3023d-a408-4f7e-9f3b-8d1c83840bb8" containerID="27ee3339fc9bf0bcec3eee3240a00453a00f00959fc5677e403773b6627d1e9a" exitCode=0 Nov 02 22:33:55.986064 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:55.985686 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-tvsb4/u65ca6d7cff5-node-0-1-fm448" event={"ID":"46e3023d-a408-4f7e-9f3b-8d1c83840bb8","Type":"ContainerDied","Data":"27ee3339fc9bf0bcec3eee3240a00453a00f00959fc5677e403773b6627d1e9a"} Nov 02 22:33:55.992733 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:55.992709 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:56.459418 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:56.459388 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:56.496588 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:56.496553 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_u65ca6d7cff5-node-0-1-fm448_46e3023d-a408-4f7e-9f3b-8d1c83840bb8/node/0.log" Nov 02 22:33:57.024504 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:57.024479 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:57.120646 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:57.120620 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-tvsb4/u65ca6d7cff5-node-0-1-fm448" Nov 02 22:33:57.269347 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:57.269256 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/nfs/46e3023d-a408-4f7e-9f3b-8d1c83840bb8-pvc-23cbc96a-2b0b-4eed-84f1-c5895c6effa6\" (UniqueName: \"kubernetes.io/nfs/46e3023d-a408-4f7e-9f3b-8d1c83840bb8-pvc-23cbc96a-2b0b-4eed-84f1-c5895c6effa6\") pod \"46e3023d-a408-4f7e-9f3b-8d1c83840bb8\" (UID: \"46e3023d-a408-4f7e-9f3b-8d1c83840bb8\") " Nov 02 22:33:57.269347 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:57.269306 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/46e3023d-a408-4f7e-9f3b-8d1c83840bb8-kube-api-access-vp9xm\" (UniqueName: \"kubernetes.io/projected/46e3023d-a408-4f7e-9f3b-8d1c83840bb8-kube-api-access-vp9xm\") pod \"46e3023d-a408-4f7e-9f3b-8d1c83840bb8\" (UID: \"46e3023d-a408-4f7e-9f3b-8d1c83840bb8\") " Nov 02 22:33:57.271589 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:57.271562 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46e3023d-a408-4f7e-9f3b-8d1c83840bb8-kube-api-access-vp9xm" pod "46e3023d-a408-4f7e-9f3b-8d1c83840bb8" (UID: "46e3023d-a408-4f7e-9f3b-8d1c83840bb8"). InnerVolumeSpecName "kube-api-access-vp9xm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 22:33:57.280920 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:57.280895 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/nfs/46e3023d-a408-4f7e-9f3b-8d1c83840bb8-pvc-23cbc96a-2b0b-4eed-84f1-c5895c6effa6" pod "46e3023d-a408-4f7e-9f3b-8d1c83840bb8" (UID: "46e3023d-a408-4f7e-9f3b-8d1c83840bb8"). InnerVolumeSpecName "pvc-23cbc96a-2b0b-4eed-84f1-c5895c6effa6". PluginName "kubernetes.io/nfs", VolumeGIDValue "" Nov 02 22:33:57.370912 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:57.370880 5963 reconciler_common.go:299] "Volume detached for volume \"pvc-23cbc96a-2b0b-4eed-84f1-c5895c6effa6\" (UniqueName: \"kubernetes.io/nfs/46e3023d-a408-4f7e-9f3b-8d1c83840bb8-pvc-23cbc96a-2b0b-4eed-84f1-c5895c6effa6\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:33:57.370912 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:57.370909 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vp9xm\" (UniqueName: \"kubernetes.io/projected/46e3023d-a408-4f7e-9f3b-8d1c83840bb8-kube-api-access-vp9xm\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:33:57.995720 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:57.995678 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-tvsb4/u65ca6d7cff5-node-0-1-fm448" event={"ID":"46e3023d-a408-4f7e-9f3b-8d1c83840bb8","Type":"ContainerDied","Data":"c543f44e791adc43a860aabf5d9918ff7bdcd99dfaa426e2116d2018be39ff2b"} Nov 02 22:33:57.995720 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:57.995704 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-tvsb4/u65ca6d7cff5-node-0-1-fm448" Nov 02 22:33:57.995720 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:57.995727 5963 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c543f44e791adc43a860aabf5d9918ff7bdcd99dfaa426e2116d2018be39ff2b" Nov 02 22:33:58.057217 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:58.057165 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:58.812862 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:58.812823 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-tvsb4/u65ca6d7cff5-node-0-1-fm448"] Nov 02 22:33:58.815048 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:58.815020 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-tvsb4/u65ca6d7cff5-node-0-1-fm448"] Nov 02 22:33:58.860426 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:58.860386 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:33:59.101459 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:59.101376 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:59.127163 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:33:59.127126 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:33:59.332072 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:59.332019 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:33:59.450000 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:59.449889 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:33:59.863607 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:33:59.863574 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="46e3023d-a408-4f7e-9f3b-8d1c83840bb8" path="/var/lib/kubelet/pods/46e3023d-a408-4f7e-9f3b-8d1c83840bb8/volumes" Nov 02 22:34:00.143491 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:00.143358 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:34:00.195368 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:00.195333 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-tvsb4/dw-deployment-9grqw-77bdcccd94-r6sb7"] Nov 02 22:34:00.195609 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:00.195564 5963 kuberuntime_container.go:898] "Killing container with a grace period" pod="test-ns-tvsb4/dw-deployment-9grqw-77bdcccd94-r6sb7" podUID="73dfec5c-99b7-496e-8877-6ae3d15eb933" containerName="notebook" containerID="cri-o://ae7552484039a04932139910e59939fab3c48d8deb188e4df6c90c56d9ed735b" gracePeriod=30 Nov 02 22:34:00.299821 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:00.299782 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tvsb4_dw-deployment-9grqw-77bdcccd94-r6sb7_73dfec5c-99b7-496e-8877-6ae3d15eb933/notebook/0.log" Nov 02 22:34:00.401425 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:00.401348 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:00.500979 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:00.500944 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:00.607042 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:00.606995 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:00.710604 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:00.710526 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-ql46v/test-preemption-trainjob-8vqfg-node-0-0-d2qdh"] Nov 02 22:34:00.710947 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:00.710932 5963 cpu_manager.go:414] "containerMap: removing container" podUID="7a4229f0-8c2c-4fbb-8556-9c70383d8b14" containerName="notebook" Nov 02 22:34:00.710998 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:00.710950 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7a4229f0-8c2c-4fbb-8556-9c70383d8b14" containerName="notebook" Nov 02 22:34:00.710998 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:00.710974 5963 cpu_manager.go:414] "containerMap: removing container" podUID="46e3023d-a408-4f7e-9f3b-8d1c83840bb8" containerName="node" Nov 02 22:34:00.710998 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:00.710982 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="46e3023d-a408-4f7e-9f3b-8d1c83840bb8" containerName="node" Nov 02 22:34:00.711097 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:00.711046 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="7a4229f0-8c2c-4fbb-8556-9c70383d8b14" containerName="notebook" Nov 02 22:34:00.711097 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:00.711061 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="46e3023d-a408-4f7e-9f3b-8d1c83840bb8" containerName="node" Nov 02 22:34:00.714387 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:00.714371 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-ql46v/test-preemption-trainjob-8vqfg-node-0-0-d2qdh" Nov 02 22:34:00.728615 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:00.728578 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-ql46v/test-preemption-trainjob-8vqfg-node-0-0-d2qdh"] Nov 02 22:34:00.728862 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:00.728771 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-ql46v\"/\"kube-root-ca.crt\"" Nov 02 22:34:00.728953 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:00.728886 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-ql46v\"/\"openshift-service-ca.crt\"" Nov 02 22:34:00.729027 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:00.728989 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-ql46v\"/\"default-dockercfg-p78d6\"" Nov 02 22:34:00.800822 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:00.800779 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn8f9\" (UniqueName: \"kubernetes.io/projected/b406cc6a-c351-41b3-a07e-6c9d86e0e848-kube-api-access-wn8f9\") pod \"test-preemption-trainjob-8vqfg-node-0-0-d2qdh\" (UID: \"b406cc6a-c351-41b3-a07e-6c9d86e0e848\") " pod="test-ns-ql46v/test-preemption-trainjob-8vqfg-node-0-0-d2qdh" Nov 02 22:34:00.901822 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:00.901783 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn8f9\" (UniqueName: \"kubernetes.io/projected/b406cc6a-c351-41b3-a07e-6c9d86e0e848-kube-api-access-wn8f9\") pod \"test-preemption-trainjob-8vqfg-node-0-0-d2qdh\" (UID: \"b406cc6a-c351-41b3-a07e-6c9d86e0e848\") " pod="test-ns-ql46v/test-preemption-trainjob-8vqfg-node-0-0-d2qdh" Nov 02 22:34:00.914800 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:00.914766 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn8f9\" (UniqueName: \"kubernetes.io/projected/b406cc6a-c351-41b3-a07e-6c9d86e0e848-kube-api-access-wn8f9\") pod \"test-preemption-trainjob-8vqfg-node-0-0-d2qdh\" (UID: \"b406cc6a-c351-41b3-a07e-6c9d86e0e848\") " pod="test-ns-ql46v/test-preemption-trainjob-8vqfg-node-0-0-d2qdh" Nov 02 22:34:01.031039 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:01.030947 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-ql46v/test-preemption-trainjob-8vqfg-node-0-0-d2qdh" Nov 02 22:34:01.312586 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:01.312554 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-ql46v/test-preemption-trainjob-8vqfg-node-0-0-d2qdh"] Nov 02 22:34:01.316402 ip-10-0-139-99 kubenswrapper[5963]: W1102 22:34:01.316370 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb406cc6a_c351_41b3_a07e_6c9d86e0e848.slice/crio-055054cbee5f44d22709fec649723c2677560ebe5f464ab86df217f46f27dc30 WatchSource:0}: Error finding container 055054cbee5f44d22709fec649723c2677560ebe5f464ab86df217f46f27dc30: Status 404 returned error can't find the container with id 055054cbee5f44d22709fec649723c2677560ebe5f464ab86df217f46f27dc30 Nov 02 22:34:02.016851 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:02.016814 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-ql46v/test-preemption-trainjob-8vqfg-node-0-0-d2qdh" event={"ID":"b406cc6a-c351-41b3-a07e-6c9d86e0e848","Type":"ContainerStarted","Data":"b2ee4626379a5a6945ce8f22e68af82925ec7f8407b4a3788bfd9c4b8175d141"} Nov 02 22:34:02.016851 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:02.016857 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-ql46v/test-preemption-trainjob-8vqfg-node-0-0-d2qdh" event={"ID":"b406cc6a-c351-41b3-a07e-6c9d86e0e848","Type":"ContainerStarted","Data":"055054cbee5f44d22709fec649723c2677560ebe5f464ab86df217f46f27dc30"} Nov 02 22:34:02.036933 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:02.036884 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-ql46v/test-preemption-trainjob-8vqfg-node-0-0-d2qdh" podStartSLOduration=2.03687002 podStartE2EDuration="2.03687002s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:34:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:34:02.035628293 +0000 UTC m=+2414.287626788" watchObservedRunningTime="2026-11-02 22:34:02.03687002 +0000 UTC m=+2414.288868463" Nov 02 22:34:02.781286 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:02.781251 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-ql46v/test-preemption-trainjob-8vqfg-node-0-0-d2qdh"] Nov 02 22:34:03.428293 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:03.428264 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ql46v_test-preemption-trainjob-8vqfg-node-0-0-d2qdh_b406cc6a-c351-41b3-a07e-6c9d86e0e848/node/0.log" Nov 02 22:34:03.789881 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:03.789800 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-ql46v_test-preemption-trainjob-8vqfg-node-0-0-d2qdh_b406cc6a-c351-41b3-a07e-6c9d86e0e848/node/0.log" Nov 02 22:34:03.886128 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:03.886093 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:03.989597 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:03.989555 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:04.027088 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:04.027031 5963 kuberuntime_container.go:898] "Killing container with a grace period" pod="test-ns-ql46v/test-preemption-trainjob-8vqfg-node-0-0-d2qdh" podUID="b406cc6a-c351-41b3-a07e-6c9d86e0e848" containerName="node" containerID="cri-o://b2ee4626379a5a6945ce8f22e68af82925ec7f8407b4a3788bfd9c4b8175d141" gracePeriod=30 Nov 02 22:34:04.089566 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:04.089528 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:05.210875 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:05.210836 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:05.355545 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:05.355514 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:05.455861 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:05.455824 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:08.943377 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:08.943330 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:10.258717 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:10.258684 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:15.311308 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:15.311259 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:16.126582 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:16.126545 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:18.857068 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:18.857031 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-mt646/test-mpi-trainjob-n6v44-launcher-0-0-k7gw6"] Nov 02 22:34:18.860714 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:18.860694 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-mt646/test-mpi-trainjob-n6v44-launcher-0-0-k7gw6" Nov 02 22:34:18.864824 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:18.864797 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-mt646\"/\"openshift-service-ca.crt\"" Nov 02 22:34:18.866038 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:18.866019 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-mt646\"/\"default-dockercfg-299ch\"" Nov 02 22:34:18.867483 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:18.867468 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-mt646\"/\"test-mpi-trainjob-n6v44-mpi-hostfile\"" Nov 02 22:34:18.872291 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:18.872267 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-mt646/test-mpi-trainjob-n6v44-launcher-0-0-k7gw6"] Nov 02 22:34:18.950460 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:18.950418 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8dwp\" (UniqueName: \"kubernetes.io/projected/87e77d5a-d0c4-439c-983f-efbb4ddb9fc2-kube-api-access-h8dwp\") pod \"test-mpi-trainjob-n6v44-launcher-0-0-k7gw6\" (UID: \"87e77d5a-d0c4-439c-983f-efbb4ddb9fc2\") " pod="test-ns-mt646/test-mpi-trainjob-n6v44-launcher-0-0-k7gw6" Nov 02 22:34:18.950646 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:18.950493 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"mpi-ssh-auth\" (UniqueName: \"kubernetes.io/secret/87e77d5a-d0c4-439c-983f-efbb4ddb9fc2-mpi-ssh-auth\") pod \"test-mpi-trainjob-n6v44-launcher-0-0-k7gw6\" (UID: \"87e77d5a-d0c4-439c-983f-efbb4ddb9fc2\") " pod="test-ns-mt646/test-mpi-trainjob-n6v44-launcher-0-0-k7gw6" Nov 02 22:34:18.950646 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:18.950559 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"mpi-hostfile\" (UniqueName: \"kubernetes.io/configmap/87e77d5a-d0c4-439c-983f-efbb4ddb9fc2-mpi-hostfile\") pod \"test-mpi-trainjob-n6v44-launcher-0-0-k7gw6\" (UID: \"87e77d5a-d0c4-439c-983f-efbb4ddb9fc2\") " pod="test-ns-mt646/test-mpi-trainjob-n6v44-launcher-0-0-k7gw6" Nov 02 22:34:18.950646 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:18.950599 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"mpi-test-script\" (UniqueName: \"kubernetes.io/configmap/87e77d5a-d0c4-439c-983f-efbb4ddb9fc2-mpi-test-script\") pod \"test-mpi-trainjob-n6v44-launcher-0-0-k7gw6\" (UID: \"87e77d5a-d0c4-439c-983f-efbb4ddb9fc2\") " pod="test-ns-mt646/test-mpi-trainjob-n6v44-launcher-0-0-k7gw6" Nov 02 22:34:18.965966 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:18.965942 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-mt646\"/\"kube-root-ca.crt\"" Nov 02 22:34:18.966074 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:18.966054 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-mt646\"/\"test-mpi-trainjob-n6v44-mpi-ssh-auth\"" Nov 02 22:34:18.966154 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:18.966140 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-mt646\"/\"config-x45xj\"" Nov 02 22:34:19.051335 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:19.051291 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"mpi-test-script\" (UniqueName: \"kubernetes.io/configmap/87e77d5a-d0c4-439c-983f-efbb4ddb9fc2-mpi-test-script\") pod \"test-mpi-trainjob-n6v44-launcher-0-0-k7gw6\" (UID: \"87e77d5a-d0c4-439c-983f-efbb4ddb9fc2\") " pod="test-ns-mt646/test-mpi-trainjob-n6v44-launcher-0-0-k7gw6" Nov 02 22:34:19.051541 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:19.051342 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8dwp\" (UniqueName: \"kubernetes.io/projected/87e77d5a-d0c4-439c-983f-efbb4ddb9fc2-kube-api-access-h8dwp\") pod \"test-mpi-trainjob-n6v44-launcher-0-0-k7gw6\" (UID: \"87e77d5a-d0c4-439c-983f-efbb4ddb9fc2\") " pod="test-ns-mt646/test-mpi-trainjob-n6v44-launcher-0-0-k7gw6" Nov 02 22:34:19.051541 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:19.051397 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"mpi-ssh-auth\" (UniqueName: \"kubernetes.io/secret/87e77d5a-d0c4-439c-983f-efbb4ddb9fc2-mpi-ssh-auth\") pod \"test-mpi-trainjob-n6v44-launcher-0-0-k7gw6\" (UID: \"87e77d5a-d0c4-439c-983f-efbb4ddb9fc2\") " pod="test-ns-mt646/test-mpi-trainjob-n6v44-launcher-0-0-k7gw6" Nov 02 22:34:19.051541 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:19.051422 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"mpi-hostfile\" (UniqueName: \"kubernetes.io/configmap/87e77d5a-d0c4-439c-983f-efbb4ddb9fc2-mpi-hostfile\") pod \"test-mpi-trainjob-n6v44-launcher-0-0-k7gw6\" (UID: \"87e77d5a-d0c4-439c-983f-efbb4ddb9fc2\") " pod="test-ns-mt646/test-mpi-trainjob-n6v44-launcher-0-0-k7gw6" Nov 02 22:34:19.052111 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:19.052087 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"mpi-hostfile\" (UniqueName: \"kubernetes.io/configmap/87e77d5a-d0c4-439c-983f-efbb4ddb9fc2-mpi-hostfile\") pod \"test-mpi-trainjob-n6v44-launcher-0-0-k7gw6\" (UID: \"87e77d5a-d0c4-439c-983f-efbb4ddb9fc2\") " pod="test-ns-mt646/test-mpi-trainjob-n6v44-launcher-0-0-k7gw6" Nov 02 22:34:19.052216 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:19.052094 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"mpi-test-script\" (UniqueName: \"kubernetes.io/configmap/87e77d5a-d0c4-439c-983f-efbb4ddb9fc2-mpi-test-script\") pod \"test-mpi-trainjob-n6v44-launcher-0-0-k7gw6\" (UID: \"87e77d5a-d0c4-439c-983f-efbb4ddb9fc2\") " pod="test-ns-mt646/test-mpi-trainjob-n6v44-launcher-0-0-k7gw6" Nov 02 22:34:19.054070 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:19.054049 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"mpi-ssh-auth\" (UniqueName: \"kubernetes.io/secret/87e77d5a-d0c4-439c-983f-efbb4ddb9fc2-mpi-ssh-auth\") pod \"test-mpi-trainjob-n6v44-launcher-0-0-k7gw6\" (UID: \"87e77d5a-d0c4-439c-983f-efbb4ddb9fc2\") " pod="test-ns-mt646/test-mpi-trainjob-n6v44-launcher-0-0-k7gw6" Nov 02 22:34:19.064528 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:19.064493 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8dwp\" (UniqueName: \"kubernetes.io/projected/87e77d5a-d0c4-439c-983f-efbb4ddb9fc2-kube-api-access-h8dwp\") pod \"test-mpi-trainjob-n6v44-launcher-0-0-k7gw6\" (UID: \"87e77d5a-d0c4-439c-983f-efbb4ddb9fc2\") " pod="test-ns-mt646/test-mpi-trainjob-n6v44-launcher-0-0-k7gw6" Nov 02 22:34:19.174450 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:19.174364 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-mt646/test-mpi-trainjob-n6v44-launcher-0-0-k7gw6" Nov 02 22:34:19.455040 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:19.454966 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-mt646/test-mpi-trainjob-n6v44-launcher-0-0-k7gw6"] Nov 02 22:34:19.458203 ip-10-0-139-99 kubenswrapper[5963]: W1102 22:34:19.458177 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod87e77d5a_d0c4_439c_983f_efbb4ddb9fc2.slice/crio-be28d76a0e128c030e6edd0b202d757c0ec6ca33d1a9746b1963fd1b6dccb94f WatchSource:0}: Error finding container be28d76a0e128c030e6edd0b202d757c0ec6ca33d1a9746b1963fd1b6dccb94f: Status 404 returned error can't find the container with id be28d76a0e128c030e6edd0b202d757c0ec6ca33d1a9746b1963fd1b6dccb94f Nov 02 22:34:20.100904 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:20.100865 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-mt646/test-mpi-trainjob-n6v44-launcher-0-0-k7gw6" event={"ID":"87e77d5a-d0c4-439c-983f-efbb4ddb9fc2","Type":"ContainerStarted","Data":"bd14386aa49a1075ceddc61f9a73eebb105c59577c184a8264ea44149c81c82a"} Nov 02 22:34:20.101357 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:20.100924 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-mt646/test-mpi-trainjob-n6v44-launcher-0-0-k7gw6" event={"ID":"87e77d5a-d0c4-439c-983f-efbb4ddb9fc2","Type":"ContainerStarted","Data":"be28d76a0e128c030e6edd0b202d757c0ec6ca33d1a9746b1963fd1b6dccb94f"} Nov 02 22:34:20.122768 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:20.122709 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-mt646/test-mpi-trainjob-n6v44-launcher-0-0-k7gw6" podStartSLOduration=2.122695741 podStartE2EDuration="2.122695741s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:34:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:34:20.12212511 +0000 UTC m=+2432.374123588" watchObservedRunningTime="2026-11-02 22:34:20.122695741 +0000 UTC m=+2432.374694208" Nov 02 22:34:20.228427 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:20.228398 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-mt646_test-mpi-trainjob-n6v44-launcher-0-0-k7gw6_87e77d5a-d0c4-439c-983f-efbb4ddb9fc2/node/0.log" Nov 02 22:34:23.228394 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:23.228367 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-mt646_test-mpi-trainjob-n6v44-launcher-0-0-k7gw6_87e77d5a-d0c4-439c-983f-efbb4ddb9fc2/node/0.log" Nov 02 22:34:26.228535 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:26.228498 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-mt646_test-mpi-trainjob-n6v44-launcher-0-0-k7gw6_87e77d5a-d0c4-439c-983f-efbb4ddb9fc2/node/0.log" Nov 02 22:34:28.138230 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:28.138197 5963 generic.go:356] "Generic (PLEG): container finished" podID="87e77d5a-d0c4-439c-983f-efbb4ddb9fc2" containerID="bd14386aa49a1075ceddc61f9a73eebb105c59577c184a8264ea44149c81c82a" exitCode=0 Nov 02 22:34:28.138624 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:28.138271 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-mt646/test-mpi-trainjob-n6v44-launcher-0-0-k7gw6" event={"ID":"87e77d5a-d0c4-439c-983f-efbb4ddb9fc2","Type":"ContainerDied","Data":"bd14386aa49a1075ceddc61f9a73eebb105c59577c184a8264ea44149c81c82a"} Nov 02 22:34:29.122924 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:34:29.122892 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:34:29.229512 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:29.229479 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-mt646_test-mpi-trainjob-n6v44-launcher-0-0-k7gw6_87e77d5a-d0c4-439c-983f-efbb4ddb9fc2/node/0.log" Nov 02 22:34:29.283037 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:29.283009 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-mt646/test-mpi-trainjob-n6v44-launcher-0-0-k7gw6" Nov 02 22:34:29.342105 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:29.342071 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/87e77d5a-d0c4-439c-983f-efbb4ddb9fc2-kube-api-access-h8dwp\" (UniqueName: \"kubernetes.io/projected/87e77d5a-d0c4-439c-983f-efbb4ddb9fc2-kube-api-access-h8dwp\") pod \"87e77d5a-d0c4-439c-983f-efbb4ddb9fc2\" (UID: \"87e77d5a-d0c4-439c-983f-efbb4ddb9fc2\") " Nov 02 22:34:29.342273 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:29.342115 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/87e77d5a-d0c4-439c-983f-efbb4ddb9fc2-mpi-ssh-auth\" (UniqueName: \"kubernetes.io/secret/87e77d5a-d0c4-439c-983f-efbb4ddb9fc2-mpi-ssh-auth\") pod \"87e77d5a-d0c4-439c-983f-efbb4ddb9fc2\" (UID: \"87e77d5a-d0c4-439c-983f-efbb4ddb9fc2\") " Nov 02 22:34:29.342273 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:29.342165 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/87e77d5a-d0c4-439c-983f-efbb4ddb9fc2-mpi-test-script\" (UniqueName: \"kubernetes.io/configmap/87e77d5a-d0c4-439c-983f-efbb4ddb9fc2-mpi-test-script\") pod \"87e77d5a-d0c4-439c-983f-efbb4ddb9fc2\" (UID: \"87e77d5a-d0c4-439c-983f-efbb4ddb9fc2\") " Nov 02 22:34:29.342273 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:29.342208 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/87e77d5a-d0c4-439c-983f-efbb4ddb9fc2-mpi-hostfile\" (UniqueName: \"kubernetes.io/configmap/87e77d5a-d0c4-439c-983f-efbb4ddb9fc2-mpi-hostfile\") pod \"87e77d5a-d0c4-439c-983f-efbb4ddb9fc2\" (UID: \"87e77d5a-d0c4-439c-983f-efbb4ddb9fc2\") " Nov 02 22:34:29.342646 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:29.342618 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87e77d5a-d0c4-439c-983f-efbb4ddb9fc2-mpi-test-script" pod "87e77d5a-d0c4-439c-983f-efbb4ddb9fc2" (UID: "87e77d5a-d0c4-439c-983f-efbb4ddb9fc2"). InnerVolumeSpecName "mpi-test-script". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 22:34:29.342788 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:29.342642 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87e77d5a-d0c4-439c-983f-efbb4ddb9fc2-mpi-hostfile" pod "87e77d5a-d0c4-439c-983f-efbb4ddb9fc2" (UID: "87e77d5a-d0c4-439c-983f-efbb4ddb9fc2"). InnerVolumeSpecName "mpi-hostfile". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 22:34:29.344597 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:29.344576 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87e77d5a-d0c4-439c-983f-efbb4ddb9fc2-kube-api-access-h8dwp" pod "87e77d5a-d0c4-439c-983f-efbb4ddb9fc2" (UID: "87e77d5a-d0c4-439c-983f-efbb4ddb9fc2"). InnerVolumeSpecName "kube-api-access-h8dwp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 22:34:29.344683 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:29.344604 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87e77d5a-d0c4-439c-983f-efbb4ddb9fc2-mpi-ssh-auth" pod "87e77d5a-d0c4-439c-983f-efbb4ddb9fc2" (UID: "87e77d5a-d0c4-439c-983f-efbb4ddb9fc2"). InnerVolumeSpecName "mpi-ssh-auth". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 22:34:29.443617 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:29.443511 5963 reconciler_common.go:299] "Volume detached for volume \"mpi-test-script\" (UniqueName: \"kubernetes.io/configmap/87e77d5a-d0c4-439c-983f-efbb4ddb9fc2-mpi-test-script\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:34:29.443617 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:29.443551 5963 reconciler_common.go:299] "Volume detached for volume \"mpi-hostfile\" (UniqueName: \"kubernetes.io/configmap/87e77d5a-d0c4-439c-983f-efbb4ddb9fc2-mpi-hostfile\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:34:29.443617 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:29.443564 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8dwp\" (UniqueName: \"kubernetes.io/projected/87e77d5a-d0c4-439c-983f-efbb4ddb9fc2-kube-api-access-h8dwp\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:34:29.443617 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:29.443576 5963 reconciler_common.go:299] "Volume detached for volume \"mpi-ssh-auth\" (UniqueName: \"kubernetes.io/secret/87e77d5a-d0c4-439c-983f-efbb4ddb9fc2-mpi-ssh-auth\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:34:30.148248 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:30.148171 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-mt646/test-mpi-trainjob-n6v44-launcher-0-0-k7gw6" Nov 02 22:34:30.148248 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:30.148208 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-mt646/test-mpi-trainjob-n6v44-launcher-0-0-k7gw6" event={"ID":"87e77d5a-d0c4-439c-983f-efbb4ddb9fc2","Type":"ContainerDied","Data":"be28d76a0e128c030e6edd0b202d757c0ec6ca33d1a9746b1963fd1b6dccb94f"} Nov 02 22:34:30.148438 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:30.148254 5963 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be28d76a0e128c030e6edd0b202d757c0ec6ca33d1a9746b1963fd1b6dccb94f" Nov 02 22:34:30.393089 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:30.393062 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-tvsb4/dw-deployment-9grqw-77bdcccd94-r6sb7" Nov 02 22:34:30.452502 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:30.452414 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/nfs/73dfec5c-99b7-496e-8877-6ae3d15eb933-pvc-23cbc96a-2b0b-4eed-84f1-c5895c6effa6\" (UniqueName: \"kubernetes.io/nfs/73dfec5c-99b7-496e-8877-6ae3d15eb933-pvc-23cbc96a-2b0b-4eed-84f1-c5895c6effa6\") pod \"73dfec5c-99b7-496e-8877-6ae3d15eb933\" (UID: \"73dfec5c-99b7-496e-8877-6ae3d15eb933\") " Nov 02 22:34:30.452502 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:30.452489 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/73dfec5c-99b7-496e-8877-6ae3d15eb933-kube-api-access-rhgkw\" (UniqueName: \"kubernetes.io/projected/73dfec5c-99b7-496e-8877-6ae3d15eb933-kube-api-access-rhgkw\") pod \"73dfec5c-99b7-496e-8877-6ae3d15eb933\" (UID: \"73dfec5c-99b7-496e-8877-6ae3d15eb933\") " Nov 02 22:34:30.452734 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:30.452564 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/73dfec5c-99b7-496e-8877-6ae3d15eb933-notebook-config\" (UniqueName: \"kubernetes.io/configmap/73dfec5c-99b7-496e-8877-6ae3d15eb933-notebook-config\") pod \"73dfec5c-99b7-496e-8877-6ae3d15eb933\" (UID: \"73dfec5c-99b7-496e-8877-6ae3d15eb933\") " Nov 02 22:34:30.452971 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:30.452933 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73dfec5c-99b7-496e-8877-6ae3d15eb933-notebook-config" pod "73dfec5c-99b7-496e-8877-6ae3d15eb933" (UID: "73dfec5c-99b7-496e-8877-6ae3d15eb933"). InnerVolumeSpecName "notebook-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 22:34:30.454844 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:30.454820 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73dfec5c-99b7-496e-8877-6ae3d15eb933-kube-api-access-rhgkw" pod "73dfec5c-99b7-496e-8877-6ae3d15eb933" (UID: "73dfec5c-99b7-496e-8877-6ae3d15eb933"). InnerVolumeSpecName "kube-api-access-rhgkw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 22:34:30.483446 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:30.483416 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/nfs/73dfec5c-99b7-496e-8877-6ae3d15eb933-pvc-23cbc96a-2b0b-4eed-84f1-c5895c6effa6" pod "73dfec5c-99b7-496e-8877-6ae3d15eb933" (UID: "73dfec5c-99b7-496e-8877-6ae3d15eb933"). InnerVolumeSpecName "pvc-23cbc96a-2b0b-4eed-84f1-c5895c6effa6". PluginName "kubernetes.io/nfs", VolumeGIDValue "" Nov 02 22:34:30.554046 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:30.554014 5963 reconciler_common.go:299] "Volume detached for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/73dfec5c-99b7-496e-8877-6ae3d15eb933-notebook-config\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:34:30.554046 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:30.554042 5963 reconciler_common.go:299] "Volume detached for volume \"pvc-23cbc96a-2b0b-4eed-84f1-c5895c6effa6\" (UniqueName: \"kubernetes.io/nfs/73dfec5c-99b7-496e-8877-6ae3d15eb933-pvc-23cbc96a-2b0b-4eed-84f1-c5895c6effa6\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:34:30.554046 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:30.554052 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhgkw\" (UniqueName: \"kubernetes.io/projected/73dfec5c-99b7-496e-8877-6ae3d15eb933-kube-api-access-rhgkw\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:34:30.832026 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:30.831997 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-mt646_test-mpi-trainjob-n6v44-launcher-0-0-k7gw6_87e77d5a-d0c4-439c-983f-efbb4ddb9fc2/node/0.log" Nov 02 22:34:30.896705 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:30.896651 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-mt646_test-mpi-trainjob-n6v44-launcher-0-0-k7gw6_87e77d5a-d0c4-439c-983f-efbb4ddb9fc2/node/0.log" Nov 02 22:34:31.005322 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:31.005290 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:31.153614 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:31.153524 5963 generic.go:356] "Generic (PLEG): container finished" podID="73dfec5c-99b7-496e-8877-6ae3d15eb933" containerID="ae7552484039a04932139910e59939fab3c48d8deb188e4df6c90c56d9ed735b" exitCode=137 Nov 02 22:34:31.153614 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:31.153577 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-tvsb4/dw-deployment-9grqw-77bdcccd94-r6sb7" Nov 02 22:34:31.153826 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:31.153613 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-tvsb4/dw-deployment-9grqw-77bdcccd94-r6sb7" event={"ID":"73dfec5c-99b7-496e-8877-6ae3d15eb933","Type":"ContainerDied","Data":"ae7552484039a04932139910e59939fab3c48d8deb188e4df6c90c56d9ed735b"} Nov 02 22:34:31.153826 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:31.153694 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-tvsb4/dw-deployment-9grqw-77bdcccd94-r6sb7" event={"ID":"73dfec5c-99b7-496e-8877-6ae3d15eb933","Type":"ContainerDied","Data":"2bd5d76ed71c95517ea94d954c8027378da21a83d04f6892561a521a6e4b6c0b"} Nov 02 22:34:31.153826 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:31.153723 5963 scope.go:122] "RemoveContainer" containerID="ae7552484039a04932139910e59939fab3c48d8deb188e4df6c90c56d9ed735b" Nov 02 22:34:31.176877 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:31.176844 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-tvsb4/dw-deployment-9grqw-77bdcccd94-r6sb7"] Nov 02 22:34:31.177829 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:31.177797 5963 scope.go:122] "RemoveContainer" containerID="ae7552484039a04932139910e59939fab3c48d8deb188e4df6c90c56d9ed735b" Nov 02 22:34:31.178312 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:34:31.178279 5963 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae7552484039a04932139910e59939fab3c48d8deb188e4df6c90c56d9ed735b\": container with ID starting with ae7552484039a04932139910e59939fab3c48d8deb188e4df6c90c56d9ed735b not found: ID does not exist" containerID="ae7552484039a04932139910e59939fab3c48d8deb188e4df6c90c56d9ed735b" Nov 02 22:34:31.178406 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:31.178321 5963 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae7552484039a04932139910e59939fab3c48d8deb188e4df6c90c56d9ed735b"} err="failed to get container status \"ae7552484039a04932139910e59939fab3c48d8deb188e4df6c90c56d9ed735b\": rpc error: code = NotFound desc = could not find container \"ae7552484039a04932139910e59939fab3c48d8deb188e4df6c90c56d9ed735b\": container with ID starting with ae7552484039a04932139910e59939fab3c48d8deb188e4df6c90c56d9ed735b not found: ID does not exist" Nov 02 22:34:31.181276 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:31.181256 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-tvsb4/dw-deployment-9grqw-77bdcccd94-r6sb7"] Nov 02 22:34:31.472653 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:31.472557 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:31.863778 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:31.863744 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="73dfec5c-99b7-496e-8877-6ae3d15eb933" path="/var/lib/kubelet/pods/73dfec5c-99b7-496e-8877-6ae3d15eb933/volumes" Nov 02 22:34:34.170818 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:34.170788 5963 generic.go:356] "Generic (PLEG): container finished" podID="b406cc6a-c351-41b3-a07e-6c9d86e0e848" containerID="b2ee4626379a5a6945ce8f22e68af82925ec7f8407b4a3788bfd9c4b8175d141" exitCode=137 Nov 02 22:34:34.171228 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:34.170862 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-ql46v/test-preemption-trainjob-8vqfg-node-0-0-d2qdh" event={"ID":"b406cc6a-c351-41b3-a07e-6c9d86e0e848","Type":"ContainerDied","Data":"b2ee4626379a5a6945ce8f22e68af82925ec7f8407b4a3788bfd9c4b8175d141"} Nov 02 22:34:34.219559 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:34.219530 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-ql46v/test-preemption-trainjob-8vqfg-node-0-0-d2qdh" Nov 02 22:34:34.285575 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:34.285497 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b406cc6a-c351-41b3-a07e-6c9d86e0e848-kube-api-access-wn8f9\" (UniqueName: \"kubernetes.io/projected/b406cc6a-c351-41b3-a07e-6c9d86e0e848-kube-api-access-wn8f9\") pod \"b406cc6a-c351-41b3-a07e-6c9d86e0e848\" (UID: \"b406cc6a-c351-41b3-a07e-6c9d86e0e848\") " Nov 02 22:34:34.287864 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:34.287835 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b406cc6a-c351-41b3-a07e-6c9d86e0e848-kube-api-access-wn8f9" pod "b406cc6a-c351-41b3-a07e-6c9d86e0e848" (UID: "b406cc6a-c351-41b3-a07e-6c9d86e0e848"). InnerVolumeSpecName "kube-api-access-wn8f9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 22:34:34.349627 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:34.349589 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:34.386233 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:34.386203 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wn8f9\" (UniqueName: \"kubernetes.io/projected/b406cc6a-c351-41b3-a07e-6c9d86e0e848-kube-api-access-wn8f9\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:34:34.462883 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:34.462850 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:34.568193 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:34.568162 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:34.664035 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:34.663996 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:35.176638 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:35.176609 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-ql46v/test-preemption-trainjob-8vqfg-node-0-0-d2qdh" Nov 02 22:34:35.177143 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:35.176613 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-ql46v/test-preemption-trainjob-8vqfg-node-0-0-d2qdh" event={"ID":"b406cc6a-c351-41b3-a07e-6c9d86e0e848","Type":"ContainerDied","Data":"055054cbee5f44d22709fec649723c2677560ebe5f464ab86df217f46f27dc30"} Nov 02 22:34:35.177143 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:35.176724 5963 scope.go:122] "RemoveContainer" containerID="b2ee4626379a5a6945ce8f22e68af82925ec7f8407b4a3788bfd9c4b8175d141" Nov 02 22:34:35.198314 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:35.198282 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-ql46v/test-preemption-trainjob-8vqfg-node-0-0-d2qdh"] Nov 02 22:34:35.203364 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:35.203342 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-ql46v/test-preemption-trainjob-8vqfg-node-0-0-d2qdh"] Nov 02 22:34:35.863905 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:35.863865 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b406cc6a-c351-41b3-a07e-6c9d86e0e848" path="/var/lib/kubelet/pods/b406cc6a-c351-41b3-a07e-6c9d86e0e848/volumes" Nov 02 22:34:35.951155 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:35.951125 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-mt646/test-mpi-trainjob-n6v44-launcher-0-0-k7gw6"] Nov 02 22:34:35.955512 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:35.955488 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-mt646/test-mpi-trainjob-n6v44-launcher-0-0-k7gw6"] Nov 02 22:34:36.177785 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:36.177690 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:36.623168 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:36.623135 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:36.725912 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:36.725884 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:36.825822 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:36.825786 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:37.512723 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:37.512683 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-p5kvc/test-trainjob-fail-zrt8c-dataset-initializer-0-0-5j225"] Nov 02 22:34:37.513221 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:37.513156 5963 cpu_manager.go:414] "containerMap: removing container" podUID="73dfec5c-99b7-496e-8877-6ae3d15eb933" containerName="notebook" Nov 02 22:34:37.513221 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:37.513174 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="73dfec5c-99b7-496e-8877-6ae3d15eb933" containerName="notebook" Nov 02 22:34:37.513221 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:37.513189 5963 cpu_manager.go:414] "containerMap: removing container" podUID="87e77d5a-d0c4-439c-983f-efbb4ddb9fc2" containerName="node" Nov 02 22:34:37.513221 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:37.513196 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="87e77d5a-d0c4-439c-983f-efbb4ddb9fc2" containerName="node" Nov 02 22:34:37.513438 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:37.513225 5963 cpu_manager.go:414] "containerMap: removing container" podUID="b406cc6a-c351-41b3-a07e-6c9d86e0e848" containerName="node" Nov 02 22:34:37.513438 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:37.513232 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b406cc6a-c351-41b3-a07e-6c9d86e0e848" containerName="node" Nov 02 22:34:37.513438 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:37.513320 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="87e77d5a-d0c4-439c-983f-efbb4ddb9fc2" containerName="node" Nov 02 22:34:37.513438 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:37.513334 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="b406cc6a-c351-41b3-a07e-6c9d86e0e848" containerName="node" Nov 02 22:34:37.513438 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:37.513348 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="73dfec5c-99b7-496e-8877-6ae3d15eb933" containerName="notebook" Nov 02 22:34:37.517789 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:37.517767 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-p5kvc/test-trainjob-fail-zrt8c-dataset-initializer-0-0-5j225" Nov 02 22:34:37.522852 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:37.522833 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-p5kvc\"/\"kube-root-ca.crt\"" Nov 02 22:34:37.523134 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:37.523116 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-p5kvc\"/\"default-dockercfg-8f2pw\"" Nov 02 22:34:37.523197 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:37.523138 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-p5kvc\"/\"openshift-service-ca.crt\"" Nov 02 22:34:37.528296 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:37.528273 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-p5kvc/test-trainjob-fail-zrt8c-dataset-initializer-0-0-5j225"] Nov 02 22:34:37.615625 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:37.615586 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh5jb\" (UniqueName: \"kubernetes.io/projected/714d025d-45d0-4182-9920-b34e1ad02529-kube-api-access-kh5jb\") pod \"test-trainjob-fail-zrt8c-dataset-initializer-0-0-5j225\" (UID: \"714d025d-45d0-4182-9920-b34e1ad02529\") " pod="test-ns-p5kvc/test-trainjob-fail-zrt8c-dataset-initializer-0-0-5j225" Nov 02 22:34:37.672254 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:37.672213 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:37.716528 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:37.716491 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh5jb\" (UniqueName: \"kubernetes.io/projected/714d025d-45d0-4182-9920-b34e1ad02529-kube-api-access-kh5jb\") pod \"test-trainjob-fail-zrt8c-dataset-initializer-0-0-5j225\" (UID: \"714d025d-45d0-4182-9920-b34e1ad02529\") " pod="test-ns-p5kvc/test-trainjob-fail-zrt8c-dataset-initializer-0-0-5j225" Nov 02 22:34:37.729951 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:37.729920 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh5jb\" (UniqueName: \"kubernetes.io/projected/714d025d-45d0-4182-9920-b34e1ad02529-kube-api-access-kh5jb\") pod \"test-trainjob-fail-zrt8c-dataset-initializer-0-0-5j225\" (UID: \"714d025d-45d0-4182-9920-b34e1ad02529\") " pod="test-ns-p5kvc/test-trainjob-fail-zrt8c-dataset-initializer-0-0-5j225" Nov 02 22:34:37.863441 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:37.863403 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="87e77d5a-d0c4-439c-983f-efbb4ddb9fc2" path="/var/lib/kubelet/pods/87e77d5a-d0c4-439c-983f-efbb4ddb9fc2/volumes" Nov 02 22:34:41.248545 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:41.248504 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-8436cf1c-ef2f-4161-94a4-8cb2886e3f2a\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-00eb48c4f3008659a\") pod \"test-trainjob-fail-zrt8c-dataset-initializer-0-0-5j225\" (UID: \"714d025d-45d0-4182-9920-b34e1ad02529\") " pod="test-ns-p5kvc/test-trainjob-fail-zrt8c-dataset-initializer-0-0-5j225" Nov 02 22:34:41.255703 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:41.255654 5963 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-8436cf1c-ef2f-4161-94a4-8cb2886e3f2a\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-00eb48c4f3008659a\") pod \"test-trainjob-fail-zrt8c-dataset-initializer-0-0-5j225\" (UID: \"714d025d-45d0-4182-9920-b34e1ad02529\") device path: \"\"" pod="test-ns-p5kvc/test-trainjob-fail-zrt8c-dataset-initializer-0-0-5j225" Nov 02 22:34:41.349968 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:41.349929 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-8436cf1c-ef2f-4161-94a4-8cb2886e3f2a\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-00eb48c4f3008659a\") pod \"test-trainjob-fail-zrt8c-dataset-initializer-0-0-5j225\" (UID: \"714d025d-45d0-4182-9920-b34e1ad02529\") " pod="test-ns-p5kvc/test-trainjob-fail-zrt8c-dataset-initializer-0-0-5j225" Nov 02 22:34:41.350157 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:41.350050 5963 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-8436cf1c-ef2f-4161-94a4-8cb2886e3f2a\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-00eb48c4f3008659a\") pod \"test-trainjob-fail-zrt8c-dataset-initializer-0-0-5j225\" (UID: \"714d025d-45d0-4182-9920-b34e1ad02529\") DevicePath \"\"" pod="test-ns-p5kvc/test-trainjob-fail-zrt8c-dataset-initializer-0-0-5j225" Nov 02 22:34:41.353849 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:41.353815 5963 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-8436cf1c-ef2f-4161-94a4-8cb2886e3f2a\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-00eb48c4f3008659a\") pod \"test-trainjob-fail-zrt8c-dataset-initializer-0-0-5j225\" (UID: \"714d025d-45d0-4182-9920-b34e1ad02529\") DevicePath \"csi-5a0770a765d663c74157cff89a7da8b4a410e25c5fc7e5392939f1411fbc8983\"" pod="test-ns-p5kvc/test-trainjob-fail-zrt8c-dataset-initializer-0-0-5j225" Nov 02 22:34:41.520425 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:41.520350 5963 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-8436cf1c-ef2f-4161-94a4-8cb2886e3f2a\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-00eb48c4f3008659a\") pod \"test-trainjob-fail-zrt8c-dataset-initializer-0-0-5j225\" (UID: \"714d025d-45d0-4182-9920-b34e1ad02529\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/25ba6a7cfffa6b4e191421dec435147325cf6e80f3930fe431a678ad78253b80/globalmount\"" pod="test-ns-p5kvc/test-trainjob-fail-zrt8c-dataset-initializer-0-0-5j225" Nov 02 22:34:41.534158 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:41.534131 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-8436cf1c-ef2f-4161-94a4-8cb2886e3f2a\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-00eb48c4f3008659a\") pod \"test-trainjob-fail-zrt8c-dataset-initializer-0-0-5j225\" (UID: \"714d025d-45d0-4182-9920-b34e1ad02529\") " pod="test-ns-p5kvc/test-trainjob-fail-zrt8c-dataset-initializer-0-0-5j225" Nov 02 22:34:41.731316 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:41.731280 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-p5kvc/test-trainjob-fail-zrt8c-dataset-initializer-0-0-5j225" Nov 02 22:34:42.009274 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:42.009240 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-p5kvc/test-trainjob-fail-zrt8c-dataset-initializer-0-0-5j225"] Nov 02 22:34:42.012607 ip-10-0-139-99 kubenswrapper[5963]: W1102 22:34:42.012576 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod714d025d_45d0_4182_9920_b34e1ad02529.slice/crio-d9ea92632ff9583d606480ed65ba1b82b021e5521ba70082987bb7e52a3213e0 WatchSource:0}: Error finding container d9ea92632ff9583d606480ed65ba1b82b021e5521ba70082987bb7e52a3213e0: Status 404 returned error can't find the container with id d9ea92632ff9583d606480ed65ba1b82b021e5521ba70082987bb7e52a3213e0 Nov 02 22:34:42.210011 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:42.209975 5963 generic.go:356] "Generic (PLEG): container finished" podID="714d025d-45d0-4182-9920-b34e1ad02529" containerID="26e8888a67fefd93110e160e6e431b362c215285a3bc6452b75d877d80ba89f6" exitCode=1 Nov 02 22:34:42.210177 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:42.210018 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-p5kvc/test-trainjob-fail-zrt8c-dataset-initializer-0-0-5j225" event={"ID":"714d025d-45d0-4182-9920-b34e1ad02529","Type":"ContainerDied","Data":"26e8888a67fefd93110e160e6e431b362c215285a3bc6452b75d877d80ba89f6"} Nov 02 22:34:42.210177 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:42.210086 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-p5kvc/test-trainjob-fail-zrt8c-dataset-initializer-0-0-5j225" event={"ID":"714d025d-45d0-4182-9920-b34e1ad02529","Type":"ContainerStarted","Data":"d9ea92632ff9583d606480ed65ba1b82b021e5521ba70082987bb7e52a3213e0"} Nov 02 22:34:43.112377 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:43.112339 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:43.212231 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:43.212185 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:43.309281 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:43.309253 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-p5kvc_test-trainjob-fail-zrt8c-dataset-initializer-0-0-5j225_714d025d-45d0-4182-9920-b34e1ad02529/dataset-initializer/0.log" Nov 02 22:34:43.353561 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:43.353537 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-p5kvc/test-trainjob-fail-zrt8c-dataset-initializer-0-0-5j225" Nov 02 22:34:43.379141 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:43.379041 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:43.467269 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:43.467225 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/714d025d-45d0-4182-9920-b34e1ad02529-kube-api-access-kh5jb\" (UniqueName: \"kubernetes.io/projected/714d025d-45d0-4182-9920-b34e1ad02529-kube-api-access-kh5jb\") pod \"714d025d-45d0-4182-9920-b34e1ad02529\" (UID: \"714d025d-45d0-4182-9920-b34e1ad02529\") " Nov 02 22:34:43.467453 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:43.467385 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-00eb48c4f3008659a\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-00eb48c4f3008659a\") pod \"714d025d-45d0-4182-9920-b34e1ad02529\" (UID: \"714d025d-45d0-4182-9920-b34e1ad02529\") " Nov 02 22:34:43.469871 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:43.469845 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/714d025d-45d0-4182-9920-b34e1ad02529-kube-api-access-kh5jb" pod "714d025d-45d0-4182-9920-b34e1ad02529" (UID: "714d025d-45d0-4182-9920-b34e1ad02529"). InnerVolumeSpecName "kube-api-access-kh5jb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 22:34:43.470411 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:43.470390 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-00eb48c4f3008659a" pod "714d025d-45d0-4182-9920-b34e1ad02529" (UID: "714d025d-45d0-4182-9920-b34e1ad02529"). InnerVolumeSpecName "pvc-8436cf1c-ef2f-4161-94a4-8cb2886e3f2a". PluginName "kubernetes.io/csi", VolumeGIDValue "" Nov 02 22:34:43.568580 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:43.568549 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kh5jb\" (UniqueName: \"kubernetes.io/projected/714d025d-45d0-4182-9920-b34e1ad02529-kube-api-access-kh5jb\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:34:43.568780 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:43.568596 5963 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-8436cf1c-ef2f-4161-94a4-8cb2886e3f2a\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-00eb48c4f3008659a\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" " Nov 02 22:34:43.584125 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:43.584105 5963 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-8436cf1c-ef2f-4161-94a4-8cb2886e3f2a" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-00eb48c4f3008659a") on node "ip-10-0-139-99.us-east-2.compute.internal" Nov 02 22:34:43.669993 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:43.669901 5963 reconciler_common.go:299] "Volume detached for volume \"pvc-8436cf1c-ef2f-4161-94a4-8cb2886e3f2a\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-00eb48c4f3008659a\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"csi-5a0770a765d663c74157cff89a7da8b4a410e25c5fc7e5392939f1411fbc8983\"" Nov 02 22:34:44.221090 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:44.221052 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-p5kvc/test-trainjob-fail-zrt8c-dataset-initializer-0-0-5j225" event={"ID":"714d025d-45d0-4182-9920-b34e1ad02529","Type":"ContainerDied","Data":"d9ea92632ff9583d606480ed65ba1b82b021e5521ba70082987bb7e52a3213e0"} Nov 02 22:34:44.221506 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:44.221112 5963 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d9ea92632ff9583d606480ed65ba1b82b021e5521ba70082987bb7e52a3213e0" Nov 02 22:34:44.221506 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:44.221064 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-p5kvc/test-trainjob-fail-zrt8c-dataset-initializer-0-0-5j225" Nov 02 22:34:44.668181 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:44.668142 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-p5kvc_test-trainjob-fail-zrt8c-dataset-initializer-0-0-5j225_714d025d-45d0-4182-9920-b34e1ad02529/dataset-initializer/0.log" Nov 02 22:34:44.841856 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:44.841824 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:44.964270 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:44.964189 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:45.061868 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:45.061811 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-dxg5x/dw-deployment-gdgvg-857459d55d-l8wxk"] Nov 02 22:34:45.062174 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:45.062158 5963 cpu_manager.go:414] "containerMap: removing container" podUID="714d025d-45d0-4182-9920-b34e1ad02529" containerName="dataset-initializer" Nov 02 22:34:45.062222 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:45.062176 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="714d025d-45d0-4182-9920-b34e1ad02529" containerName="dataset-initializer" Nov 02 22:34:45.062269 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:45.062260 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="714d025d-45d0-4182-9920-b34e1ad02529" containerName="dataset-initializer" Nov 02 22:34:45.065370 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:45.065355 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-dxg5x/dw-deployment-gdgvg-857459d55d-l8wxk" Nov 02 22:34:45.068601 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:45.068573 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:45.071944 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:45.071922 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-dxg5x\"/\"config-pn2v5\"" Nov 02 22:34:45.074612 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:45.074594 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-dxg5x\"/\"kube-root-ca.crt\"" Nov 02 22:34:45.074612 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:45.074605 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-dxg5x\"/\"openshift-service-ca.crt\"" Nov 02 22:34:45.074817 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:45.074802 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-dxg5x\"/\"default-dockercfg-nn892\"" Nov 02 22:34:45.081019 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:45.080998 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-dxg5x/dw-deployment-gdgvg-857459d55d-l8wxk"] Nov 02 22:34:45.185468 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:45.185431 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/d7f03830-b97f-414a-8183-7f4117affc9d-notebook-config\") pod \"dw-deployment-gdgvg-857459d55d-l8wxk\" (UID: \"d7f03830-b97f-414a-8183-7f4117affc9d\") " pod="test-ns-dxg5x/dw-deployment-gdgvg-857459d55d-l8wxk" Nov 02 22:34:45.185655 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:45.185473 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-f1fc51d9-3e19-4696-956e-da7d35221d18\" (UniqueName: \"kubernetes.io/nfs/d7f03830-b97f-414a-8183-7f4117affc9d-pvc-f1fc51d9-3e19-4696-956e-da7d35221d18\") pod \"dw-deployment-gdgvg-857459d55d-l8wxk\" (UID: \"d7f03830-b97f-414a-8183-7f4117affc9d\") " pod="test-ns-dxg5x/dw-deployment-gdgvg-857459d55d-l8wxk" Nov 02 22:34:45.185655 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:45.185556 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp28c\" (UniqueName: \"kubernetes.io/projected/d7f03830-b97f-414a-8183-7f4117affc9d-kube-api-access-gp28c\") pod \"dw-deployment-gdgvg-857459d55d-l8wxk\" (UID: \"d7f03830-b97f-414a-8183-7f4117affc9d\") " pod="test-ns-dxg5x/dw-deployment-gdgvg-857459d55d-l8wxk" Nov 02 22:34:45.219643 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:45.219565 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:45.286421 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:45.286387 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/d7f03830-b97f-414a-8183-7f4117affc9d-notebook-config\") pod \"dw-deployment-gdgvg-857459d55d-l8wxk\" (UID: \"d7f03830-b97f-414a-8183-7f4117affc9d\") " pod="test-ns-dxg5x/dw-deployment-gdgvg-857459d55d-l8wxk" Nov 02 22:34:45.286916 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:45.286427 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-f1fc51d9-3e19-4696-956e-da7d35221d18\" (UniqueName: \"kubernetes.io/nfs/d7f03830-b97f-414a-8183-7f4117affc9d-pvc-f1fc51d9-3e19-4696-956e-da7d35221d18\") pod \"dw-deployment-gdgvg-857459d55d-l8wxk\" (UID: \"d7f03830-b97f-414a-8183-7f4117affc9d\") " pod="test-ns-dxg5x/dw-deployment-gdgvg-857459d55d-l8wxk" Nov 02 22:34:45.286916 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:45.286558 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp28c\" (UniqueName: \"kubernetes.io/projected/d7f03830-b97f-414a-8183-7f4117affc9d-kube-api-access-gp28c\") pod \"dw-deployment-gdgvg-857459d55d-l8wxk\" (UID: \"d7f03830-b97f-414a-8183-7f4117affc9d\") " pod="test-ns-dxg5x/dw-deployment-gdgvg-857459d55d-l8wxk" Nov 02 22:34:45.287235 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:45.287214 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/d7f03830-b97f-414a-8183-7f4117affc9d-notebook-config\") pod \"dw-deployment-gdgvg-857459d55d-l8wxk\" (UID: \"d7f03830-b97f-414a-8183-7f4117affc9d\") " pod="test-ns-dxg5x/dw-deployment-gdgvg-857459d55d-l8wxk" Nov 02 22:34:45.299587 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:45.299561 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp28c\" (UniqueName: \"kubernetes.io/projected/d7f03830-b97f-414a-8183-7f4117affc9d-kube-api-access-gp28c\") pod \"dw-deployment-gdgvg-857459d55d-l8wxk\" (UID: \"d7f03830-b97f-414a-8183-7f4117affc9d\") " pod="test-ns-dxg5x/dw-deployment-gdgvg-857459d55d-l8wxk" Nov 02 22:34:45.310588 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:45.310563 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-f1fc51d9-3e19-4696-956e-da7d35221d18\" (UniqueName: \"kubernetes.io/nfs/d7f03830-b97f-414a-8183-7f4117affc9d-pvc-f1fc51d9-3e19-4696-956e-da7d35221d18\") pod \"dw-deployment-gdgvg-857459d55d-l8wxk\" (UID: \"d7f03830-b97f-414a-8183-7f4117affc9d\") " pod="test-ns-dxg5x/dw-deployment-gdgvg-857459d55d-l8wxk" Nov 02 22:34:45.378721 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:45.378656 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-dxg5x/dw-deployment-gdgvg-857459d55d-l8wxk" Nov 02 22:34:45.656551 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:45.656520 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-dxg5x/dw-deployment-gdgvg-857459d55d-l8wxk"] Nov 02 22:34:45.659709 ip-10-0-139-99 kubenswrapper[5963]: W1102 22:34:45.659657 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7f03830_b97f_414a_8183_7f4117affc9d.slice/crio-796e6e0f1b3e7efecbfa37d192b0f70735f6a80e7f1e8d69ed5fa6db9ff2ff34 WatchSource:0}: Error finding container 796e6e0f1b3e7efecbfa37d192b0f70735f6a80e7f1e8d69ed5fa6db9ff2ff34: Status 404 returned error can't find the container with id 796e6e0f1b3e7efecbfa37d192b0f70735f6a80e7f1e8d69ed5fa6db9ff2ff34 Nov 02 22:34:46.101002 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:46.100968 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:46.232164 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:46.232124 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-dxg5x/dw-deployment-gdgvg-857459d55d-l8wxk" event={"ID":"d7f03830-b97f-414a-8183-7f4117affc9d","Type":"ContainerStarted","Data":"713eb332cbe9bf290a950d13cf2e7a5fe809a011467a7399648aab52dae0e895"} Nov 02 22:34:46.232321 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:46.232197 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-dxg5x/dw-deployment-gdgvg-857459d55d-l8wxk" event={"ID":"d7f03830-b97f-414a-8183-7f4117affc9d","Type":"ContainerStarted","Data":"796e6e0f1b3e7efecbfa37d192b0f70735f6a80e7f1e8d69ed5fa6db9ff2ff34"} Nov 02 22:34:46.252905 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:46.252861 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-dxg5x/dw-deployment-gdgvg-857459d55d-l8wxk" podStartSLOduration=0.788001419 podStartE2EDuration="1.252848114s" totalImagesPullingTime="464.846695ms" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 22:34:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:34:46.252294788 +0000 UTC m=+2458.504293268" watchObservedRunningTime="2026-11-02 22:34:46.252848114 +0000 UTC m=+2458.504846577" Nov 02 22:34:46.965599 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:46.965563 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:47.756339 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:47.756302 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:34:48.989269 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:48.989225 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:49.086597 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:49.086562 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:49.785035 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:49.784990 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-p5kvc/test-trainjob-fail-zrt8c-dataset-initializer-0-0-5j225"] Nov 02 22:34:49.786548 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:49.786529 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-p5kvc/test-trainjob-fail-zrt8c-dataset-initializer-0-0-5j225"] Nov 02 22:34:49.863987 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:49.863953 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="714d025d-45d0-4182-9920-b34e1ad02529" path="/var/lib/kubelet/pods/714d025d-45d0-4182-9920-b34e1ad02529/volumes" Nov 02 22:34:49.902760 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:49.902730 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:50.270164 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:50.270131 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:50.367240 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:50.367208 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:50.574343 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:50.574310 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:50.758702 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:50.758626 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:34:52.505445 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:52.505400 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:52.608895 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:52.608855 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:52.713180 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:52.713143 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:53.412383 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:53.412350 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:53.515232 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:53.515197 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:53.771949 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:53.771866 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:34:56.020471 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:56.020427 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:56.113746 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:56.113715 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:56.239307 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:56.239246 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:56.332235 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:56.332191 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:56.771037 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:56.770916 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:34:56.787975 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:56.787933 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:56.886421 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:56.886385 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:59.124641 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:34:59.124605 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:34:59.389652 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:59.389545 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:34:59.784956 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:34:59.784869 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:35:02.772105 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:35:02.772070 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:35:05.773208 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:35:05.773171 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:35:08.773469 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:35:08.773428 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:35:11.772252 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:35:11.772212 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:35:14.773337 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:35:14.773299 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:35:17.770752 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:35:17.770714 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:35:20.772853 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:35:20.772822 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:35:23.770513 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:35:23.770483 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:35:26.772372 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:35:26.772333 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:35:29.123802 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:35:29.123763 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:35:29.771845 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:35:29.771812 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:35:32.773272 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:35:32.773241 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:35:35.772642 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:35:35.772603 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:35:38.770808 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:35:38.770775 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:35:41.772225 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:35:41.772185 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:35:44.773858 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:35:44.773826 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:35:47.770915 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:35:47.770879 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:35:50.772688 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:35:50.772635 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:35:53.771456 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:35:53.771425 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:35:56.772406 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:35:56.772327 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:35:59.124794 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:35:59.124744 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:35:59.449189 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:35:59.449100 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:35:59.772478 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:35:59.772394 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:36:02.772900 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:36:02.772865 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:36:05.773224 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:36:05.773186 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:36:08.770748 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:36:08.770711 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:36:11.772282 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:36:11.772242 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:36:14.772674 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:36:14.772626 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:36:17.782443 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:36:17.782414 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:36:20.773621 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:36:20.773594 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:36:23.772615 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:36:23.772582 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:36:26.770307 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:36:26.770269 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:36:29.123203 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:36:29.123167 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:36:29.772522 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:36:29.772495 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:36:32.772461 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:36:32.772427 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:36:35.772534 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:36:35.772506 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:36:38.770551 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:36:38.770517 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:36:41.774156 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:36:41.774123 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:36:44.772635 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:36:44.772595 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:36:47.757644 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:36:47.757605 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:36:48.478164 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:36:48.478132 5963 scope.go:122] "RemoveContainer" containerID="40ab212d206591b94f10d640c94b543a316b402f48846edc1d49afa73c340746" Nov 02 22:36:48.486535 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:36:48.486515 5963 scope.go:122] "RemoveContainer" containerID="7eb50abe8b32ea7f9534b8b7df22b0931e5a253cc1edb038ebeb4fef019d96cf" Nov 02 22:36:50.772996 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:36:50.772960 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:36:53.772322 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:36:53.772284 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:36:56.771861 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:36:56.771819 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:36:59.124957 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:36:59.124918 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:36:59.494917 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:36:59.494827 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:36:59.783549 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:36:59.783460 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:37:02.772414 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:37:02.772377 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:37:05.771802 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:37:05.771770 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:37:08.783272 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:37:08.783241 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:37:11.772824 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:37:11.772791 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:37:14.773150 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:37:14.773118 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:37:17.757145 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:37:17.757108 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:37:20.772104 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:37:20.772038 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:37:23.769712 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:37:23.769652 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:37:26.772220 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:37:26.772102 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:37:29.123730 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:37:29.123687 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:37:29.783878 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:37:29.783848 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:37:32.772450 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:37:32.772412 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:37:35.771096 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:37:35.771056 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:37:38.770512 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:37:38.770483 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:37:41.772708 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:37:41.772676 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:37:44.772193 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:37:44.772122 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:37:47.770771 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:37:47.770736 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:37:49.986092 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:37:49.986055 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:37:50.772953 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:37:50.772925 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:37:53.772414 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:37:53.772370 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:37:56.771488 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:37:56.771453 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:37:59.124338 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:37:59.124298 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:37:59.549635 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:37:59.549554 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:37:59.782223 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:37:59.782183 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:38:02.773349 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:38:02.773316 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:38:05.772596 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:38:05.772566 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:38:08.770713 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:38:08.770686 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:38:11.772547 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:38:11.772513 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:38:14.771988 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:38:14.771922 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:38:17.772142 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:38:17.772107 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:38:20.786051 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:38:20.786020 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:38:23.773226 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:38:23.773192 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:38:26.773327 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:38:26.773293 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:38:29.123199 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:38:29.123153 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:38:29.771407 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:38:29.771372 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:38:32.772394 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:38:32.772364 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:38:35.772567 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:38:35.772536 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:38:38.770705 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:38:38.770647 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:38:41.770336 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:38:41.770299 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:38:44.770116 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:38:44.770087 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:38:47.771006 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:38:47.770972 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:38:48.515341 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:38:48.515308 5963 scope.go:122] "RemoveContainer" containerID="7f78582738982e2b2a02e69b385ce80e68f01f0b0305049f5ff7c1f9578b9c74" Nov 02 22:38:50.772327 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:38:50.772292 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:38:53.772073 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:38:53.772030 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:38:56.771869 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:38:56.771782 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:38:59.123642 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:38:59.123605 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:38:59.637628 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:38:59.637592 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:38:59.771877 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:38:59.771839 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:39:02.772273 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:39:02.772233 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:39:05.771839 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:39:05.771809 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:39:08.769455 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:39:08.769422 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:39:11.771199 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:39:11.771167 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:39:14.771297 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:39:14.771237 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:39:17.772742 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:39:17.772709 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:39:20.772050 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:39:20.772021 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:39:23.770649 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:39:23.770581 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:39:26.772148 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:39:26.772115 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:39:29.123003 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:39:29.122952 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:39:29.771699 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:39:29.771650 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:39:32.770810 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:39:32.770780 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:39:35.771981 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:39:35.771949 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:39:38.770952 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:39:38.770902 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:39:41.772636 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:39:41.772600 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:39:44.771984 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:39:44.771941 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:39:47.771855 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:39:47.771823 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:39:48.553439 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:39:48.553402 5963 scope.go:122] "RemoveContainer" containerID="27ee3339fc9bf0bcec3eee3240a00453a00f00959fc5677e403773b6627d1e9a" Nov 02 22:39:50.772740 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:39:50.772705 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:39:53.772315 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:39:53.772280 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:39:55.044159 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:39:55.044120 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:39:56.772093 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:39:56.772051 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:39:59.124061 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:39:59.124020 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:39:59.672731 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:39:59.672689 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:39:59.770239 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:39:59.770210 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:40:02.772719 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:40:02.772687 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:40:05.773433 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:40:05.773405 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:40:08.771693 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:40:08.771639 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:40:11.773321 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:40:11.773290 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:40:14.773134 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:40:14.773101 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:40:17.772913 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:40:17.772878 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:40:20.771327 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:40:20.771294 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:40:23.772962 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:40:23.772931 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:40:26.772614 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:40:26.772532 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:40:29.123999 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:40:29.123965 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:40:29.784401 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:40:29.784368 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:40:32.770633 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:40:32.770597 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:40:35.771735 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:40:35.771695 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:40:38.770315 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:40:38.770281 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:40:41.772564 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:40:41.772532 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:40:44.772492 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:40:44.772467 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:40:47.772286 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:40:47.772254 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:40:48.592250 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:40:48.592214 5963 scope.go:122] "RemoveContainer" containerID="bd14386aa49a1075ceddc61f9a73eebb105c59577c184a8264ea44149c81c82a" Nov 02 22:40:48.609695 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:40:48.609649 5963 scope.go:122] "RemoveContainer" containerID="26e8888a67fefd93110e160e6e431b362c215285a3bc6452b75d877d80ba89f6" Nov 02 22:40:50.771875 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:40:50.771823 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:40:53.770007 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:40:53.769965 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:40:56.772141 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:40:56.772111 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:40:59.122928 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:40:59.122889 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:40:59.730141 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:40:59.730100 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:40:59.769622 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:40:59.769597 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:41:02.772447 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:41:02.772415 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:41:05.771637 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:41:05.771601 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:41:08.770932 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:41:08.770893 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:41:11.772495 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:41:11.772453 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:41:14.772284 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:41:14.772239 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:41:17.772421 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:41:17.772389 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:41:20.772385 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:41:20.772345 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:41:23.772457 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:41:23.772421 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:41:26.772714 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:41:26.772679 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:41:29.123529 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:41:29.123493 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:41:29.770817 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:41:29.770783 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:41:32.772903 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:41:32.772874 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:41:35.772320 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:41:35.772288 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:41:38.770694 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:41:38.770649 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:41:41.772180 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:41:41.772146 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:41:44.772582 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:41:44.772547 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:41:47.771874 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:41:47.771844 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:41:50.784737 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:41:50.784704 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:41:51.199485 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:41:51.199446 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:41:53.771596 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:41:53.771568 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:41:56.772638 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:41:56.772550 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:41:59.123782 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:41:59.123739 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:41:59.763901 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:41:59.763863 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:41:59.769846 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:41:59.769818 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:42:02.772171 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:02.772139 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:42:05.779682 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:05.779631 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:42:08.619617 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:08.619583 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-dxg5x/dw-deployment-gdgvg-857459d55d-l8wxk"] Nov 02 22:42:08.620149 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:08.619846 5963 kuberuntime_container.go:898] "Killing container with a grace period" pod="test-ns-dxg5x/dw-deployment-gdgvg-857459d55d-l8wxk" podUID="d7f03830-b97f-414a-8183-7f4117affc9d" containerName="notebook" containerID="cri-o://713eb332cbe9bf290a950d13cf2e7a5fe809a011467a7399648aab52dae0e895" gracePeriod=30 Nov 02 22:42:08.686711 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:08.686682 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dxg5x_dw-deployment-gdgvg-857459d55d-l8wxk_d7f03830-b97f-414a-8183-7f4117affc9d/notebook/0.log" Nov 02 22:42:08.825247 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:08.825213 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:42:08.925632 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:08.925520 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:42:09.056124 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:09.056089 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:42:09.106168 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:09.106133 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-5rvgz/dw-deployment-vz54f-789d7f469d-stbzd"] Nov 02 22:42:09.109467 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:09.109449 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-5rvgz/dw-deployment-vz54f-789d7f469d-stbzd" Nov 02 22:42:09.114604 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:09.114580 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-5rvgz\"/\"openshift-service-ca.crt\"" Nov 02 22:42:09.114604 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:09.114600 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-5rvgz\"/\"kube-root-ca.crt\"" Nov 02 22:42:09.115798 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:09.115780 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-5rvgz\"/\"default-dockercfg-7vrfg\"" Nov 02 22:42:09.115916 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:09.115815 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-5rvgz\"/\"config-tfcng\"" Nov 02 22:42:09.119820 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:09.119797 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-5rvgz/dw-deployment-vz54f-789d7f469d-stbzd"] Nov 02 22:42:09.159903 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:09.159863 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:42:09.240639 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:09.240558 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slk4d\" (UniqueName: \"kubernetes.io/projected/c93b25ab-4a38-4758-b9a3-a7d326a53de0-kube-api-access-slk4d\") pod \"dw-deployment-vz54f-789d7f469d-stbzd\" (UID: \"c93b25ab-4a38-4758-b9a3-a7d326a53de0\") " pod="test-ns-5rvgz/dw-deployment-vz54f-789d7f469d-stbzd" Nov 02 22:42:09.240810 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:09.240650 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/c93b25ab-4a38-4758-b9a3-a7d326a53de0-notebook-config\") pod \"dw-deployment-vz54f-789d7f469d-stbzd\" (UID: \"c93b25ab-4a38-4758-b9a3-a7d326a53de0\") " pod="test-ns-5rvgz/dw-deployment-vz54f-789d7f469d-stbzd" Nov 02 22:42:09.240810 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:09.240719 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-7cefd7c2-7d65-49e8-bf9f-fdbd22c0eabe\" (UniqueName: \"kubernetes.io/nfs/c93b25ab-4a38-4758-b9a3-a7d326a53de0-pvc-7cefd7c2-7d65-49e8-bf9f-fdbd22c0eabe\") pod \"dw-deployment-vz54f-789d7f469d-stbzd\" (UID: \"c93b25ab-4a38-4758-b9a3-a7d326a53de0\") " pod="test-ns-5rvgz/dw-deployment-vz54f-789d7f469d-stbzd" Nov 02 22:42:09.341338 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:09.341296 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slk4d\" (UniqueName: \"kubernetes.io/projected/c93b25ab-4a38-4758-b9a3-a7d326a53de0-kube-api-access-slk4d\") pod \"dw-deployment-vz54f-789d7f469d-stbzd\" (UID: \"c93b25ab-4a38-4758-b9a3-a7d326a53de0\") " pod="test-ns-5rvgz/dw-deployment-vz54f-789d7f469d-stbzd" Nov 02 22:42:09.341520 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:09.341369 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/c93b25ab-4a38-4758-b9a3-a7d326a53de0-notebook-config\") pod \"dw-deployment-vz54f-789d7f469d-stbzd\" (UID: \"c93b25ab-4a38-4758-b9a3-a7d326a53de0\") " pod="test-ns-5rvgz/dw-deployment-vz54f-789d7f469d-stbzd" Nov 02 22:42:09.341520 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:09.341410 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-7cefd7c2-7d65-49e8-bf9f-fdbd22c0eabe\" (UniqueName: \"kubernetes.io/nfs/c93b25ab-4a38-4758-b9a3-a7d326a53de0-pvc-7cefd7c2-7d65-49e8-bf9f-fdbd22c0eabe\") pod \"dw-deployment-vz54f-789d7f469d-stbzd\" (UID: \"c93b25ab-4a38-4758-b9a3-a7d326a53de0\") " pod="test-ns-5rvgz/dw-deployment-vz54f-789d7f469d-stbzd" Nov 02 22:42:09.342190 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:09.342167 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/c93b25ab-4a38-4758-b9a3-a7d326a53de0-notebook-config\") pod \"dw-deployment-vz54f-789d7f469d-stbzd\" (UID: \"c93b25ab-4a38-4758-b9a3-a7d326a53de0\") " pod="test-ns-5rvgz/dw-deployment-vz54f-789d7f469d-stbzd" Nov 02 22:42:09.354349 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:09.354317 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slk4d\" (UniqueName: \"kubernetes.io/projected/c93b25ab-4a38-4758-b9a3-a7d326a53de0-kube-api-access-slk4d\") pod \"dw-deployment-vz54f-789d7f469d-stbzd\" (UID: \"c93b25ab-4a38-4758-b9a3-a7d326a53de0\") " pod="test-ns-5rvgz/dw-deployment-vz54f-789d7f469d-stbzd" Nov 02 22:42:09.371564 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:09.371536 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-7cefd7c2-7d65-49e8-bf9f-fdbd22c0eabe\" (UniqueName: \"kubernetes.io/nfs/c93b25ab-4a38-4758-b9a3-a7d326a53de0-pvc-7cefd7c2-7d65-49e8-bf9f-fdbd22c0eabe\") pod \"dw-deployment-vz54f-789d7f469d-stbzd\" (UID: \"c93b25ab-4a38-4758-b9a3-a7d326a53de0\") " pod="test-ns-5rvgz/dw-deployment-vz54f-789d7f469d-stbzd" Nov 02 22:42:09.422559 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:09.422511 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-5rvgz/dw-deployment-vz54f-789d7f469d-stbzd" Nov 02 22:42:09.700064 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:09.700017 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-5rvgz/dw-deployment-vz54f-789d7f469d-stbzd"] Nov 02 22:42:09.709511 ip-10-0-139-99 kubenswrapper[5963]: W1102 22:42:09.709475 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc93b25ab_4a38_4758_b9a3_a7d326a53de0.slice/crio-2d82ecfbd6ef1237636e5d47af586a4a4a2cdb7e7b5e202cc054cb17132eb0cf WatchSource:0}: Error finding container 2d82ecfbd6ef1237636e5d47af586a4a4a2cdb7e7b5e202cc054cb17132eb0cf: Status 404 returned error can't find the container with id 2d82ecfbd6ef1237636e5d47af586a4a4a2cdb7e7b5e202cc054cb17132eb0cf Nov 02 22:42:09.711161 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:09.711126 5963 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 02 22:42:10.135681 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:10.135621 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-5rvgz/dw-deployment-vz54f-789d7f469d-stbzd" event={"ID":"c93b25ab-4a38-4758-b9a3-a7d326a53de0","Type":"ContainerStarted","Data":"2d82ecfbd6ef1237636e5d47af586a4a4a2cdb7e7b5e202cc054cb17132eb0cf"} Nov 02 22:42:11.141087 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:11.141049 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-5rvgz/dw-deployment-vz54f-789d7f469d-stbzd" event={"ID":"c93b25ab-4a38-4758-b9a3-a7d326a53de0","Type":"ContainerStarted","Data":"06b042e5028f6cb3d0a27f3427e5b06619519a65f1cfba8d130ff47096a6fdea"} Nov 02 22:42:11.161513 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:11.161466 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-5rvgz/dw-deployment-vz54f-789d7f469d-stbzd" podStartSLOduration=1.364336861 podStartE2EDuration="2.161452659s" totalImagesPullingTime="797.115798ms" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 22:42:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:42:11.160454348 +0000 UTC m=+2903.412452816" watchObservedRunningTime="2026-11-02 22:42:11.161452659 +0000 UTC m=+2903.413451125" Nov 02 22:42:11.795941 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:11.795912 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:42:13.972951 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:13.972910 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:42:14.796782 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:14.796750 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:42:17.036494 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:17.036432 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:42:17.809594 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:17.809554 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:42:20.824558 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:20.824524 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:42:23.824807 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:23.824775 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:42:26.826374 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:26.826341 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:42:29.126103 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:42:29.126066 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:42:29.824580 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:29.824547 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:42:32.811023 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:32.810992 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:42:35.824565 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:35.824533 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:42:38.816501 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:38.816476 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-dxg5x/dw-deployment-gdgvg-857459d55d-l8wxk" Nov 02 22:42:38.823324 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:38.823286 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:42:38.902443 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:38.902343 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d7f03830-b97f-414a-8183-7f4117affc9d-notebook-config\" (UniqueName: \"kubernetes.io/configmap/d7f03830-b97f-414a-8183-7f4117affc9d-notebook-config\") pod \"d7f03830-b97f-414a-8183-7f4117affc9d\" (UID: \"d7f03830-b97f-414a-8183-7f4117affc9d\") " Nov 02 22:42:38.902443 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:38.902423 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d7f03830-b97f-414a-8183-7f4117affc9d-kube-api-access-gp28c\" (UniqueName: \"kubernetes.io/projected/d7f03830-b97f-414a-8183-7f4117affc9d-kube-api-access-gp28c\") pod \"d7f03830-b97f-414a-8183-7f4117affc9d\" (UID: \"d7f03830-b97f-414a-8183-7f4117affc9d\") " Nov 02 22:42:38.902650 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:38.902446 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/nfs/d7f03830-b97f-414a-8183-7f4117affc9d-pvc-f1fc51d9-3e19-4696-956e-da7d35221d18\" (UniqueName: \"kubernetes.io/nfs/d7f03830-b97f-414a-8183-7f4117affc9d-pvc-f1fc51d9-3e19-4696-956e-da7d35221d18\") pod \"d7f03830-b97f-414a-8183-7f4117affc9d\" (UID: \"d7f03830-b97f-414a-8183-7f4117affc9d\") " Nov 02 22:42:38.902865 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:38.902826 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7f03830-b97f-414a-8183-7f4117affc9d-notebook-config" pod "d7f03830-b97f-414a-8183-7f4117affc9d" (UID: "d7f03830-b97f-414a-8183-7f4117affc9d"). InnerVolumeSpecName "notebook-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 22:42:38.905153 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:38.905057 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7f03830-b97f-414a-8183-7f4117affc9d-kube-api-access-gp28c" pod "d7f03830-b97f-414a-8183-7f4117affc9d" (UID: "d7f03830-b97f-414a-8183-7f4117affc9d"). InnerVolumeSpecName "kube-api-access-gp28c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 22:42:38.925921 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:38.925888 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/nfs/d7f03830-b97f-414a-8183-7f4117affc9d-pvc-f1fc51d9-3e19-4696-956e-da7d35221d18" pod "d7f03830-b97f-414a-8183-7f4117affc9d" (UID: "d7f03830-b97f-414a-8183-7f4117affc9d"). InnerVolumeSpecName "pvc-f1fc51d9-3e19-4696-956e-da7d35221d18". PluginName "kubernetes.io/nfs", VolumeGIDValue "" Nov 02 22:42:39.003495 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:39.003457 5963 reconciler_common.go:299] "Volume detached for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/d7f03830-b97f-414a-8183-7f4117affc9d-notebook-config\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:42:39.003495 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:39.003488 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gp28c\" (UniqueName: \"kubernetes.io/projected/d7f03830-b97f-414a-8183-7f4117affc9d-kube-api-access-gp28c\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:42:39.003495 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:39.003499 5963 reconciler_common.go:299] "Volume detached for volume \"pvc-f1fc51d9-3e19-4696-956e-da7d35221d18\" (UniqueName: \"kubernetes.io/nfs/d7f03830-b97f-414a-8183-7f4117affc9d-pvc-f1fc51d9-3e19-4696-956e-da7d35221d18\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:42:39.252382 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:39.252289 5963 generic.go:356] "Generic (PLEG): container finished" podID="d7f03830-b97f-414a-8183-7f4117affc9d" containerID="713eb332cbe9bf290a950d13cf2e7a5fe809a011467a7399648aab52dae0e895" exitCode=137 Nov 02 22:42:39.252382 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:39.252333 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-dxg5x/dw-deployment-gdgvg-857459d55d-l8wxk" Nov 02 22:42:39.252382 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:39.252364 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-dxg5x/dw-deployment-gdgvg-857459d55d-l8wxk" event={"ID":"d7f03830-b97f-414a-8183-7f4117affc9d","Type":"ContainerDied","Data":"713eb332cbe9bf290a950d13cf2e7a5fe809a011467a7399648aab52dae0e895"} Nov 02 22:42:39.252647 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:39.252419 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-dxg5x/dw-deployment-gdgvg-857459d55d-l8wxk" event={"ID":"d7f03830-b97f-414a-8183-7f4117affc9d","Type":"ContainerDied","Data":"796e6e0f1b3e7efecbfa37d192b0f70735f6a80e7f1e8d69ed5fa6db9ff2ff34"} Nov 02 22:42:39.252647 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:39.252443 5963 scope.go:122] "RemoveContainer" containerID="713eb332cbe9bf290a950d13cf2e7a5fe809a011467a7399648aab52dae0e895" Nov 02 22:42:39.273484 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:39.273464 5963 scope.go:122] "RemoveContainer" containerID="713eb332cbe9bf290a950d13cf2e7a5fe809a011467a7399648aab52dae0e895" Nov 02 22:42:39.273934 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:42:39.273907 5963 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"713eb332cbe9bf290a950d13cf2e7a5fe809a011467a7399648aab52dae0e895\": container with ID starting with 713eb332cbe9bf290a950d13cf2e7a5fe809a011467a7399648aab52dae0e895 not found: ID does not exist" containerID="713eb332cbe9bf290a950d13cf2e7a5fe809a011467a7399648aab52dae0e895" Nov 02 22:42:39.274038 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:39.273947 5963 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"713eb332cbe9bf290a950d13cf2e7a5fe809a011467a7399648aab52dae0e895"} err="failed to get container status \"713eb332cbe9bf290a950d13cf2e7a5fe809a011467a7399648aab52dae0e895\": rpc error: code = NotFound desc = could not find container \"713eb332cbe9bf290a950d13cf2e7a5fe809a011467a7399648aab52dae0e895\": container with ID starting with 713eb332cbe9bf290a950d13cf2e7a5fe809a011467a7399648aab52dae0e895 not found: ID does not exist" Nov 02 22:42:39.274192 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:39.274173 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-dxg5x/dw-deployment-gdgvg-857459d55d-l8wxk"] Nov 02 22:42:39.278845 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:39.278816 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-dxg5x/dw-deployment-gdgvg-857459d55d-l8wxk"] Nov 02 22:42:39.863558 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:39.863521 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d7f03830-b97f-414a-8183-7f4117affc9d" path="/var/lib/kubelet/pods/d7f03830-b97f-414a-8183-7f4117affc9d/volumes" Nov 02 22:42:41.822577 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:41.822550 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:42:44.823492 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:44.823460 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:42:47.796882 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:47.796847 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:42:50.825228 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:50.825191 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:42:51.162313 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:51.162230 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:42:51.796605 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:51.796564 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:42:51.897369 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:51.897332 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:42:52.021374 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:52.021335 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:42:53.823477 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:53.823441 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:42:56.824558 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:56.824521 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:42:57.479808 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:57.479767 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:42:57.573634 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:57.573594 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:42:59.125077 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:42:59.125037 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:42:59.824307 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:59.824280 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:42:59.839619 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:42:59.839579 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:43:02.824349 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:43:02.824313 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:43:05.824335 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:43:05.824301 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:43:08.822773 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:43:08.822734 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:43:11.826682 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:43:11.826633 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:43:14.823451 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:43:14.823410 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:43:17.822546 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:43:17.822515 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:43:20.824938 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:43:20.824909 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:43:23.823136 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:43:23.823101 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:43:26.825020 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:43:26.824945 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:43:29.122872 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:43:29.122836 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:43:29.823679 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:43:29.823624 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:43:32.840455 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:43:32.840421 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:43:35.824585 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:43:35.824555 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:43:38.822410 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:43:38.822376 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:43:41.825494 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:43:41.825464 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:43:44.823252 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:43:44.823220 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:43:47.823814 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:43:47.823782 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:43:50.824200 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:43:50.824165 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:43:53.808483 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:43:53.808444 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:43:56.823810 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:43:56.823744 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:43:59.124479 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:43:59.124435 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:43:59.826926 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:43:59.826900 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:43:59.901112 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:43:59.901074 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:44:02.825251 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:44:02.825216 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:44:05.141413 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:44:05.141374 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:44:05.824188 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:44:05.824146 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:44:08.798378 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:44:08.798349 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:44:11.823740 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:44:11.823642 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:44:14.823039 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:44:14.823004 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:44:17.824889 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:44:17.824855 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:44:20.823174 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:44:20.823116 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:44:23.838221 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:44:23.838172 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:44:26.824283 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:44:26.824221 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:44:29.123966 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:44:29.123919 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:44:29.822415 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:44:29.822383 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:44:32.825635 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:44:32.825601 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:44:35.824263 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:44:35.824182 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:44:38.825790 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:44:38.825754 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:44:41.824564 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:44:41.824534 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:44:44.823328 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:44:44.823291 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:44:47.824382 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:44:47.824350 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:44:50.823041 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:44:50.822984 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:44:53.824206 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:44:53.824175 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:44:56.823269 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:44:56.823179 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:44:59.122177 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:44:59.122139 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:44:59.822377 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:44:59.822344 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:44:59.953004 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:44:59.952969 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:45:02.824768 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:45:02.824734 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:45:05.822551 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:45:05.822521 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:45:08.825106 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:45:08.825071 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:45:11.824343 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:45:11.824313 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:45:14.818032 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:45:14.817995 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:45:17.822541 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:45:17.822508 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:45:20.823406 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:45:20.823368 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:45:23.823518 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:45:23.823487 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:45:26.823178 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:45:26.823144 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:45:29.123847 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:45:29.123810 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:45:29.796705 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:45:29.796655 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:45:32.822783 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:45:32.822747 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:45:35.823083 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:45:35.823053 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:45:38.824485 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:45:38.824449 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:45:41.825140 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:45:41.825102 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:45:44.823838 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:45:44.823807 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:45:47.823676 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:45:47.823623 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:45:50.825973 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:45:50.825936 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:45:53.823076 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:45:53.823042 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:45:56.822563 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:45:56.822530 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:45:59.122952 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:45:59.122915 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:45:59.825040 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:45:59.825009 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:45:59.997512 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:45:59.997478 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:46:02.825365 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:46:02.825333 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:46:03.769556 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:46:03.769521 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:46:05.823335 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:46:05.823299 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:46:08.823941 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:46:08.823911 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:46:11.826179 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:46:11.826149 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:46:14.825229 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:46:14.825195 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:46:17.825056 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:46:17.825026 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:46:20.825987 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:46:20.825947 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:46:23.824885 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:46:23.824853 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:46:26.578879 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:46:26.578791 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:46:26.822810 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:46:26.822778 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:46:29.122300 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:46:29.122258 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:46:29.827545 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:46:29.827511 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:46:32.824929 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:46:32.824902 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:46:33.866769 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:46:33.866730 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:46:35.822905 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:46:35.822863 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:46:36.403807 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:46:36.403767 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:46:38.824393 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:46:38.824355 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:46:41.824221 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:46:41.824177 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:46:44.824069 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:46:44.824037 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:46:47.824997 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:46:47.824962 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:46:50.824974 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:46:50.824939 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:46:53.824589 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:46:53.824556 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:46:56.823248 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:46:56.823200 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:46:59.122284 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:46:59.122241 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:46:59.825273 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:46:59.825240 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:47:00.053621 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:47:00.053582 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:47:02.844812 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:47:02.844778 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:47:05.809633 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:47:05.809595 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:47:08.825431 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:47:08.825393 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:47:11.825166 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:47:11.825130 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:47:14.824960 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:47:14.824923 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:47:17.824679 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:47:17.824634 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:47:20.825188 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:47:20.825155 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:47:23.825093 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:47:23.825059 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:47:26.824453 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:47:26.824418 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:47:29.121960 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:47:29.121925 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:47:29.824307 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:47:29.824275 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:47:32.824728 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:47:32.824694 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:47:35.809569 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:47:35.809530 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:47:38.825594 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:47:38.825563 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:47:41.824166 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:47:41.824130 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:47:44.824652 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:47:44.824616 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:47:47.822381 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:47:47.822346 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:47:50.824593 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:47:50.824562 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:47:53.824326 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:47:53.824292 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:47:56.823130 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:47:56.823043 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:47:59.122603 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:47:59.122561 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:47:59.824066 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:47:59.824032 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:48:00.083133 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:48:00.083062 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:48:02.824116 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:48:02.824087 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:48:05.796674 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:48:05.796643 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:48:08.823036 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:48:08.823009 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:48:11.825088 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:48:11.825052 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:48:14.824796 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:48:14.824757 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:48:17.824125 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:48:17.824088 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:48:20.824202 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:48:20.824166 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:48:23.825060 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:48:23.825028 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:48:26.823521 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:48:26.823472 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:48:29.124163 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:48:29.124125 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:48:29.825122 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:48:29.825090 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:48:32.824402 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:48:32.824366 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:48:35.825232 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:48:35.825197 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:48:38.822853 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:48:38.822811 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:48:41.824624 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:48:41.824590 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:48:44.824390 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:48:44.824347 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:48:47.823732 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:48:47.823679 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:48:50.825405 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:48:50.825358 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:48:53.823681 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:48:53.823633 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:48:56.881180 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:48:56.881144 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:48:59.123263 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:48:59.123214 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:48:59.824599 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:48:59.824569 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:49:00.155929 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:49:00.155847 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:49:02.823867 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:49:02.823819 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:49:05.824726 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:49:05.824691 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:49:08.824245 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:49:08.824208 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:49:11.824599 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:49:11.824568 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:49:14.825356 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:49:14.825319 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:49:17.823466 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:49:17.823437 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:49:20.824274 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:49:20.824237 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:49:23.824442 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:49:23.824406 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:49:26.823532 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:49:26.823436 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:49:29.124032 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:49:29.123993 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:49:29.824156 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:49:29.824125 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:49:32.825052 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:49:32.825016 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:49:35.824111 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:49:35.824076 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:49:38.825160 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:49:38.825122 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:49:41.824890 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:49:41.824854 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:49:44.823975 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:49:44.823936 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:49:47.823381 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:49:47.823347 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:49:50.824802 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:49:50.824774 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:49:53.824075 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:49:53.824045 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:49:56.823297 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:49:56.823254 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:49:59.124247 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:49:59.124198 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:49:59.824875 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:49:59.824833 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:50:00.209241 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:00.209155 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:50:02.823778 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:02.823749 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:50:05.867844 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:05.867807 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:50:08.824719 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:08.824686 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:50:11.826928 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:11.826898 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:50:14.824618 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:14.824581 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:50:17.823624 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:17.823589 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:50:20.824280 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:20.824241 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:50:23.824259 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:23.824223 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:50:26.823108 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:26.823070 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:50:29.122903 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:50:29.122862 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:50:29.824441 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:29.824402 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:50:32.825839 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:32.825766 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:50:35.824909 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:35.824875 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:50:38.825046 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:38.825006 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:50:41.824310 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:41.824274 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:50:44.823910 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:44.823866 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:50:47.822800 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:47.822761 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:50:50.826240 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:50.826205 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:50:53.831079 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:53.831045 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:50:56.479123 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:56.479084 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-5rvgz/dw-deployment-vz54f-789d7f469d-stbzd"] Nov 02 22:50:56.479550 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:56.479304 5963 kuberuntime_container.go:898] "Killing container with a grace period" pod="test-ns-5rvgz/dw-deployment-vz54f-789d7f469d-stbzd" podUID="c93b25ab-4a38-4758-b9a3-a7d326a53de0" containerName="notebook" containerID="cri-o://06b042e5028f6cb3d0a27f3427e5b06619519a65f1cfba8d130ff47096a6fdea" gracePeriod=30 Nov 02 22:50:56.538400 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:56.538367 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-5rvgz_dw-deployment-vz54f-789d7f469d-stbzd_c93b25ab-4a38-4758-b9a3-a7d326a53de0/notebook/0.log" Nov 02 22:50:56.712228 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:56.712147 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:50:56.817594 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:56.817556 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:50:56.928880 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:56.928835 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:50:56.931856 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:56.931830 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-m76bb/dw-deployment-pjpbn-58c6ddb979-n7l9r"] Nov 02 22:50:56.932193 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:56.932179 5963 cpu_manager.go:414] "containerMap: removing container" podUID="d7f03830-b97f-414a-8183-7f4117affc9d" containerName="notebook" Nov 02 22:50:56.932236 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:56.932195 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d7f03830-b97f-414a-8183-7f4117affc9d" containerName="notebook" Nov 02 22:50:56.932278 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:56.932269 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="d7f03830-b97f-414a-8183-7f4117affc9d" containerName="notebook" Nov 02 22:50:56.935166 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:56.935149 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-m76bb/dw-deployment-pjpbn-58c6ddb979-n7l9r" Nov 02 22:50:56.941956 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:56.941568 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-m76bb\"/\"openshift-service-ca.crt\"" Nov 02 22:50:56.941956 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:56.941637 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-m76bb\"/\"default-dockercfg-f5vhc\"" Nov 02 22:50:56.942217 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:56.942198 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-m76bb\"/\"kube-root-ca.crt\"" Nov 02 22:50:56.943084 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:56.943070 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-m76bb\"/\"config-7449j\"" Nov 02 22:50:56.945907 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:56.945881 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-m76bb/dw-deployment-pjpbn-58c6ddb979-n7l9r"] Nov 02 22:50:57.030546 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:57.030518 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:50:57.089254 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:57.089177 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q2x8\" (UniqueName: \"kubernetes.io/projected/45db6093-eea0-45b2-959e-82f3861aef1d-kube-api-access-4q2x8\") pod \"dw-deployment-pjpbn-58c6ddb979-n7l9r\" (UID: \"45db6093-eea0-45b2-959e-82f3861aef1d\") " pod="test-ns-m76bb/dw-deployment-pjpbn-58c6ddb979-n7l9r" Nov 02 22:50:57.089254 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:57.089219 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-a5aa6320-0b91-42ee-9771-4c1ed11f429b\" (UniqueName: \"kubernetes.io/nfs/45db6093-eea0-45b2-959e-82f3861aef1d-pvc-a5aa6320-0b91-42ee-9771-4c1ed11f429b\") pod \"dw-deployment-pjpbn-58c6ddb979-n7l9r\" (UID: \"45db6093-eea0-45b2-959e-82f3861aef1d\") " pod="test-ns-m76bb/dw-deployment-pjpbn-58c6ddb979-n7l9r" Nov 02 22:50:57.089427 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:57.089328 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/45db6093-eea0-45b2-959e-82f3861aef1d-notebook-config\") pod \"dw-deployment-pjpbn-58c6ddb979-n7l9r\" (UID: \"45db6093-eea0-45b2-959e-82f3861aef1d\") " pod="test-ns-m76bb/dw-deployment-pjpbn-58c6ddb979-n7l9r" Nov 02 22:50:57.189781 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:57.189748 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q2x8\" (UniqueName: \"kubernetes.io/projected/45db6093-eea0-45b2-959e-82f3861aef1d-kube-api-access-4q2x8\") pod \"dw-deployment-pjpbn-58c6ddb979-n7l9r\" (UID: \"45db6093-eea0-45b2-959e-82f3861aef1d\") " pod="test-ns-m76bb/dw-deployment-pjpbn-58c6ddb979-n7l9r" Nov 02 22:50:57.189781 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:57.189782 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-a5aa6320-0b91-42ee-9771-4c1ed11f429b\" (UniqueName: \"kubernetes.io/nfs/45db6093-eea0-45b2-959e-82f3861aef1d-pvc-a5aa6320-0b91-42ee-9771-4c1ed11f429b\") pod \"dw-deployment-pjpbn-58c6ddb979-n7l9r\" (UID: \"45db6093-eea0-45b2-959e-82f3861aef1d\") " pod="test-ns-m76bb/dw-deployment-pjpbn-58c6ddb979-n7l9r" Nov 02 22:50:57.189999 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:57.189809 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/45db6093-eea0-45b2-959e-82f3861aef1d-notebook-config\") pod \"dw-deployment-pjpbn-58c6ddb979-n7l9r\" (UID: \"45db6093-eea0-45b2-959e-82f3861aef1d\") " pod="test-ns-m76bb/dw-deployment-pjpbn-58c6ddb979-n7l9r" Nov 02 22:50:57.190631 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:57.190563 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/45db6093-eea0-45b2-959e-82f3861aef1d-notebook-config\") pod \"dw-deployment-pjpbn-58c6ddb979-n7l9r\" (UID: \"45db6093-eea0-45b2-959e-82f3861aef1d\") " pod="test-ns-m76bb/dw-deployment-pjpbn-58c6ddb979-n7l9r" Nov 02 22:50:57.203046 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:57.203017 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q2x8\" (UniqueName: \"kubernetes.io/projected/45db6093-eea0-45b2-959e-82f3861aef1d-kube-api-access-4q2x8\") pod \"dw-deployment-pjpbn-58c6ddb979-n7l9r\" (UID: \"45db6093-eea0-45b2-959e-82f3861aef1d\") " pod="test-ns-m76bb/dw-deployment-pjpbn-58c6ddb979-n7l9r" Nov 02 22:50:57.212567 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:57.212530 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-a5aa6320-0b91-42ee-9771-4c1ed11f429b\" (UniqueName: \"kubernetes.io/nfs/45db6093-eea0-45b2-959e-82f3861aef1d-pvc-a5aa6320-0b91-42ee-9771-4c1ed11f429b\") pod \"dw-deployment-pjpbn-58c6ddb979-n7l9r\" (UID: \"45db6093-eea0-45b2-959e-82f3861aef1d\") " pod="test-ns-m76bb/dw-deployment-pjpbn-58c6ddb979-n7l9r" Nov 02 22:50:57.249250 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:57.249212 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-m76bb/dw-deployment-pjpbn-58c6ddb979-n7l9r" Nov 02 22:50:57.526988 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:57.526903 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-m76bb/dw-deployment-pjpbn-58c6ddb979-n7l9r"] Nov 02 22:50:57.530735 ip-10-0-139-99 kubenswrapper[5963]: W1102 22:50:57.530705 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45db6093_eea0_45b2_959e_82f3861aef1d.slice/crio-a8d16e3aa1918187b711170d84d8a6683fe488621f0c007469c603c6401e0d1e WatchSource:0}: Error finding container a8d16e3aa1918187b711170d84d8a6683fe488621f0c007469c603c6401e0d1e: Status 404 returned error can't find the container with id a8d16e3aa1918187b711170d84d8a6683fe488621f0c007469c603c6401e0d1e Nov 02 22:50:57.532066 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:57.532046 5963 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 02 22:50:58.187806 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:58.187771 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-m76bb/dw-deployment-pjpbn-58c6ddb979-n7l9r" event={"ID":"45db6093-eea0-45b2-959e-82f3861aef1d","Type":"ContainerStarted","Data":"0fcc38300f6a47cd7870e68f4d8d87c382bb3da42f952aa257381dd9761c0298"} Nov 02 22:50:58.188127 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:58.187825 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-m76bb/dw-deployment-pjpbn-58c6ddb979-n7l9r" event={"ID":"45db6093-eea0-45b2-959e-82f3861aef1d","Type":"ContainerStarted","Data":"a8d16e3aa1918187b711170d84d8a6683fe488621f0c007469c603c6401e0d1e"} Nov 02 22:50:58.207548 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:58.207490 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-m76bb/dw-deployment-pjpbn-58c6ddb979-n7l9r" podStartSLOduration=1.66523655 podStartE2EDuration="2.2074753s" totalImagesPullingTime="542.23875ms" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 22:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:50:58.206557435 +0000 UTC m=+3430.458555914" watchObservedRunningTime="2026-11-02 22:50:58.2074753 +0000 UTC m=+3430.459473765" Nov 02 22:50:59.125946 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:50:59.125900 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:50:59.647596 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:50:59.647566 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:51:00.262744 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:00.262706 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:51:01.816175 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:01.816138 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:51:02.649561 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:02.649527 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:51:04.945172 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:04.945132 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:51:05.695184 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:05.695151 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:51:08.697237 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:08.697208 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:51:11.697143 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:11.697107 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:51:14.693866 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:14.693832 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:51:17.696817 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:17.696776 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:51:20.696529 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:20.696496 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:51:23.694545 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:23.694508 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:51:26.679529 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:26.679499 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-5rvgz/dw-deployment-vz54f-789d7f469d-stbzd" Nov 02 22:51:26.695556 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:26.695529 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:51:26.735133 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:26.735036 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c93b25ab-4a38-4758-b9a3-a7d326a53de0-kube-api-access-slk4d\" (UniqueName: \"kubernetes.io/projected/c93b25ab-4a38-4758-b9a3-a7d326a53de0-kube-api-access-slk4d\") pod \"c93b25ab-4a38-4758-b9a3-a7d326a53de0\" (UID: \"c93b25ab-4a38-4758-b9a3-a7d326a53de0\") " Nov 02 22:51:26.735133 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:26.735106 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c93b25ab-4a38-4758-b9a3-a7d326a53de0-notebook-config\" (UniqueName: \"kubernetes.io/configmap/c93b25ab-4a38-4758-b9a3-a7d326a53de0-notebook-config\") pod \"c93b25ab-4a38-4758-b9a3-a7d326a53de0\" (UID: \"c93b25ab-4a38-4758-b9a3-a7d326a53de0\") " Nov 02 22:51:26.735389 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:26.735151 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/nfs/c93b25ab-4a38-4758-b9a3-a7d326a53de0-pvc-7cefd7c2-7d65-49e8-bf9f-fdbd22c0eabe\" (UniqueName: \"kubernetes.io/nfs/c93b25ab-4a38-4758-b9a3-a7d326a53de0-pvc-7cefd7c2-7d65-49e8-bf9f-fdbd22c0eabe\") pod \"c93b25ab-4a38-4758-b9a3-a7d326a53de0\" (UID: \"c93b25ab-4a38-4758-b9a3-a7d326a53de0\") " Nov 02 22:51:26.735501 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:26.735470 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c93b25ab-4a38-4758-b9a3-a7d326a53de0-notebook-config" pod "c93b25ab-4a38-4758-b9a3-a7d326a53de0" (UID: "c93b25ab-4a38-4758-b9a3-a7d326a53de0"). InnerVolumeSpecName "notebook-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 22:51:26.737649 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:26.737610 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c93b25ab-4a38-4758-b9a3-a7d326a53de0-kube-api-access-slk4d" pod "c93b25ab-4a38-4758-b9a3-a7d326a53de0" (UID: "c93b25ab-4a38-4758-b9a3-a7d326a53de0"). InnerVolumeSpecName "kube-api-access-slk4d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 22:51:26.762151 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:26.762108 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/nfs/c93b25ab-4a38-4758-b9a3-a7d326a53de0-pvc-7cefd7c2-7d65-49e8-bf9f-fdbd22c0eabe" pod "c93b25ab-4a38-4758-b9a3-a7d326a53de0" (UID: "c93b25ab-4a38-4758-b9a3-a7d326a53de0"). InnerVolumeSpecName "pvc-7cefd7c2-7d65-49e8-bf9f-fdbd22c0eabe". PluginName "kubernetes.io/nfs", VolumeGIDValue "" Nov 02 22:51:26.836101 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:26.836060 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-slk4d\" (UniqueName: \"kubernetes.io/projected/c93b25ab-4a38-4758-b9a3-a7d326a53de0-kube-api-access-slk4d\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:51:26.836101 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:26.836094 5963 reconciler_common.go:299] "Volume detached for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/c93b25ab-4a38-4758-b9a3-a7d326a53de0-notebook-config\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:51:26.836101 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:26.836104 5963 reconciler_common.go:299] "Volume detached for volume \"pvc-7cefd7c2-7d65-49e8-bf9f-fdbd22c0eabe\" (UniqueName: \"kubernetes.io/nfs/c93b25ab-4a38-4758-b9a3-a7d326a53de0-pvc-7cefd7c2-7d65-49e8-bf9f-fdbd22c0eabe\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 22:51:27.302585 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:27.302547 5963 generic.go:356] "Generic (PLEG): container finished" podID="c93b25ab-4a38-4758-b9a3-a7d326a53de0" containerID="06b042e5028f6cb3d0a27f3427e5b06619519a65f1cfba8d130ff47096a6fdea" exitCode=137 Nov 02 22:51:27.302585 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:27.302584 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-5rvgz/dw-deployment-vz54f-789d7f469d-stbzd" Nov 02 22:51:27.302837 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:27.302604 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-5rvgz/dw-deployment-vz54f-789d7f469d-stbzd" event={"ID":"c93b25ab-4a38-4758-b9a3-a7d326a53de0","Type":"ContainerDied","Data":"06b042e5028f6cb3d0a27f3427e5b06619519a65f1cfba8d130ff47096a6fdea"} Nov 02 22:51:27.302837 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:27.302654 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-5rvgz/dw-deployment-vz54f-789d7f469d-stbzd" event={"ID":"c93b25ab-4a38-4758-b9a3-a7d326a53de0","Type":"ContainerDied","Data":"2d82ecfbd6ef1237636e5d47af586a4a4a2cdb7e7b5e202cc054cb17132eb0cf"} Nov 02 22:51:27.302837 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:27.302697 5963 scope.go:122] "RemoveContainer" containerID="06b042e5028f6cb3d0a27f3427e5b06619519a65f1cfba8d130ff47096a6fdea" Nov 02 22:51:27.323351 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:27.323330 5963 scope.go:122] "RemoveContainer" containerID="06b042e5028f6cb3d0a27f3427e5b06619519a65f1cfba8d130ff47096a6fdea" Nov 02 22:51:27.323774 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:51:27.323737 5963 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06b042e5028f6cb3d0a27f3427e5b06619519a65f1cfba8d130ff47096a6fdea\": container with ID starting with 06b042e5028f6cb3d0a27f3427e5b06619519a65f1cfba8d130ff47096a6fdea not found: ID does not exist" containerID="06b042e5028f6cb3d0a27f3427e5b06619519a65f1cfba8d130ff47096a6fdea" Nov 02 22:51:27.323979 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:27.323935 5963 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06b042e5028f6cb3d0a27f3427e5b06619519a65f1cfba8d130ff47096a6fdea"} err="failed to get container status \"06b042e5028f6cb3d0a27f3427e5b06619519a65f1cfba8d130ff47096a6fdea\": rpc error: code = NotFound desc = could not find container \"06b042e5028f6cb3d0a27f3427e5b06619519a65f1cfba8d130ff47096a6fdea\": container with ID starting with 06b042e5028f6cb3d0a27f3427e5b06619519a65f1cfba8d130ff47096a6fdea not found: ID does not exist" Nov 02 22:51:27.325022 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:27.324991 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-5rvgz/dw-deployment-vz54f-789d7f469d-stbzd"] Nov 02 22:51:27.329781 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:27.329760 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-5rvgz/dw-deployment-vz54f-789d7f469d-stbzd"] Nov 02 22:51:27.864195 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:27.864161 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c93b25ab-4a38-4758-b9a3-a7d326a53de0" path="/var/lib/kubelet/pods/c93b25ab-4a38-4758-b9a3-a7d326a53de0/volumes" Nov 02 22:51:29.125817 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:51:29.125784 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:51:29.683041 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:29.683008 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:51:32.695205 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:32.695170 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:51:35.696895 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:35.696860 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:51:38.697900 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:38.697868 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:51:38.930897 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:38.930862 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:51:39.244412 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:39.244379 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:51:39.344143 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:39.344099 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:51:39.538389 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:39.538276 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:51:39.639418 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:39.639384 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:51:41.732174 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:41.732141 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:51:44.669491 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:44.669457 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:51:44.977726 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:44.977625 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:51:45.074631 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:45.074597 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:51:47.697426 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:47.697391 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:51:50.696692 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:50.696624 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:51:53.697061 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:53.697026 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:51:56.696788 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:56.696755 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:51:59.123905 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:51:59.123867 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:51:59.696022 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:51:59.695984 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:52:00.317738 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:52:00.317696 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:52:02.696180 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:52:02.696144 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:52:05.695465 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:52:05.695429 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:52:08.697747 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:52:08.697717 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:52:11.696080 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:52:11.696050 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:52:14.697919 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:52:14.697887 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:52:17.696455 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:52:17.696423 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:52:20.696716 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:52:20.696682 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:52:23.697710 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:52:23.697652 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:52:26.698046 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:52:26.697959 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:52:29.123560 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:52:29.123519 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:52:29.698455 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:52:29.698421 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:52:32.697116 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:52:32.697082 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:52:35.695209 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:52:35.695177 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:52:38.754013 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:52:38.753983 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:52:41.696785 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:52:41.696749 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:52:44.698620 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:52:44.698580 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:52:46.537323 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:52:46.537283 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:52:47.697994 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:52:47.697947 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:52:50.711383 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:52:50.711212 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:52:53.696549 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:52:53.696512 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:52:56.695375 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:52:56.695332 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:52:59.124190 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:52:59.124149 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:52:59.698097 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:52:59.697810 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:53:00.355699 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:53:00.355642 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:53:02.698717 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:53:02.698681 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:53:05.669529 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:53:05.669490 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:53:08.704698 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:53:08.704303 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:53:11.696839 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:53:11.696804 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:53:14.697326 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:53:14.697277 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:53:17.696778 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:53:17.696744 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:53:20.698067 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:53:20.698030 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:53:23.697153 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:53:23.697095 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:53:26.701929 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:53:26.701899 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:53:29.123470 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:53:29.123434 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:53:29.700191 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:53:29.700153 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:53:32.697045 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:53:32.696997 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:53:35.696823 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:53:35.696791 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:53:38.698922 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:53:38.698887 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:53:41.695456 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:53:41.695417 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:53:44.698426 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:53:44.698390 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:53:47.696142 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:53:47.696104 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:53:50.698434 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:53:50.698403 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:53:53.696700 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:53:53.696651 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:53:56.695612 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:53:56.695522 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:53:59.124214 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:53:59.124171 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:53:59.698057 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:53:59.698023 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:54:00.436151 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:54:00.436107 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:54:02.735752 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:54:02.735713 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:54:05.698316 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:54:05.698287 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:54:08.700071 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:54:08.700035 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:54:11.683082 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:54:11.683049 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:54:14.697781 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:54:14.697746 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:54:17.699610 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:54:17.699533 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:54:20.701689 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:54:20.701594 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:54:23.697681 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:54:23.697642 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:54:26.670154 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:54:26.670122 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:54:29.123762 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:54:29.123721 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:54:29.698813 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:54:29.698781 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:54:32.696901 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:54:32.696864 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:54:35.697546 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:54:35.697511 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:54:38.697679 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:54:38.697634 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:54:41.650861 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:54:41.650832 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:54:44.695589 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:54:44.695557 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:54:47.694502 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:54:47.694473 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:54:50.697407 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:54:50.697381 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:54:53.695965 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:54:53.695929 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:54:56.695876 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:54:56.695820 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:54:59.123975 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:54:59.123937 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:54:59.696590 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:54:59.696559 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:55:00.484033 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:55:00.483993 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:55:02.697548 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:55:02.697512 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:55:05.697741 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:55:05.697713 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:55:08.696323 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:55:08.696288 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:55:11.698959 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:55:11.698909 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:55:14.698557 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:55:14.698523 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:55:17.697205 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:55:17.697174 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:55:20.697747 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:55:20.697718 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:55:23.697645 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:55:23.697612 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:55:26.699224 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:55:26.699125 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:55:29.123050 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:55:29.123015 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:55:29.714357 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:55:29.714325 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:55:32.697068 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:55:32.697040 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:55:35.698532 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:55:35.698499 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:55:38.696441 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:55:38.696408 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:55:41.698541 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:55:41.698515 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:55:44.698070 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:55:44.698042 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:55:47.683879 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:55:47.683839 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:55:50.697814 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:55:50.697784 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:55:53.698082 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:55:53.698050 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:55:56.700021 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:55:56.699983 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:55:59.125433 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:55:59.125398 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:55:59.709274 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:55:59.709243 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:56:00.655352 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:56:00.655302 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:56:02.697728 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:56:02.697643 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:56:05.698087 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:56:05.698056 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:56:08.696236 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:56:08.696200 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:56:11.697328 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:56:11.697296 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:56:14.706995 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:56:14.706961 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:56:17.683038 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:56:17.683006 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:56:20.699648 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:56:20.699611 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:56:23.698308 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:56:23.698272 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:56:26.697732 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:56:26.697704 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:56:29.124053 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:56:29.124008 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:56:29.703376 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:56:29.703247 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:56:32.698571 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:56:32.698535 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:56:35.697107 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:56:35.697075 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:56:38.760595 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:56:38.760556 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:56:41.697624 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:56:41.697597 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:56:44.698025 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:56:44.697989 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:56:47.669092 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:56:47.669009 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:56:50.698787 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:56:50.698750 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:56:52.562924 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:56:52.562880 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:56:53.697266 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:56:53.697232 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:56:56.698236 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:56:56.698150 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:56:59.124041 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:56:59.124000 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:56:59.698127 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:56:59.698097 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:57:00.593540 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:57:00.593487 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:57:02.701086 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:57:02.701050 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:57:05.697736 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:57:05.697702 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:57:08.695789 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:57:08.695745 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:57:11.697014 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:57:11.696982 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:57:14.699452 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:57:14.699404 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:57:17.683603 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:57:17.683560 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:57:20.702683 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:57:20.702640 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:57:23.699430 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:57:23.699402 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:57:26.699504 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:57:26.699446 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:57:29.125651 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:57:29.125610 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:57:29.697688 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:57:29.697641 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:57:32.701736 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:57:32.701702 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:57:35.699573 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:57:35.699541 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:57:38.696708 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:57:38.696675 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:57:41.699157 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:57:41.699118 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:57:44.697276 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:57:44.697242 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:57:47.697386 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:57:47.697350 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:57:50.698242 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:57:50.698207 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:57:53.698013 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:57:53.697974 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:57:56.698169 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:57:56.698134 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:57:59.123686 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:57:59.123631 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:57:59.697504 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:57:59.697473 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:58:00.649273 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:58:00.649238 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:58:02.698511 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:58:02.698484 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:58:05.698937 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:58:05.698907 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:58:08.697072 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:58:08.697039 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:58:11.739134 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:58:11.739107 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:58:14.702712 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:58:14.702654 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:58:17.698921 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:58:17.698884 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:58:20.699291 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:58:20.699260 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:58:23.699526 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:58:23.699490 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:58:26.702730 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:58:26.702611 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:58:29.123797 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:58:29.123758 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:58:29.704531 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:58:29.704498 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:58:32.697606 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:58:32.697563 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:58:35.700255 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:58:35.700221 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:58:38.697358 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:58:38.697325 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:58:41.700484 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:58:41.700453 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:58:44.697043 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:58:44.697009 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:58:47.700025 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:58:47.699987 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:58:47.905619 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:58:47.905576 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:58:50.695896 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:58:50.695864 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:58:53.698748 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:58:53.698714 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:58:56.701139 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:58:56.701108 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:58:59.124205 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:58:59.124167 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:58:59.698250 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:58:59.698219 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:59:00.699345 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:00.699309 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:59:02.698624 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:02.698592 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:59:05.699682 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:05.699632 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:59:08.696584 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:08.696550 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:59:11.701060 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:11.701026 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:59:14.700297 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:14.700265 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:59:17.699233 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:17.699186 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:59:20.699311 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:20.699281 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:59:23.702426 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:23.702393 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:59:26.700580 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:26.700535 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:59:29.124305 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:59:29.124267 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 22:59:29.697215 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:29.697179 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:59:32.702720 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:32.702683 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:59:35.701973 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:35.701946 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:59:38.691694 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:38.690919 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:59:41.706946 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:41.706912 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:59:44.706403 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:44.706356 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:59:47.707505 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:47.707462 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:59:48.420146 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:48.420109 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-m76bb/dw-deployment-pjpbn-58c6ddb979-n7l9r"] Nov 02 22:59:48.420391 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:48.420329 5963 kuberuntime_container.go:898] "Killing container with a grace period" pod="test-ns-m76bb/dw-deployment-pjpbn-58c6ddb979-n7l9r" podUID="45db6093-eea0-45b2-959e-82f3861aef1d" containerName="notebook" containerID="cri-o://0fcc38300f6a47cd7870e68f4d8d87c382bb3da42f952aa257381dd9761c0298" gracePeriod=30 Nov 02 22:59:48.504556 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:48.504523 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-m76bb_dw-deployment-pjpbn-58c6ddb979-n7l9r_45db6093-eea0-45b2-959e-82f3861aef1d/notebook/0.log" Nov 02 22:59:48.651742 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:48.651707 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:59:48.770378 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:48.770281 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:59:48.871864 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:48.871822 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:59:49.046923 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:49.046825 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:59:49.062186 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:49.062157 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-wwjt5/dw-deployment-g85sv-569b85bb76-5lvhl"] Nov 02 22:59:49.062503 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:49.062491 5963 cpu_manager.go:414] "containerMap: removing container" podUID="c93b25ab-4a38-4758-b9a3-a7d326a53de0" containerName="notebook" Nov 02 22:59:49.062553 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:49.062505 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c93b25ab-4a38-4758-b9a3-a7d326a53de0" containerName="notebook" Nov 02 22:59:49.062594 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:49.062582 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="c93b25ab-4a38-4758-b9a3-a7d326a53de0" containerName="notebook" Nov 02 22:59:49.065497 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:49.065482 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-wwjt5/dw-deployment-g85sv-569b85bb76-5lvhl" Nov 02 22:59:49.069610 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:49.069592 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-wwjt5\"/\"default-dockercfg-kp4pt\"" Nov 02 22:59:49.076224 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:49.075508 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-wwjt5\"/\"openshift-service-ca.crt\"" Nov 02 22:59:49.077135 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:49.077095 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-wwjt5/dw-deployment-g85sv-569b85bb76-5lvhl"] Nov 02 22:59:49.077244 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:49.077142 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-wwjt5\"/\"kube-root-ca.crt\"" Nov 02 22:59:49.078164 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:49.078146 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-wwjt5\"/\"config-rcl4m\"" Nov 02 22:59:49.145656 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:49.145623 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:59:49.249081 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:49.249042 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfwtj\" (UniqueName: \"kubernetes.io/projected/3923f732-1209-4240-932d-9f5486329051-kube-api-access-pfwtj\") pod \"dw-deployment-g85sv-569b85bb76-5lvhl\" (UID: \"3923f732-1209-4240-932d-9f5486329051\") " pod="test-ns-wwjt5/dw-deployment-g85sv-569b85bb76-5lvhl" Nov 02 22:59:49.249081 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:49.249085 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-48f631c0-163c-4dd8-8494-aaf60a7ccbb2\" (UniqueName: \"kubernetes.io/nfs/3923f732-1209-4240-932d-9f5486329051-pvc-48f631c0-163c-4dd8-8494-aaf60a7ccbb2\") pod \"dw-deployment-g85sv-569b85bb76-5lvhl\" (UID: \"3923f732-1209-4240-932d-9f5486329051\") " pod="test-ns-wwjt5/dw-deployment-g85sv-569b85bb76-5lvhl" Nov 02 22:59:49.249306 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:49.249165 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/3923f732-1209-4240-932d-9f5486329051-notebook-config\") pod \"dw-deployment-g85sv-569b85bb76-5lvhl\" (UID: \"3923f732-1209-4240-932d-9f5486329051\") " pod="test-ns-wwjt5/dw-deployment-g85sv-569b85bb76-5lvhl" Nov 02 22:59:49.350155 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:49.350120 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-48f631c0-163c-4dd8-8494-aaf60a7ccbb2\" (UniqueName: \"kubernetes.io/nfs/3923f732-1209-4240-932d-9f5486329051-pvc-48f631c0-163c-4dd8-8494-aaf60a7ccbb2\") pod \"dw-deployment-g85sv-569b85bb76-5lvhl\" (UID: \"3923f732-1209-4240-932d-9f5486329051\") " pod="test-ns-wwjt5/dw-deployment-g85sv-569b85bb76-5lvhl" Nov 02 22:59:49.350347 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:49.350168 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/3923f732-1209-4240-932d-9f5486329051-notebook-config\") pod \"dw-deployment-g85sv-569b85bb76-5lvhl\" (UID: \"3923f732-1209-4240-932d-9f5486329051\") " pod="test-ns-wwjt5/dw-deployment-g85sv-569b85bb76-5lvhl" Nov 02 22:59:49.350347 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:49.350244 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfwtj\" (UniqueName: \"kubernetes.io/projected/3923f732-1209-4240-932d-9f5486329051-kube-api-access-pfwtj\") pod \"dw-deployment-g85sv-569b85bb76-5lvhl\" (UID: \"3923f732-1209-4240-932d-9f5486329051\") " pod="test-ns-wwjt5/dw-deployment-g85sv-569b85bb76-5lvhl" Nov 02 22:59:49.351074 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:49.351036 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/3923f732-1209-4240-932d-9f5486329051-notebook-config\") pod \"dw-deployment-g85sv-569b85bb76-5lvhl\" (UID: \"3923f732-1209-4240-932d-9f5486329051\") " pod="test-ns-wwjt5/dw-deployment-g85sv-569b85bb76-5lvhl" Nov 02 22:59:49.363096 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:49.363061 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfwtj\" (UniqueName: \"kubernetes.io/projected/3923f732-1209-4240-932d-9f5486329051-kube-api-access-pfwtj\") pod \"dw-deployment-g85sv-569b85bb76-5lvhl\" (UID: \"3923f732-1209-4240-932d-9f5486329051\") " pod="test-ns-wwjt5/dw-deployment-g85sv-569b85bb76-5lvhl" Nov 02 22:59:49.377599 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:49.377558 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-48f631c0-163c-4dd8-8494-aaf60a7ccbb2\" (UniqueName: \"kubernetes.io/nfs/3923f732-1209-4240-932d-9f5486329051-pvc-48f631c0-163c-4dd8-8494-aaf60a7ccbb2\") pod \"dw-deployment-g85sv-569b85bb76-5lvhl\" (UID: \"3923f732-1209-4240-932d-9f5486329051\") " pod="test-ns-wwjt5/dw-deployment-g85sv-569b85bb76-5lvhl" Nov 02 22:59:49.380764 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:49.380745 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-wwjt5/dw-deployment-g85sv-569b85bb76-5lvhl" Nov 02 22:59:49.654325 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:49.654246 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-wwjt5/dw-deployment-g85sv-569b85bb76-5lvhl"] Nov 02 22:59:49.657747 ip-10-0-139-99 kubenswrapper[5963]: W1102 22:59:49.657720 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3923f732_1209_4240_932d_9f5486329051.slice/crio-16215f336653d28f0b836b0b33abb4b9eb0f06c185bcff6d3a59bc6799851fd9 WatchSource:0}: Error finding container 16215f336653d28f0b836b0b33abb4b9eb0f06c185bcff6d3a59bc6799851fd9: Status 404 returned error can't find the container with id 16215f336653d28f0b836b0b33abb4b9eb0f06c185bcff6d3a59bc6799851fd9 Nov 02 22:59:49.659071 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:49.659055 5963 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 02 22:59:50.267497 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:50.267457 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-wwjt5/dw-deployment-g85sv-569b85bb76-5lvhl" event={"ID":"3923f732-1209-4240-932d-9f5486329051","Type":"ContainerStarted","Data":"92cde0984d3049d9cd748105ae2e295fa2b8d7c72f1f09f4d1286a672e567a8b"} Nov 02 22:59:50.267988 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:50.267525 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-wwjt5/dw-deployment-g85sv-569b85bb76-5lvhl" event={"ID":"3923f732-1209-4240-932d-9f5486329051","Type":"ContainerStarted","Data":"16215f336653d28f0b836b0b33abb4b9eb0f06c185bcff6d3a59bc6799851fd9"} Nov 02 22:59:50.287731 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:50.287681 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-wwjt5/dw-deployment-g85sv-569b85bb76-5lvhl" podStartSLOduration=0.797617487 podStartE2EDuration="1.28764561s" totalImagesPullingTime="490.028123ms" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 22:59:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:59:50.286919867 +0000 UTC m=+3962.538918346" watchObservedRunningTime="2026-11-02 22:59:50.28764561 +0000 UTC m=+3962.539644070" Nov 02 22:59:51.724495 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:51.724467 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 22:59:53.659804 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:53.659753 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:59:54.726374 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:54.726340 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 22:59:57.037388 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:57.037083 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 22:59:57.776116 ip-10-0-139-99 kubenswrapper[5963]: I1102 22:59:57.776078 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 22:59:59.124892 ip-10-0-139-99 kubenswrapper[5963]: E1102 22:59:59.124856 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 23:00:00.777836 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:00.777801 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:00:00.813184 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:00.813138 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:00:03.777014 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:03.776973 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:00:06.761150 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:06.761124 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:00:09.777700 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:09.777645 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:00:12.776438 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:12.776407 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:00:15.777566 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:15.777536 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:00:18.609470 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:18.609443 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-m76bb/dw-deployment-pjpbn-58c6ddb979-n7l9r" Nov 02 23:00:18.700349 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:18.700258 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/45db6093-eea0-45b2-959e-82f3861aef1d-kube-api-access-4q2x8\" (UniqueName: \"kubernetes.io/projected/45db6093-eea0-45b2-959e-82f3861aef1d-kube-api-access-4q2x8\") pod \"45db6093-eea0-45b2-959e-82f3861aef1d\" (UID: \"45db6093-eea0-45b2-959e-82f3861aef1d\") " Nov 02 23:00:18.700349 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:18.700321 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/45db6093-eea0-45b2-959e-82f3861aef1d-notebook-config\" (UniqueName: \"kubernetes.io/configmap/45db6093-eea0-45b2-959e-82f3861aef1d-notebook-config\") pod \"45db6093-eea0-45b2-959e-82f3861aef1d\" (UID: \"45db6093-eea0-45b2-959e-82f3861aef1d\") " Nov 02 23:00:18.700349 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:18.700350 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/nfs/45db6093-eea0-45b2-959e-82f3861aef1d-pvc-a5aa6320-0b91-42ee-9771-4c1ed11f429b\" (UniqueName: \"kubernetes.io/nfs/45db6093-eea0-45b2-959e-82f3861aef1d-pvc-a5aa6320-0b91-42ee-9771-4c1ed11f429b\") pod \"45db6093-eea0-45b2-959e-82f3861aef1d\" (UID: \"45db6093-eea0-45b2-959e-82f3861aef1d\") " Nov 02 23:00:18.700774 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:18.700749 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45db6093-eea0-45b2-959e-82f3861aef1d-notebook-config" pod "45db6093-eea0-45b2-959e-82f3861aef1d" (UID: "45db6093-eea0-45b2-959e-82f3861aef1d"). InnerVolumeSpecName "notebook-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 23:00:18.703288 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:18.703259 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45db6093-eea0-45b2-959e-82f3861aef1d-kube-api-access-4q2x8" pod "45db6093-eea0-45b2-959e-82f3861aef1d" (UID: "45db6093-eea0-45b2-959e-82f3861aef1d"). InnerVolumeSpecName "kube-api-access-4q2x8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 23:00:18.730094 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:18.730058 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/nfs/45db6093-eea0-45b2-959e-82f3861aef1d-pvc-a5aa6320-0b91-42ee-9771-4c1ed11f429b" pod "45db6093-eea0-45b2-959e-82f3861aef1d" (UID: "45db6093-eea0-45b2-959e-82f3861aef1d"). InnerVolumeSpecName "pvc-a5aa6320-0b91-42ee-9771-4c1ed11f429b". PluginName "kubernetes.io/nfs", VolumeGIDValue "" Nov 02 23:00:18.776161 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:18.776135 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:00:18.801977 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:18.801945 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4q2x8\" (UniqueName: \"kubernetes.io/projected/45db6093-eea0-45b2-959e-82f3861aef1d-kube-api-access-4q2x8\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 23:00:18.801977 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:18.801976 5963 reconciler_common.go:299] "Volume detached for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/45db6093-eea0-45b2-959e-82f3861aef1d-notebook-config\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 23:00:18.802148 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:18.801986 5963 reconciler_common.go:299] "Volume detached for volume \"pvc-a5aa6320-0b91-42ee-9771-4c1ed11f429b\" (UniqueName: \"kubernetes.io/nfs/45db6093-eea0-45b2-959e-82f3861aef1d-pvc-a5aa6320-0b91-42ee-9771-4c1ed11f429b\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 23:00:19.389519 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:19.389480 5963 generic.go:356] "Generic (PLEG): container finished" podID="45db6093-eea0-45b2-959e-82f3861aef1d" containerID="0fcc38300f6a47cd7870e68f4d8d87c382bb3da42f952aa257381dd9761c0298" exitCode=137 Nov 02 23:00:19.389519 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:19.389517 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-m76bb/dw-deployment-pjpbn-58c6ddb979-n7l9r" event={"ID":"45db6093-eea0-45b2-959e-82f3861aef1d","Type":"ContainerDied","Data":"0fcc38300f6a47cd7870e68f4d8d87c382bb3da42f952aa257381dd9761c0298"} Nov 02 23:00:19.389799 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:19.389536 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-m76bb/dw-deployment-pjpbn-58c6ddb979-n7l9r" Nov 02 23:00:19.389799 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:19.389560 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-m76bb/dw-deployment-pjpbn-58c6ddb979-n7l9r" event={"ID":"45db6093-eea0-45b2-959e-82f3861aef1d","Type":"ContainerDied","Data":"a8d16e3aa1918187b711170d84d8a6683fe488621f0c007469c603c6401e0d1e"} Nov 02 23:00:19.389799 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:19.389581 5963 scope.go:122] "RemoveContainer" containerID="0fcc38300f6a47cd7870e68f4d8d87c382bb3da42f952aa257381dd9761c0298" Nov 02 23:00:19.409606 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:19.409585 5963 scope.go:122] "RemoveContainer" containerID="0fcc38300f6a47cd7870e68f4d8d87c382bb3da42f952aa257381dd9761c0298" Nov 02 23:00:19.410048 ip-10-0-139-99 kubenswrapper[5963]: E1102 23:00:19.409978 5963 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fcc38300f6a47cd7870e68f4d8d87c382bb3da42f952aa257381dd9761c0298\": container with ID starting with 0fcc38300f6a47cd7870e68f4d8d87c382bb3da42f952aa257381dd9761c0298 not found: ID does not exist" containerID="0fcc38300f6a47cd7870e68f4d8d87c382bb3da42f952aa257381dd9761c0298" Nov 02 23:00:19.410048 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:19.410033 5963 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fcc38300f6a47cd7870e68f4d8d87c382bb3da42f952aa257381dd9761c0298"} err="failed to get container status \"0fcc38300f6a47cd7870e68f4d8d87c382bb3da42f952aa257381dd9761c0298\": rpc error: code = NotFound desc = could not find container \"0fcc38300f6a47cd7870e68f4d8d87c382bb3da42f952aa257381dd9761c0298\": container with ID starting with 0fcc38300f6a47cd7870e68f4d8d87c382bb3da42f952aa257381dd9761c0298 not found: ID does not exist" Nov 02 23:00:19.411005 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:19.410988 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-m76bb/dw-deployment-pjpbn-58c6ddb979-n7l9r"] Nov 02 23:00:19.415493 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:19.415474 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-m76bb/dw-deployment-pjpbn-58c6ddb979-n7l9r"] Nov 02 23:00:19.864099 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:19.864070 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="45db6093-eea0-45b2-959e-82f3861aef1d" path="/var/lib/kubelet/pods/45db6093-eea0-45b2-959e-82f3861aef1d/volumes" Nov 02 23:00:21.746141 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:21.746109 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:00:24.778281 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:24.778237 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:00:27.776554 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:27.776509 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:00:29.124729 ip-10-0-139-99 kubenswrapper[5963]: E1102 23:00:29.124690 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 23:00:30.796527 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:30.796493 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:00:31.015330 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:31.015297 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:00:31.115139 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:31.115098 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:00:31.216166 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:31.216128 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:00:31.373313 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:31.373221 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:00:31.473487 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:31.473418 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:00:31.718336 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:31.718240 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:00:33.777432 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:33.777402 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:00:36.765509 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:36.765468 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:00:37.059260 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:37.059216 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:00:37.151441 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:37.151404 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:00:39.777797 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:39.777758 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:00:42.777209 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:42.777181 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:00:45.777517 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:45.777480 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:00:48.777607 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:48.777572 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:00:51.777399 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:51.777368 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:00:54.777036 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:54.777001 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:00:57.776585 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:00:57.776551 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:00:59.122512 ip-10-0-139-99 kubenswrapper[5963]: E1102 23:00:59.122477 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 23:01:00.780017 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:01:00.779982 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:01:00.804817 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:01:00.804781 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:01:03.777391 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:01:03.776992 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:01:06.778224 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:01:06.778185 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:01:09.780397 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:01:09.780365 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:01:12.777109 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:01:12.777066 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:01:14.785885 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:01:14.785839 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:01:15.782147 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:01:15.782114 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:01:18.156410 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:01:18.156375 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:01:18.250157 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:01:18.250120 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:01:18.778314 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:01:18.778284 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:01:21.778959 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:01:21.778921 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:01:24.777674 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:01:24.777639 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:01:26.287346 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:01:26.287312 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:01:27.747742 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:01:27.747634 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:01:29.125811 ip-10-0-139-99 kubenswrapper[5963]: E1102 23:01:29.125774 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 23:01:30.779417 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:01:30.779384 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:01:33.778776 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:01:33.778744 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:01:36.780654 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:01:36.780614 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:01:39.778092 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:01:39.778065 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:01:42.761343 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:01:42.761312 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:01:45.778902 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:01:45.778869 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:01:48.775780 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:01:48.775744 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:01:51.777649 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:01:51.777615 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:01:54.777399 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:01:54.777357 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:01:57.794454 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:01:57.794421 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:01:59.126020 ip-10-0-139-99 kubenswrapper[5963]: E1102 23:01:59.125984 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 23:02:00.779446 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:02:00.779413 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:02:00.888434 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:02:00.888396 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:02:03.777297 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:02:03.777266 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:02:06.778255 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:02:06.778227 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:02:09.782554 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:02:09.782510 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:02:12.778998 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:02:12.778966 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:02:15.779450 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:02:15.779417 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:02:18.777473 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:02:18.777439 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:02:21.778090 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:02:21.778052 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:02:24.776725 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:02:24.776685 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:02:27.778575 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:02:27.778546 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:02:29.127577 ip-10-0-139-99 kubenswrapper[5963]: E1102 23:02:29.127533 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 23:02:30.777456 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:02:30.777428 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:02:33.762045 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:02:33.762015 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:02:36.779290 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:02:36.779233 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:02:39.777308 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:02:39.777275 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:02:42.778341 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:02:42.778299 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:02:45.777759 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:02:45.777722 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:02:48.748446 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:02:48.748409 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:02:51.780227 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:02:51.780189 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:02:54.777051 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:02:54.777009 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:02:57.781068 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:02:57.780985 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:02:59.123586 ip-10-0-139-99 kubenswrapper[5963]: E1102 23:02:59.123548 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 23:03:00.777924 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:03:00.777813 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:03:00.917382 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:03:00.917343 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:03:03.778173 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:03:03.778137 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:03:06.780039 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:03:06.780005 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:03:09.778942 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:03:09.778908 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:03:12.779640 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:03:12.779606 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:03:15.779034 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:03:15.779000 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:03:18.779432 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:03:18.779397 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:03:21.780467 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:03:21.780436 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:03:24.783144 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:03:24.783112 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:03:27.790726 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:03:27.790690 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:03:29.124446 ip-10-0-139-99 kubenswrapper[5963]: E1102 23:03:29.124409 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 23:03:30.777714 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:03:30.777684 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:03:33.780156 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:03:33.780118 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:03:36.779644 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:03:36.779612 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:03:39.760224 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:03:39.760189 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:03:42.779566 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:03:42.779532 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:03:45.776778 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:03:45.776745 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:03:48.776675 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:03:48.776640 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:03:51.777517 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:03:51.777487 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:03:54.750644 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:03:54.750610 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:03:57.777878 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:03:57.777846 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:03:59.124626 ip-10-0-139-99 kubenswrapper[5963]: E1102 23:03:59.124586 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 23:04:00.782677 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:04:00.782632 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:04:00.974059 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:04:00.974022 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:04:03.778981 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:04:03.778954 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:04:06.777299 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:04:06.777257 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:04:09.778979 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:04:09.778948 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:04:12.777490 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:04:12.777459 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:04:15.777411 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:04:15.777380 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:04:18.778816 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:04:18.778787 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:04:21.779728 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:04:21.779694 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:04:24.778773 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:04:24.778732 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:04:27.779899 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:04:27.779823 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:04:29.123360 ip-10-0-139-99 kubenswrapper[5963]: E1102 23:04:29.123319 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 23:04:30.779637 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:04:30.779596 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:04:33.779745 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:04:33.779715 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:04:35.601233 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:04:35.601198 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:04:36.777625 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:04:36.777596 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:04:39.778133 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:04:39.778092 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:04:42.777989 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:04:42.777958 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:04:45.781177 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:04:45.781136 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:04:48.781266 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:04:48.781230 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:04:51.777946 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:04:51.777912 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:04:54.778594 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:04:54.778557 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:04:57.777290 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:04:57.777240 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:04:59.122982 ip-10-0-139-99 kubenswrapper[5963]: E1102 23:04:59.122943 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 23:05:00.779786 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:05:00.779750 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:05:01.026726 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:05:01.026651 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:05:03.776698 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:05:03.776654 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:05:06.777192 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:05:06.777157 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:05:09.778089 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:05:09.778058 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:05:12.779476 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:05:12.779447 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:05:15.777041 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:05:15.777006 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:05:18.779144 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:05:18.779109 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:05:21.778705 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:05:21.778672 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:05:24.779838 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:05:24.779803 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:05:27.780511 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:05:27.780474 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:05:29.123291 ip-10-0-139-99 kubenswrapper[5963]: E1102 23:05:29.123242 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 23:05:30.778826 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:05:30.778793 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:05:33.786537 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:05:33.786503 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:05:36.778932 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:05:36.778894 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:05:39.780252 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:05:39.780221 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:05:42.778911 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:05:42.778880 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:05:45.777626 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:05:45.777583 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:05:48.778443 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:05:48.778416 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:05:51.781543 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:05:51.781506 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:05:54.779209 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:05:54.779176 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:05:57.776566 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:05:57.776451 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:05:59.122214 ip-10-0-139-99 kubenswrapper[5963]: E1102 23:05:59.122176 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 23:06:00.778363 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:06:00.778326 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:06:01.085243 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:06:01.085212 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:06:03.779282 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:06:03.779239 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:06:06.777164 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:06:06.777119 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:06:09.779252 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:06:09.779213 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:06:12.779553 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:06:12.779515 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:06:15.778475 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:06:15.778445 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:06:18.778885 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:06:18.778851 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:06:21.778222 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:06:21.778191 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:06:24.780453 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:06:24.780421 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:06:27.778162 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:06:27.778123 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:06:29.122982 ip-10-0-139-99 kubenswrapper[5963]: E1102 23:06:29.122937 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 23:06:30.778484 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:06:30.778448 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:06:33.781047 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:06:33.781011 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:06:36.776903 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:06:36.776872 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:06:39.780239 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:06:39.780173 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:06:42.779912 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:06:42.779873 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:06:45.761977 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:06:45.761945 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:06:48.779702 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:06:48.779655 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:06:51.778496 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:06:51.778458 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:06:54.781147 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:06:54.781110 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:06:57.778153 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:06:57.778122 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:06:59.122809 ip-10-0-139-99 kubenswrapper[5963]: E1102 23:06:59.122772 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 23:07:00.779366 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:07:00.779336 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:07:01.138046 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:07:01.138006 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:07:03.781333 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:07:03.781292 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:07:06.777562 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:07:06.777530 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:07:09.780936 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:07:09.780898 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:07:12.780832 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:07:12.780799 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:07:15.749236 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:07:15.749206 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:07:18.779656 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:07:18.779619 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:07:21.780211 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:07:21.780164 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:07:24.780637 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:07:24.780600 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:07:27.809989 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:07:27.809899 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:07:29.123882 ip-10-0-139-99 kubenswrapper[5963]: E1102 23:07:29.123839 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 23:07:30.780082 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:07:30.780050 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:07:33.784596 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:07:33.784555 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:07:36.779187 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:07:36.779147 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:07:39.780354 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:07:39.780309 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:07:42.780098 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:07:42.780065 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:07:45.751452 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:07:45.751411 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:07:48.779840 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:07:48.779805 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:07:51.780780 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:07:51.780738 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:07:54.780215 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:07:54.780179 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:07:57.778009 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:07:57.777955 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:07:59.123611 ip-10-0-139-99 kubenswrapper[5963]: E1102 23:07:59.123573 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 23:08:00.120272 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:08:00.120223 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:08:00.779849 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:08:00.779733 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:08:01.186717 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:08:01.186657 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:08:03.780133 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:08:03.780101 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:08:06.778953 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:08:06.778915 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:08:09.783083 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:08:09.783044 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:08:12.780525 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:08:12.780490 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:08:15.779384 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:08:15.779353 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:08:18.778837 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:08:18.778809 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:08:21.778525 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:08:21.778492 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:08:24.779807 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:08:24.779778 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:08:27.790415 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:08:27.790382 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:08:29.123223 ip-10-0-139-99 kubenswrapper[5963]: E1102 23:08:29.123186 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 23:08:30.780923 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:08:30.780892 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:08:33.779606 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:08:33.779567 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:08:36.778787 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:08:36.778755 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:08:39.779296 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:08:39.779261 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:08:42.786071 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:08:42.786033 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:08:45.786613 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:08:45.786581 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:08:46.029591 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:08:46.029551 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-wwjt5/dw-deployment-g85sv-569b85bb76-5lvhl"] Nov 02 23:08:46.029870 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:08:46.029833 5963 kuberuntime_container.go:898] "Killing container with a grace period" pod="test-ns-wwjt5/dw-deployment-g85sv-569b85bb76-5lvhl" podUID="3923f732-1209-4240-932d-9f5486329051" containerName="notebook" containerID="cri-o://92cde0984d3049d9cd748105ae2e295fa2b8d7c72f1f09f4d1286a672e567a8b" gracePeriod=30 Nov 02 23:08:47.242132 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:08:47.242089 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wwjt5_dw-deployment-g85sv-569b85bb76-5lvhl_3923f732-1209-4240-932d-9f5486329051/notebook/0.log" Nov 02 23:08:47.344147 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:08:47.344114 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:08:47.462571 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:08:47.462523 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:08:47.660170 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:08:47.660132 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:08:48.017245 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:08:48.017141 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:08:52.417187 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:08:52.417137 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:08:59.123804 ip-10-0-139-99 kubenswrapper[5963]: E1102 23:08:59.123718 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 23:09:01.247685 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:01.247630 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:09:12.098822 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:12.098791 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-hw8fl/test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9"] Nov 02 23:09:12.099357 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:12.099120 5963 cpu_manager.go:414] "containerMap: removing container" podUID="45db6093-eea0-45b2-959e-82f3861aef1d" containerName="notebook" Nov 02 23:09:12.099357 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:12.099131 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="45db6093-eea0-45b2-959e-82f3861aef1d" containerName="notebook" Nov 02 23:09:12.099357 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:12.099214 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="45db6093-eea0-45b2-959e-82f3861aef1d" containerName="notebook" Nov 02 23:09:12.102236 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:12.102212 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-hw8fl/test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9" Nov 02 23:09:12.113132 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:12.113108 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-hw8fl/test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9"] Nov 02 23:09:12.177820 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:12.177791 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-hw8fl\"/\"kube-root-ca.crt\"" Nov 02 23:09:12.178033 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:12.177864 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-hw8fl\"/\"openshift-service-ca.crt\"" Nov 02 23:09:12.178033 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:12.177954 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-hw8fl\"/\"default-dockercfg-n5z5r\"" Nov 02 23:09:12.178033 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:12.177985 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-hw8fl\"/\"config-4bv52\"" Nov 02 23:09:12.192326 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:12.192304 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kprfr\" (UniqueName: \"kubernetes.io/projected/e7496e10-5602-469c-9641-3f41f1fcdc5e-kube-api-access-kprfr\") pod \"test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9\" (UID: \"e7496e10-5602-469c-9641-3f41f1fcdc5e\") " pod="test-ns-hw8fl/test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9" Nov 02 23:09:12.192401 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:12.192334 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7496e10-5602-469c-9641-3f41f1fcdc5e-dshm\") pod \"test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9\" (UID: \"e7496e10-5602-469c-9641-3f41f1fcdc5e\") " pod="test-ns-hw8fl/test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9" Nov 02 23:09:12.192401 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:12.192360 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"training-scripts\" (UniqueName: \"kubernetes.io/configmap/e7496e10-5602-469c-9641-3f41f1fcdc5e-training-scripts\") pod \"test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9\" (UID: \"e7496e10-5602-469c-9641-3f41f1fcdc5e\") " pod="test-ns-hw8fl/test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9" Nov 02 23:09:12.192519 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:12.192488 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-65d6e616-3c41-4408-952f-4afd75f421fa\" (UniqueName: \"kubernetes.io/nfs/e7496e10-5602-469c-9641-3f41f1fcdc5e-pvc-65d6e616-3c41-4408-952f-4afd75f421fa\") pod \"test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9\" (UID: \"e7496e10-5602-469c-9641-3f41f1fcdc5e\") " pod="test-ns-hw8fl/test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9" Nov 02 23:09:12.293496 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:12.293461 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kprfr\" (UniqueName: \"kubernetes.io/projected/e7496e10-5602-469c-9641-3f41f1fcdc5e-kube-api-access-kprfr\") pod \"test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9\" (UID: \"e7496e10-5602-469c-9641-3f41f1fcdc5e\") " pod="test-ns-hw8fl/test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9" Nov 02 23:09:12.293736 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:12.293508 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7496e10-5602-469c-9641-3f41f1fcdc5e-dshm\") pod \"test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9\" (UID: \"e7496e10-5602-469c-9641-3f41f1fcdc5e\") " pod="test-ns-hw8fl/test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9" Nov 02 23:09:12.293736 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:12.293556 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"training-scripts\" (UniqueName: \"kubernetes.io/configmap/e7496e10-5602-469c-9641-3f41f1fcdc5e-training-scripts\") pod \"test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9\" (UID: \"e7496e10-5602-469c-9641-3f41f1fcdc5e\") " pod="test-ns-hw8fl/test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9" Nov 02 23:09:12.293736 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:12.293602 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-65d6e616-3c41-4408-952f-4afd75f421fa\" (UniqueName: \"kubernetes.io/nfs/e7496e10-5602-469c-9641-3f41f1fcdc5e-pvc-65d6e616-3c41-4408-952f-4afd75f421fa\") pod \"test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9\" (UID: \"e7496e10-5602-469c-9641-3f41f1fcdc5e\") " pod="test-ns-hw8fl/test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9" Nov 02 23:09:12.294489 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:12.294462 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"training-scripts\" (UniqueName: \"kubernetes.io/configmap/e7496e10-5602-469c-9641-3f41f1fcdc5e-training-scripts\") pod \"test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9\" (UID: \"e7496e10-5602-469c-9641-3f41f1fcdc5e\") " pod="test-ns-hw8fl/test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9" Nov 02 23:09:12.295927 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:12.295904 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7496e10-5602-469c-9641-3f41f1fcdc5e-dshm\") pod \"test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9\" (UID: \"e7496e10-5602-469c-9641-3f41f1fcdc5e\") " pod="test-ns-hw8fl/test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9" Nov 02 23:09:12.306546 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:12.306520 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kprfr\" (UniqueName: \"kubernetes.io/projected/e7496e10-5602-469c-9641-3f41f1fcdc5e-kube-api-access-kprfr\") pod \"test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9\" (UID: \"e7496e10-5602-469c-9641-3f41f1fcdc5e\") " pod="test-ns-hw8fl/test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9" Nov 02 23:09:12.321643 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:12.321614 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-65d6e616-3c41-4408-952f-4afd75f421fa\" (UniqueName: \"kubernetes.io/nfs/e7496e10-5602-469c-9641-3f41f1fcdc5e-pvc-65d6e616-3c41-4408-952f-4afd75f421fa\") pod \"test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9\" (UID: \"e7496e10-5602-469c-9641-3f41f1fcdc5e\") " pod="test-ns-hw8fl/test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9" Nov 02 23:09:12.415048 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:12.414957 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-hw8fl/test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9" Nov 02 23:09:12.691514 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:12.691434 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-hw8fl/test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9"] Nov 02 23:09:12.694457 ip-10-0-139-99 kubenswrapper[5963]: W1102 23:09:12.694424 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7496e10_5602_469c_9641_3f41f1fcdc5e.slice/crio-d2026b5eefe14b870e8ee3bcd620fa9e32c937e976879a7c712d912603eec65e WatchSource:0}: Error finding container d2026b5eefe14b870e8ee3bcd620fa9e32c937e976879a7c712d912603eec65e: Status 404 returned error can't find the container with id d2026b5eefe14b870e8ee3bcd620fa9e32c937e976879a7c712d912603eec65e Nov 02 23:09:13.419803 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:13.419764 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-hw8fl/test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9" event={"ID":"e7496e10-5602-469c-9641-3f41f1fcdc5e","Type":"ContainerStarted","Data":"15ada0af49423cd483439cf9394b4830f8f351987df915496d6ce40c578c0844"} Nov 02 23:09:13.420197 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:13.419832 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-hw8fl/test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9" event={"ID":"e7496e10-5602-469c-9641-3f41f1fcdc5e","Type":"ContainerStarted","Data":"d2026b5eefe14b870e8ee3bcd620fa9e32c937e976879a7c712d912603eec65e"} Nov 02 23:09:13.440986 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:13.440931 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-hw8fl/test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9" podStartSLOduration=1.4409180670000001 podStartE2EDuration="1.440918067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 23:09:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 23:09:13.44047843 +0000 UTC m=+4525.692476899" watchObservedRunningTime="2026-11-02 23:09:13.440918067 +0000 UTC m=+4525.692916533" Nov 02 23:09:14.482250 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:14.482217 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hw8fl_test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9_e7496e10-5602-469c-9641-3f41f1fcdc5e/node/0.log" Nov 02 23:09:16.239186 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:16.239158 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-wwjt5/dw-deployment-g85sv-569b85bb76-5lvhl" Nov 02 23:09:16.326963 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:16.326920 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3923f732-1209-4240-932d-9f5486329051-notebook-config\" (UniqueName: \"kubernetes.io/configmap/3923f732-1209-4240-932d-9f5486329051-notebook-config\") pod \"3923f732-1209-4240-932d-9f5486329051\" (UID: \"3923f732-1209-4240-932d-9f5486329051\") " Nov 02 23:09:16.327170 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:16.326974 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/nfs/3923f732-1209-4240-932d-9f5486329051-pvc-48f631c0-163c-4dd8-8494-aaf60a7ccbb2\" (UniqueName: \"kubernetes.io/nfs/3923f732-1209-4240-932d-9f5486329051-pvc-48f631c0-163c-4dd8-8494-aaf60a7ccbb2\") pod \"3923f732-1209-4240-932d-9f5486329051\" (UID: \"3923f732-1209-4240-932d-9f5486329051\") " Nov 02 23:09:16.327170 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:16.327080 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3923f732-1209-4240-932d-9f5486329051-kube-api-access-pfwtj\" (UniqueName: \"kubernetes.io/projected/3923f732-1209-4240-932d-9f5486329051-kube-api-access-pfwtj\") pod \"3923f732-1209-4240-932d-9f5486329051\" (UID: \"3923f732-1209-4240-932d-9f5486329051\") " Nov 02 23:09:16.327375 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:16.327341 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3923f732-1209-4240-932d-9f5486329051-notebook-config" pod "3923f732-1209-4240-932d-9f5486329051" (UID: "3923f732-1209-4240-932d-9f5486329051"). InnerVolumeSpecName "notebook-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 23:09:16.329642 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:16.329612 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3923f732-1209-4240-932d-9f5486329051-kube-api-access-pfwtj" pod "3923f732-1209-4240-932d-9f5486329051" (UID: "3923f732-1209-4240-932d-9f5486329051"). InnerVolumeSpecName "kube-api-access-pfwtj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 23:09:16.345963 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:16.345933 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/nfs/3923f732-1209-4240-932d-9f5486329051-pvc-48f631c0-163c-4dd8-8494-aaf60a7ccbb2" pod "3923f732-1209-4240-932d-9f5486329051" (UID: "3923f732-1209-4240-932d-9f5486329051"). InnerVolumeSpecName "pvc-48f631c0-163c-4dd8-8494-aaf60a7ccbb2". PluginName "kubernetes.io/nfs", VolumeGIDValue "" Nov 02 23:09:16.428479 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:16.428426 5963 reconciler_common.go:299] "Volume detached for volume \"notebook-config\" (UniqueName: \"kubernetes.io/configmap/3923f732-1209-4240-932d-9f5486329051-notebook-config\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 23:09:16.428479 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:16.428458 5963 reconciler_common.go:299] "Volume detached for volume \"pvc-48f631c0-163c-4dd8-8494-aaf60a7ccbb2\" (UniqueName: \"kubernetes.io/nfs/3923f732-1209-4240-932d-9f5486329051-pvc-48f631c0-163c-4dd8-8494-aaf60a7ccbb2\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 23:09:16.428479 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:16.428469 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pfwtj\" (UniqueName: \"kubernetes.io/projected/3923f732-1209-4240-932d-9f5486329051-kube-api-access-pfwtj\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 23:09:16.436490 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:16.436451 5963 generic.go:356] "Generic (PLEG): container finished" podID="3923f732-1209-4240-932d-9f5486329051" containerID="92cde0984d3049d9cd748105ae2e295fa2b8d7c72f1f09f4d1286a672e567a8b" exitCode=137 Nov 02 23:09:16.436641 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:16.436497 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-wwjt5/dw-deployment-g85sv-569b85bb76-5lvhl" Nov 02 23:09:16.436641 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:16.436515 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-wwjt5/dw-deployment-g85sv-569b85bb76-5lvhl" event={"ID":"3923f732-1209-4240-932d-9f5486329051","Type":"ContainerDied","Data":"92cde0984d3049d9cd748105ae2e295fa2b8d7c72f1f09f4d1286a672e567a8b"} Nov 02 23:09:16.436641 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:16.436574 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-wwjt5/dw-deployment-g85sv-569b85bb76-5lvhl" event={"ID":"3923f732-1209-4240-932d-9f5486329051","Type":"ContainerDied","Data":"16215f336653d28f0b836b0b33abb4b9eb0f06c185bcff6d3a59bc6799851fd9"} Nov 02 23:09:16.436641 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:16.436608 5963 scope.go:122] "RemoveContainer" containerID="92cde0984d3049d9cd748105ae2e295fa2b8d7c72f1f09f4d1286a672e567a8b" Nov 02 23:09:16.458981 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:16.458951 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-wwjt5/dw-deployment-g85sv-569b85bb76-5lvhl"] Nov 02 23:09:16.461119 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:16.461095 5963 scope.go:122] "RemoveContainer" containerID="92cde0984d3049d9cd748105ae2e295fa2b8d7c72f1f09f4d1286a672e567a8b" Nov 02 23:09:16.461476 ip-10-0-139-99 kubenswrapper[5963]: E1102 23:09:16.461441 5963 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92cde0984d3049d9cd748105ae2e295fa2b8d7c72f1f09f4d1286a672e567a8b\": container with ID starting with 92cde0984d3049d9cd748105ae2e295fa2b8d7c72f1f09f4d1286a672e567a8b not found: ID does not exist" containerID="92cde0984d3049d9cd748105ae2e295fa2b8d7c72f1f09f4d1286a672e567a8b" Nov 02 23:09:16.461579 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:16.461482 5963 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92cde0984d3049d9cd748105ae2e295fa2b8d7c72f1f09f4d1286a672e567a8b"} err="failed to get container status \"92cde0984d3049d9cd748105ae2e295fa2b8d7c72f1f09f4d1286a672e567a8b\": rpc error: code = NotFound desc = could not find container \"92cde0984d3049d9cd748105ae2e295fa2b8d7c72f1f09f4d1286a672e567a8b\": container with ID starting with 92cde0984d3049d9cd748105ae2e295fa2b8d7c72f1f09f4d1286a672e567a8b not found: ID does not exist" Nov 02 23:09:16.463836 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:16.463814 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-wwjt5/dw-deployment-g85sv-569b85bb76-5lvhl"] Nov 02 23:09:17.481424 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:17.481384 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hw8fl_test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9_e7496e10-5602-469c-9641-3f41f1fcdc5e/node/0.log" Nov 02 23:09:17.865322 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:17.865279 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3923f732-1209-4240-932d-9f5486329051" path="/var/lib/kubelet/pods/3923f732-1209-4240-932d-9f5486329051/volumes" Nov 02 23:09:20.481059 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:20.481031 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hw8fl_test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9_e7496e10-5602-469c-9641-3f41f1fcdc5e/node/0.log" Nov 02 23:09:23.481171 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:23.481129 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hw8fl_test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9_e7496e10-5602-469c-9641-3f41f1fcdc5e/node/0.log" Nov 02 23:09:26.483519 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:26.483480 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hw8fl_test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9_e7496e10-5602-469c-9641-3f41f1fcdc5e/node/0.log" Nov 02 23:09:29.127998 ip-10-0-139-99 kubenswrapper[5963]: E1102 23:09:29.127957 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 23:09:29.541320 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:29.541235 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hw8fl_test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9_e7496e10-5602-469c-9641-3f41f1fcdc5e/node/0.log" Nov 02 23:09:29.744892 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:29.744852 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:09:30.877933 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:30.877892 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:09:32.484150 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:32.484117 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hw8fl_test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9_e7496e10-5602-469c-9641-3f41f1fcdc5e/node/0.log" Nov 02 23:09:35.482598 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:35.482559 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hw8fl_test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9_e7496e10-5602-469c-9641-3f41f1fcdc5e/node/0.log" Nov 02 23:09:35.858474 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:35.858423 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:09:35.957895 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:35.957858 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:09:38.479407 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:38.479368 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hw8fl_test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9_e7496e10-5602-469c-9641-3f41f1fcdc5e/node/0.log" Nov 02 23:09:41.481733 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:41.481697 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hw8fl_test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9_e7496e10-5602-469c-9641-3f41f1fcdc5e/node/0.log" Nov 02 23:09:44.481542 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:44.481498 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hw8fl_test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9_e7496e10-5602-469c-9641-3f41f1fcdc5e/node/0.log" Nov 02 23:09:47.483651 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:47.483614 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hw8fl_test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9_e7496e10-5602-469c-9641-3f41f1fcdc5e/node/0.log" Nov 02 23:09:50.483680 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:50.483629 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hw8fl_test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9_e7496e10-5602-469c-9641-3f41f1fcdc5e/node/0.log" Nov 02 23:09:53.489022 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:53.488987 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hw8fl_test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9_e7496e10-5602-469c-9641-3f41f1fcdc5e/node/0.log" Nov 02 23:09:55.636038 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:55.636008 5963 generic.go:356] "Generic (PLEG): container finished" podID="e7496e10-5602-469c-9641-3f41f1fcdc5e" containerID="15ada0af49423cd483439cf9394b4830f8f351987df915496d6ce40c578c0844" exitCode=0 Nov 02 23:09:55.636523 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:55.636050 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-hw8fl/test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9" event={"ID":"e7496e10-5602-469c-9641-3f41f1fcdc5e","Type":"ContainerDied","Data":"15ada0af49423cd483439cf9394b4830f8f351987df915496d6ce40c578c0844"} Nov 02 23:09:56.479357 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:56.479270 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hw8fl_test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9_e7496e10-5602-469c-9641-3f41f1fcdc5e/node/0.log" Nov 02 23:09:56.765236 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:56.765214 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-hw8fl/test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9" Nov 02 23:09:56.827901 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:56.827870 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e7496e10-5602-469c-9641-3f41f1fcdc5e-kube-api-access-kprfr\" (UniqueName: \"kubernetes.io/projected/e7496e10-5602-469c-9641-3f41f1fcdc5e-kube-api-access-kprfr\") pod \"e7496e10-5602-469c-9641-3f41f1fcdc5e\" (UID: \"e7496e10-5602-469c-9641-3f41f1fcdc5e\") " Nov 02 23:09:56.828047 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:56.827918 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/nfs/e7496e10-5602-469c-9641-3f41f1fcdc5e-pvc-65d6e616-3c41-4408-952f-4afd75f421fa\" (UniqueName: \"kubernetes.io/nfs/e7496e10-5602-469c-9641-3f41f1fcdc5e-pvc-65d6e616-3c41-4408-952f-4afd75f421fa\") pod \"e7496e10-5602-469c-9641-3f41f1fcdc5e\" (UID: \"e7496e10-5602-469c-9641-3f41f1fcdc5e\") " Nov 02 23:09:56.828047 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:56.827951 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e7496e10-5602-469c-9641-3f41f1fcdc5e-training-scripts\" (UniqueName: \"kubernetes.io/configmap/e7496e10-5602-469c-9641-3f41f1fcdc5e-training-scripts\") pod \"e7496e10-5602-469c-9641-3f41f1fcdc5e\" (UID: \"e7496e10-5602-469c-9641-3f41f1fcdc5e\") " Nov 02 23:09:56.828047 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:56.827971 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e7496e10-5602-469c-9641-3f41f1fcdc5e-dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7496e10-5602-469c-9641-3f41f1fcdc5e-dshm\") pod \"e7496e10-5602-469c-9641-3f41f1fcdc5e\" (UID: \"e7496e10-5602-469c-9641-3f41f1fcdc5e\") " Nov 02 23:09:56.828364 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:56.828336 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7496e10-5602-469c-9641-3f41f1fcdc5e-training-scripts" pod "e7496e10-5602-469c-9641-3f41f1fcdc5e" (UID: "e7496e10-5602-469c-9641-3f41f1fcdc5e"). InnerVolumeSpecName "training-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 23:09:56.830273 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:56.830245 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7496e10-5602-469c-9641-3f41f1fcdc5e-dshm" pod "e7496e10-5602-469c-9641-3f41f1fcdc5e" (UID: "e7496e10-5602-469c-9641-3f41f1fcdc5e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 23:09:56.830273 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:56.830257 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7496e10-5602-469c-9641-3f41f1fcdc5e-kube-api-access-kprfr" pod "e7496e10-5602-469c-9641-3f41f1fcdc5e" (UID: "e7496e10-5602-469c-9641-3f41f1fcdc5e"). InnerVolumeSpecName "kube-api-access-kprfr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 23:09:56.858521 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:56.858493 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/nfs/e7496e10-5602-469c-9641-3f41f1fcdc5e-pvc-65d6e616-3c41-4408-952f-4afd75f421fa" pod "e7496e10-5602-469c-9641-3f41f1fcdc5e" (UID: "e7496e10-5602-469c-9641-3f41f1fcdc5e"). InnerVolumeSpecName "pvc-65d6e616-3c41-4408-952f-4afd75f421fa". PluginName "kubernetes.io/nfs", VolumeGIDValue "" Nov 02 23:09:56.929010 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:56.928977 5963 reconciler_common.go:299] "Volume detached for volume \"pvc-65d6e616-3c41-4408-952f-4afd75f421fa\" (UniqueName: \"kubernetes.io/nfs/e7496e10-5602-469c-9641-3f41f1fcdc5e-pvc-65d6e616-3c41-4408-952f-4afd75f421fa\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 23:09:56.929010 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:56.929007 5963 reconciler_common.go:299] "Volume detached for volume \"training-scripts\" (UniqueName: \"kubernetes.io/configmap/e7496e10-5602-469c-9641-3f41f1fcdc5e-training-scripts\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 23:09:56.929218 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:56.929021 5963 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7496e10-5602-469c-9641-3f41f1fcdc5e-dshm\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 23:09:56.929218 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:56.929034 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kprfr\" (UniqueName: \"kubernetes.io/projected/e7496e10-5602-469c-9641-3f41f1fcdc5e-kube-api-access-kprfr\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 23:09:57.645254 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:57.645217 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-hw8fl/test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9" event={"ID":"e7496e10-5602-469c-9641-3f41f1fcdc5e","Type":"ContainerDied","Data":"d2026b5eefe14b870e8ee3bcd620fa9e32c937e976879a7c712d912603eec65e"} Nov 02 23:09:57.645254 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:57.645254 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-hw8fl/test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9" Nov 02 23:09:57.645472 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:57.645271 5963 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d2026b5eefe14b870e8ee3bcd620fa9e32c937e976879a7c712d912603eec65e" Nov 02 23:09:58.131546 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:58.131518 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-hw8fl_test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9_e7496e10-5602-469c-9641-3f41f1fcdc5e/node/0.log" Nov 02 23:09:58.242366 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:58.242330 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:09:58.348006 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:58.347973 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:09:58.448827 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:58.448723 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:09:59.122098 ip-10-0-139-99 kubenswrapper[5963]: E1102 23:09:59.122060 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 23:09:59.445584 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:09:59.445503 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:10:00.391612 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:00.391578 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:10:00.425767 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:00.425733 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-f46lf/trainer-netpol-curl-qknx8"] Nov 02 23:10:00.426093 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:00.426079 5963 cpu_manager.go:414] "containerMap: removing container" podUID="e7496e10-5602-469c-9641-3f41f1fcdc5e" containerName="node" Nov 02 23:10:00.426133 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:00.426095 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e7496e10-5602-469c-9641-3f41f1fcdc5e" containerName="node" Nov 02 23:10:00.426133 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:00.426116 5963 cpu_manager.go:414] "containerMap: removing container" podUID="3923f732-1209-4240-932d-9f5486329051" containerName="notebook" Nov 02 23:10:00.426133 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:00.426120 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3923f732-1209-4240-932d-9f5486329051" containerName="notebook" Nov 02 23:10:00.426225 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:00.426174 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="3923f732-1209-4240-932d-9f5486329051" containerName="notebook" Nov 02 23:10:00.426225 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:00.426186 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="e7496e10-5602-469c-9641-3f41f1fcdc5e" containerName="node" Nov 02 23:10:00.429074 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:00.429059 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-f46lf/trainer-netpol-curl-qknx8" Nov 02 23:10:00.439182 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:00.439156 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-f46lf\"/\"openshift-service-ca.crt\"" Nov 02 23:10:00.439478 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:00.439460 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-f46lf\"/\"kube-root-ca.crt\"" Nov 02 23:10:00.439578 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:00.439465 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-f46lf\"/\"default-dockercfg-72pkb\"" Nov 02 23:10:00.440794 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:00.440772 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-f46lf/trainer-netpol-curl-qknx8"] Nov 02 23:10:00.460066 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:00.460045 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq9zz\" (UniqueName: \"kubernetes.io/projected/f92bc8d3-0829-4297-9d95-8fde80ea152f-kube-api-access-kq9zz\") pod \"trainer-netpol-curl-qknx8\" (UID: \"f92bc8d3-0829-4297-9d95-8fde80ea152f\") " pod="test-ns-f46lf/trainer-netpol-curl-qknx8" Nov 02 23:10:00.491403 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:00.491374 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:10:00.560967 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:00.560941 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq9zz\" (UniqueName: \"kubernetes.io/projected/f92bc8d3-0829-4297-9d95-8fde80ea152f-kube-api-access-kq9zz\") pod \"trainer-netpol-curl-qknx8\" (UID: \"f92bc8d3-0829-4297-9d95-8fde80ea152f\") " pod="test-ns-f46lf/trainer-netpol-curl-qknx8" Nov 02 23:10:00.573596 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:00.573570 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq9zz\" (UniqueName: \"kubernetes.io/projected/f92bc8d3-0829-4297-9d95-8fde80ea152f-kube-api-access-kq9zz\") pod \"trainer-netpol-curl-qknx8\" (UID: \"f92bc8d3-0829-4297-9d95-8fde80ea152f\") " pod="test-ns-f46lf/trainer-netpol-curl-qknx8" Nov 02 23:10:00.747954 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:00.747873 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-f46lf/trainer-netpol-curl-qknx8" Nov 02 23:10:01.018566 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:01.018495 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-f46lf/trainer-netpol-curl-qknx8"] Nov 02 23:10:01.022193 ip-10-0-139-99 kubenswrapper[5963]: W1102 23:10:01.022162 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf92bc8d3_0829_4297_9d95_8fde80ea152f.slice/crio-78614a4ad54818c5d066d65acf2b8797014b5da1dd79ea93bf8427ce2b36e620 WatchSource:0}: Error finding container 78614a4ad54818c5d066d65acf2b8797014b5da1dd79ea93bf8427ce2b36e620: Status 404 returned error can't find the container with id 78614a4ad54818c5d066d65acf2b8797014b5da1dd79ea93bf8427ce2b36e620 Nov 02 23:10:01.024064 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:01.024046 5963 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 02 23:10:01.300431 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:01.300340 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:10:01.663016 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:01.662984 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-f46lf/trainer-netpol-curl-qknx8" event={"ID":"f92bc8d3-0829-4297-9d95-8fde80ea152f","Type":"ContainerStarted","Data":"78614a4ad54818c5d066d65acf2b8797014b5da1dd79ea93bf8427ce2b36e620"} Nov 02 23:10:03.213080 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:03.213039 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-hw8fl/test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9"] Nov 02 23:10:03.217114 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:03.217088 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-hw8fl/test-fashion-mnist-trainjob-z2d5d-node-0-1-q8mk9"] Nov 02 23:10:03.589462 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:03.589427 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:10:03.688458 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:03.688409 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:10:03.863435 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:03.863353 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e7496e10-5602-469c-9641-3f41f1fcdc5e" path="/var/lib/kubelet/pods/e7496e10-5602-469c-9641-3f41f1fcdc5e/volumes" Nov 02 23:10:04.078645 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:04.078605 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:10:04.797903 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:04.797871 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:10:05.387224 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:05.387194 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:10:05.681707 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:05.681591 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-f46lf/trainer-netpol-curl-qknx8" event={"ID":"f92bc8d3-0829-4297-9d95-8fde80ea152f","Type":"ContainerStarted","Data":"e6f73d19f20ad1cb1a6e90a4dd1a8faea694a29828f20ea5e9695fd80f314f67"} Nov 02 23:10:05.698313 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:05.698265 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-f46lf/trainer-netpol-curl-qknx8" podStartSLOduration=1.35899333 podStartE2EDuration="5.698249928s" totalImagesPullingTime="4.339256598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 23:10:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 23:10:05.697792342 +0000 UTC m=+4577.949790809" watchObservedRunningTime="2026-11-02 23:10:05.698249928 +0000 UTC m=+4577.950248393" Nov 02 23:10:06.343729 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:06.343694 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-f46lf_trainer-netpol-curl-qknx8_f92bc8d3-0829-4297-9d95-8fde80ea152f/curl/0.log" Nov 02 23:10:09.342677 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:09.342629 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-f46lf_trainer-netpol-curl-qknx8_f92bc8d3-0829-4297-9d95-8fde80ea152f/curl/0.log" Nov 02 23:10:09.508847 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:09.508810 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:10:09.604951 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:09.604856 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:10:10.702853 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:10.702822 5963 generic.go:356] "Generic (PLEG): container finished" podID="f92bc8d3-0829-4297-9d95-8fde80ea152f" containerID="e6f73d19f20ad1cb1a6e90a4dd1a8faea694a29828f20ea5e9695fd80f314f67" exitCode=28 Nov 02 23:10:10.703320 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:10.702899 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-f46lf/trainer-netpol-curl-qknx8" event={"ID":"f92bc8d3-0829-4297-9d95-8fde80ea152f","Type":"ContainerDied","Data":"e6f73d19f20ad1cb1a6e90a4dd1a8faea694a29828f20ea5e9695fd80f314f67"} Nov 02 23:10:10.855678 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:10.855630 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:10:10.949047 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:10.949012 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:10:11.830772 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:11.830743 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-f46lf/trainer-netpol-curl-qknx8" Nov 02 23:10:11.957608 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:11.957523 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f92bc8d3-0829-4297-9d95-8fde80ea152f-kube-api-access-kq9zz\" (UniqueName: \"kubernetes.io/projected/f92bc8d3-0829-4297-9d95-8fde80ea152f-kube-api-access-kq9zz\") pod \"f92bc8d3-0829-4297-9d95-8fde80ea152f\" (UID: \"f92bc8d3-0829-4297-9d95-8fde80ea152f\") " Nov 02 23:10:11.959850 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:11.959828 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f92bc8d3-0829-4297-9d95-8fde80ea152f-kube-api-access-kq9zz" pod "f92bc8d3-0829-4297-9d95-8fde80ea152f" (UID: "f92bc8d3-0829-4297-9d95-8fde80ea152f"). InnerVolumeSpecName "kube-api-access-kq9zz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 23:10:12.058784 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:12.058752 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kq9zz\" (UniqueName: \"kubernetes.io/projected/f92bc8d3-0829-4297-9d95-8fde80ea152f-kube-api-access-kq9zz\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 23:10:12.343793 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:12.343760 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-f46lf_trainer-netpol-curl-qknx8_f92bc8d3-0829-4297-9d95-8fde80ea152f/curl/0.log" Nov 02 23:10:12.563373 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:12.563339 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-f46lf_trainer-netpol-curl-qknx8_f92bc8d3-0829-4297-9d95-8fde80ea152f/curl/0.log" Nov 02 23:10:12.600715 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:12.600621 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-f46lf_trainer-netpol-curl-qknx8_f92bc8d3-0829-4297-9d95-8fde80ea152f/curl/0.log" Nov 02 23:10:12.711628 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:12.711601 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-f46lf/trainer-netpol-curl-qknx8" Nov 02 23:10:12.711827 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:12.711630 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-f46lf/trainer-netpol-curl-qknx8" event={"ID":"f92bc8d3-0829-4297-9d95-8fde80ea152f","Type":"ContainerDied","Data":"78614a4ad54818c5d066d65acf2b8797014b5da1dd79ea93bf8427ce2b36e620"} Nov 02 23:10:12.711827 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:12.711693 5963 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="78614a4ad54818c5d066d65acf2b8797014b5da1dd79ea93bf8427ce2b36e620" Nov 02 23:10:12.777842 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:12.777817 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:10:12.814921 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:12.814882 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-fcc9b/trainer-netpol-curl-s5bbs"] Nov 02 23:10:12.815199 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:12.815187 5963 cpu_manager.go:414] "containerMap: removing container" podUID="f92bc8d3-0829-4297-9d95-8fde80ea152f" containerName="curl" Nov 02 23:10:12.815266 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:12.815199 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f92bc8d3-0829-4297-9d95-8fde80ea152f" containerName="curl" Nov 02 23:10:12.815266 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:12.815263 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="f92bc8d3-0829-4297-9d95-8fde80ea152f" containerName="curl" Nov 02 23:10:12.818153 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:12.818133 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-fcc9b/trainer-netpol-curl-s5bbs" Nov 02 23:10:12.821918 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:12.821898 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-fcc9b\"/\"default-dockercfg-zrhmh\"" Nov 02 23:10:12.822045 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:12.821951 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-fcc9b\"/\"kube-root-ca.crt\"" Nov 02 23:10:12.822827 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:12.822815 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-fcc9b\"/\"openshift-service-ca.crt\"" Nov 02 23:10:12.826639 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:12.826618 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-fcc9b/trainer-netpol-curl-s5bbs"] Nov 02 23:10:12.878892 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:12.878808 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:10:12.965146 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:12.965116 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhg9x\" (UniqueName: \"kubernetes.io/projected/80ee37f4-b030-4b3d-bb99-c809c3773905-kube-api-access-zhg9x\") pod \"trainer-netpol-curl-s5bbs\" (UID: \"80ee37f4-b030-4b3d-bb99-c809c3773905\") " pod="test-ns-fcc9b/trainer-netpol-curl-s5bbs" Nov 02 23:10:13.065983 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:13.065949 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhg9x\" (UniqueName: \"kubernetes.io/projected/80ee37f4-b030-4b3d-bb99-c809c3773905-kube-api-access-zhg9x\") pod \"trainer-netpol-curl-s5bbs\" (UID: \"80ee37f4-b030-4b3d-bb99-c809c3773905\") " pod="test-ns-fcc9b/trainer-netpol-curl-s5bbs" Nov 02 23:10:13.079157 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:13.079131 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhg9x\" (UniqueName: \"kubernetes.io/projected/80ee37f4-b030-4b3d-bb99-c809c3773905-kube-api-access-zhg9x\") pod \"trainer-netpol-curl-s5bbs\" (UID: \"80ee37f4-b030-4b3d-bb99-c809c3773905\") " pod="test-ns-fcc9b/trainer-netpol-curl-s5bbs" Nov 02 23:10:13.130945 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:13.130881 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-fcc9b/trainer-netpol-curl-s5bbs" Nov 02 23:10:13.402144 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:13.402066 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-fcc9b/trainer-netpol-curl-s5bbs"] Nov 02 23:10:13.405173 ip-10-0-139-99 kubenswrapper[5963]: W1102 23:10:13.405149 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod80ee37f4_b030_4b3d_bb99_c809c3773905.slice/crio-ee061b968c3b641cc4696c8dbcf815780061a486f6e35ea0550225c51e1d8a80 WatchSource:0}: Error finding container ee061b968c3b641cc4696c8dbcf815780061a486f6e35ea0550225c51e1d8a80: Status 404 returned error can't find the container with id ee061b968c3b641cc4696c8dbcf815780061a486f6e35ea0550225c51e1d8a80 Nov 02 23:10:13.717222 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:13.717132 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-fcc9b/trainer-netpol-curl-s5bbs" event={"ID":"80ee37f4-b030-4b3d-bb99-c809c3773905","Type":"ContainerStarted","Data":"2ad0e79b176b7703897d206fdc36734bf5c9fa715db369e4a841a27da8d3932e"} Nov 02 23:10:13.717222 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:13.717180 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-fcc9b/trainer-netpol-curl-s5bbs" event={"ID":"80ee37f4-b030-4b3d-bb99-c809c3773905","Type":"ContainerStarted","Data":"ee061b968c3b641cc4696c8dbcf815780061a486f6e35ea0550225c51e1d8a80"} Nov 02 23:10:13.734541 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:13.734498 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-fcc9b/trainer-netpol-curl-s5bbs" podStartSLOduration=1.734484878 podStartE2EDuration="1.734484878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 23:10:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 23:10:13.734213667 +0000 UTC m=+4585.986212135" watchObservedRunningTime="2026-11-02 23:10:13.734484878 +0000 UTC m=+4585.986483342" Nov 02 23:10:15.730016 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:15.729991 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fcc9b_trainer-netpol-curl-s5bbs_80ee37f4-b030-4b3d-bb99-c809c3773905/curl/0.log" Nov 02 23:10:17.659077 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:17.659044 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-f46lf/trainer-netpol-curl-qknx8"] Nov 02 23:10:17.665617 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:17.665589 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-f46lf/trainer-netpol-curl-qknx8"] Nov 02 23:10:17.864065 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:17.864027 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f92bc8d3-0829-4297-9d95-8fde80ea152f" path="/var/lib/kubelet/pods/f92bc8d3-0829-4297-9d95-8fde80ea152f/volumes" Nov 02 23:10:18.373968 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:18.373932 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:10:18.470159 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:18.470114 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:10:18.730960 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:18.730881 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fcc9b_trainer-netpol-curl-s5bbs_80ee37f4-b030-4b3d-bb99-c809c3773905/curl/0.log" Nov 02 23:10:18.740014 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:18.739984 5963 generic.go:356] "Generic (PLEG): container finished" podID="80ee37f4-b030-4b3d-bb99-c809c3773905" containerID="2ad0e79b176b7703897d206fdc36734bf5c9fa715db369e4a841a27da8d3932e" exitCode=28 Nov 02 23:10:18.740137 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:18.740027 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-fcc9b/trainer-netpol-curl-s5bbs" event={"ID":"80ee37f4-b030-4b3d-bb99-c809c3773905","Type":"ContainerDied","Data":"2ad0e79b176b7703897d206fdc36734bf5c9fa715db369e4a841a27da8d3932e"} Nov 02 23:10:18.896311 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:18.896279 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fcc9b_trainer-netpol-curl-s5bbs_80ee37f4-b030-4b3d-bb99-c809c3773905/curl/0.log" Nov 02 23:10:18.940718 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:18.940690 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-fcc9b_trainer-netpol-curl-s5bbs_80ee37f4-b030-4b3d-bb99-c809c3773905/curl/0.log" Nov 02 23:10:19.136254 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:19.136220 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:10:19.168592 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:19.168561 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-pfpbj/trainer-netpol-curl-2254p"] Nov 02 23:10:19.171988 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:19.171964 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-pfpbj/trainer-netpol-curl-2254p" Nov 02 23:10:19.177244 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:19.177211 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-pfpbj\"/\"openshift-service-ca.crt\"" Nov 02 23:10:19.177360 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:19.177291 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-pfpbj\"/\"kube-root-ca.crt\"" Nov 02 23:10:19.178300 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:19.178279 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-pfpbj/trainer-netpol-curl-2254p"] Nov 02 23:10:19.178446 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:19.178284 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-pfpbj\"/\"default-dockercfg-5dnlm\"" Nov 02 23:10:19.215545 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:19.215513 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgdqb\" (UniqueName: \"kubernetes.io/projected/33d26a2a-a03b-49e1-a731-4921a2c68e8c-kube-api-access-bgdqb\") pod \"trainer-netpol-curl-2254p\" (UID: \"33d26a2a-a03b-49e1-a731-4921a2c68e8c\") " pod="test-ns-pfpbj/trainer-netpol-curl-2254p" Nov 02 23:10:19.237081 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:19.236648 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:10:19.317328 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:19.316894 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgdqb\" (UniqueName: \"kubernetes.io/projected/33d26a2a-a03b-49e1-a731-4921a2c68e8c-kube-api-access-bgdqb\") pod \"trainer-netpol-curl-2254p\" (UID: \"33d26a2a-a03b-49e1-a731-4921a2c68e8c\") " pod="test-ns-pfpbj/trainer-netpol-curl-2254p" Nov 02 23:10:19.329948 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:19.329919 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgdqb\" (UniqueName: \"kubernetes.io/projected/33d26a2a-a03b-49e1-a731-4921a2c68e8c-kube-api-access-bgdqb\") pod \"trainer-netpol-curl-2254p\" (UID: \"33d26a2a-a03b-49e1-a731-4921a2c68e8c\") " pod="test-ns-pfpbj/trainer-netpol-curl-2254p" Nov 02 23:10:19.486434 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:19.486346 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-pfpbj/trainer-netpol-curl-2254p" Nov 02 23:10:19.756995 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:19.756966 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-pfpbj/trainer-netpol-curl-2254p"] Nov 02 23:10:19.763085 ip-10-0-139-99 kubenswrapper[5963]: W1102 23:10:19.763045 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33d26a2a_a03b_49e1_a731_4921a2c68e8c.slice/crio-79c29a0551a2435ea09b0e577b537d17bc371c15060bef79d0afc31c53356217 WatchSource:0}: Error finding container 79c29a0551a2435ea09b0e577b537d17bc371c15060bef79d0afc31c53356217: Status 404 returned error can't find the container with id 79c29a0551a2435ea09b0e577b537d17bc371c15060bef79d0afc31c53356217 Nov 02 23:10:19.881946 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:19.881923 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-fcc9b/trainer-netpol-curl-s5bbs" Nov 02 23:10:19.921760 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:19.921731 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/80ee37f4-b030-4b3d-bb99-c809c3773905-kube-api-access-zhg9x\" (UniqueName: \"kubernetes.io/projected/80ee37f4-b030-4b3d-bb99-c809c3773905-kube-api-access-zhg9x\") pod \"80ee37f4-b030-4b3d-bb99-c809c3773905\" (UID: \"80ee37f4-b030-4b3d-bb99-c809c3773905\") " Nov 02 23:10:19.924028 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:19.924002 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80ee37f4-b030-4b3d-bb99-c809c3773905-kube-api-access-zhg9x" pod "80ee37f4-b030-4b3d-bb99-c809c3773905" (UID: "80ee37f4-b030-4b3d-bb99-c809c3773905"). InnerVolumeSpecName "kube-api-access-zhg9x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 23:10:20.022621 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:20.022560 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhg9x\" (UniqueName: \"kubernetes.io/projected/80ee37f4-b030-4b3d-bb99-c809c3773905-kube-api-access-zhg9x\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 23:10:20.749466 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:20.749384 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-fcc9b/trainer-netpol-curl-s5bbs" Nov 02 23:10:20.749614 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:20.749393 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-fcc9b/trainer-netpol-curl-s5bbs" event={"ID":"80ee37f4-b030-4b3d-bb99-c809c3773905","Type":"ContainerDied","Data":"ee061b968c3b641cc4696c8dbcf815780061a486f6e35ea0550225c51e1d8a80"} Nov 02 23:10:20.749614 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:20.749490 5963 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ee061b968c3b641cc4696c8dbcf815780061a486f6e35ea0550225c51e1d8a80" Nov 02 23:10:20.750973 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:20.750939 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-pfpbj/trainer-netpol-curl-2254p" event={"ID":"33d26a2a-a03b-49e1-a731-4921a2c68e8c","Type":"ContainerStarted","Data":"1ae56b88a15e946a4b7d1c4046dfccc3f90b2e26acf1d97e12c82fc01cf260e1"} Nov 02 23:10:20.751096 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:20.750978 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-pfpbj/trainer-netpol-curl-2254p" event={"ID":"33d26a2a-a03b-49e1-a731-4921a2c68e8c","Type":"ContainerStarted","Data":"79c29a0551a2435ea09b0e577b537d17bc371c15060bef79d0afc31c53356217"} Nov 02 23:10:20.768327 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:20.768279 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-pfpbj/trainer-netpol-curl-2254p" podStartSLOduration=1.768265771 podStartE2EDuration="1.768265771s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 23:10:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 23:10:20.767701897 +0000 UTC m=+4593.019700364" watchObservedRunningTime="2026-11-02 23:10:20.768265771 +0000 UTC m=+4593.020264237" Nov 02 23:10:22.082391 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:22.082365 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfpbj_trainer-netpol-curl-2254p_33d26a2a-a03b-49e1-a731-4921a2c68e8c/curl/0.log" Nov 02 23:10:24.015681 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:24.015630 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-fcc9b/trainer-netpol-curl-s5bbs"] Nov 02 23:10:24.020154 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:24.020128 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-fcc9b/trainer-netpol-curl-s5bbs"] Nov 02 23:10:24.772915 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:24.772877 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:10:24.901566 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:24.901529 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:10:25.083919 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:25.083864 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfpbj_trainer-netpol-curl-2254p_33d26a2a-a03b-49e1-a731-4921a2c68e8c/curl/0.log" Nov 02 23:10:25.772786 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:25.772758 5963 generic.go:356] "Generic (PLEG): container finished" podID="33d26a2a-a03b-49e1-a731-4921a2c68e8c" containerID="1ae56b88a15e946a4b7d1c4046dfccc3f90b2e26acf1d97e12c82fc01cf260e1" exitCode=28 Nov 02 23:10:25.772947 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:25.772817 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-pfpbj/trainer-netpol-curl-2254p" event={"ID":"33d26a2a-a03b-49e1-a731-4921a2c68e8c","Type":"ContainerDied","Data":"1ae56b88a15e946a4b7d1c4046dfccc3f90b2e26acf1d97e12c82fc01cf260e1"} Nov 02 23:10:25.863093 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:25.863062 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="80ee37f4-b030-4b3d-bb99-c809c3773905" path="/var/lib/kubelet/pods/80ee37f4-b030-4b3d-bb99-c809c3773905/volumes" Nov 02 23:10:26.903062 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:26.903042 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-pfpbj/trainer-netpol-curl-2254p" Nov 02 23:10:26.984125 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:26.984094 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/33d26a2a-a03b-49e1-a731-4921a2c68e8c-kube-api-access-bgdqb\" (UniqueName: \"kubernetes.io/projected/33d26a2a-a03b-49e1-a731-4921a2c68e8c-kube-api-access-bgdqb\") pod \"33d26a2a-a03b-49e1-a731-4921a2c68e8c\" (UID: \"33d26a2a-a03b-49e1-a731-4921a2c68e8c\") " Nov 02 23:10:26.986357 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:26.986332 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33d26a2a-a03b-49e1-a731-4921a2c68e8c-kube-api-access-bgdqb" pod "33d26a2a-a03b-49e1-a731-4921a2c68e8c" (UID: "33d26a2a-a03b-49e1-a731-4921a2c68e8c"). InnerVolumeSpecName "kube-api-access-bgdqb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 23:10:27.084865 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:27.084843 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgdqb\" (UniqueName: \"kubernetes.io/projected/33d26a2a-a03b-49e1-a731-4921a2c68e8c-kube-api-access-bgdqb\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 23:10:27.268598 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:27.268566 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfpbj_trainer-netpol-curl-2254p_33d26a2a-a03b-49e1-a731-4921a2c68e8c/curl/0.log" Nov 02 23:10:27.305061 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:27.305028 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-pfpbj_trainer-netpol-curl-2254p_33d26a2a-a03b-49e1-a731-4921a2c68e8c/curl/0.log" Nov 02 23:10:27.443728 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:27.443597 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:10:27.444889 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:27.444864 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-tlf8s/trainer-netpol-curl-scv5c"] Nov 02 23:10:27.445177 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:27.445165 5963 cpu_manager.go:414] "containerMap: removing container" podUID="33d26a2a-a03b-49e1-a731-4921a2c68e8c" containerName="curl" Nov 02 23:10:27.445229 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:27.445180 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="33d26a2a-a03b-49e1-a731-4921a2c68e8c" containerName="curl" Nov 02 23:10:27.445229 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:27.445202 5963 cpu_manager.go:414] "containerMap: removing container" podUID="80ee37f4-b030-4b3d-bb99-c809c3773905" containerName="curl" Nov 02 23:10:27.445229 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:27.445208 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="80ee37f4-b030-4b3d-bb99-c809c3773905" containerName="curl" Nov 02 23:10:27.445334 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:27.445263 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="80ee37f4-b030-4b3d-bb99-c809c3773905" containerName="curl" Nov 02 23:10:27.445334 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:27.445274 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="33d26a2a-a03b-49e1-a731-4921a2c68e8c" containerName="curl" Nov 02 23:10:27.447857 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:27.447838 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-tlf8s/trainer-netpol-curl-scv5c" Nov 02 23:10:27.453294 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:27.453262 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-tlf8s\"/\"kube-root-ca.crt\"" Nov 02 23:10:27.453432 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:27.453380 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-tlf8s\"/\"default-dockercfg-9ghf2\"" Nov 02 23:10:27.453500 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:27.453451 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-tlf8s\"/\"openshift-service-ca.crt\"" Nov 02 23:10:27.453656 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:27.453639 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-tlf8s/trainer-netpol-curl-scv5c"] Nov 02 23:10:27.543601 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:27.543561 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:10:27.589114 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:27.589082 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9ftm\" (UniqueName: \"kubernetes.io/projected/3a058b13-811d-42c8-b6b4-8b4e50adced6-kube-api-access-g9ftm\") pod \"trainer-netpol-curl-scv5c\" (UID: \"3a058b13-811d-42c8-b6b4-8b4e50adced6\") " pod="test-ns-tlf8s/trainer-netpol-curl-scv5c" Nov 02 23:10:27.690052 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:27.690016 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9ftm\" (UniqueName: \"kubernetes.io/projected/3a058b13-811d-42c8-b6b4-8b4e50adced6-kube-api-access-g9ftm\") pod \"trainer-netpol-curl-scv5c\" (UID: \"3a058b13-811d-42c8-b6b4-8b4e50adced6\") " pod="test-ns-tlf8s/trainer-netpol-curl-scv5c" Nov 02 23:10:27.702904 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:27.702837 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9ftm\" (UniqueName: \"kubernetes.io/projected/3a058b13-811d-42c8-b6b4-8b4e50adced6-kube-api-access-g9ftm\") pod \"trainer-netpol-curl-scv5c\" (UID: \"3a058b13-811d-42c8-b6b4-8b4e50adced6\") " pod="test-ns-tlf8s/trainer-netpol-curl-scv5c" Nov 02 23:10:27.759858 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:27.759830 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-tlf8s/trainer-netpol-curl-scv5c" Nov 02 23:10:27.781926 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:27.781899 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-pfpbj/trainer-netpol-curl-2254p" event={"ID":"33d26a2a-a03b-49e1-a731-4921a2c68e8c","Type":"ContainerDied","Data":"79c29a0551a2435ea09b0e577b537d17bc371c15060bef79d0afc31c53356217"} Nov 02 23:10:27.782043 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:27.781935 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-pfpbj/trainer-netpol-curl-2254p" Nov 02 23:10:27.782043 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:27.781938 5963 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="79c29a0551a2435ea09b0e577b537d17bc371c15060bef79d0afc31c53356217" Nov 02 23:10:28.032487 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:28.032408 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-tlf8s/trainer-netpol-curl-scv5c"] Nov 02 23:10:28.037014 ip-10-0-139-99 kubenswrapper[5963]: W1102 23:10:28.036988 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a058b13_811d_42c8_b6b4_8b4e50adced6.slice/crio-d70efd14ebb98e40e5d11fc9b91ae6bf819108c2f3081005a8e2291428d4fbc2 WatchSource:0}: Error finding container d70efd14ebb98e40e5d11fc9b91ae6bf819108c2f3081005a8e2291428d4fbc2: Status 404 returned error can't find the container with id d70efd14ebb98e40e5d11fc9b91ae6bf819108c2f3081005a8e2291428d4fbc2 Nov 02 23:10:28.787210 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:28.787175 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-tlf8s/trainer-netpol-curl-scv5c" event={"ID":"3a058b13-811d-42c8-b6b4-8b4e50adced6","Type":"ContainerStarted","Data":"b3248d9c587d11cacf020e5d19c988099ad8364dce58710bfc14c9819ae46734"} Nov 02 23:10:28.787419 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:28.787219 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-tlf8s/trainer-netpol-curl-scv5c" event={"ID":"3a058b13-811d-42c8-b6b4-8b4e50adced6","Type":"ContainerStarted","Data":"d70efd14ebb98e40e5d11fc9b91ae6bf819108c2f3081005a8e2291428d4fbc2"} Nov 02 23:10:28.804650 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:28.804608 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-tlf8s/trainer-netpol-curl-scv5c" podStartSLOduration=1.80459435 podStartE2EDuration="1.80459435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 23:10:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 23:10:28.803793051 +0000 UTC m=+4601.055791516" watchObservedRunningTime="2026-11-02 23:10:28.80459435 +0000 UTC m=+4601.056592822" Nov 02 23:10:29.122090 ip-10-0-139-99 kubenswrapper[5963]: E1102 23:10:29.122056 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 23:10:30.398503 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:30.398473 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tlf8s_trainer-netpol-curl-scv5c_3a058b13-811d-42c8-b6b4-8b4e50adced6/curl/0.log" Nov 02 23:10:32.365330 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:32.365289 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-pfpbj/trainer-netpol-curl-2254p"] Nov 02 23:10:32.367555 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:32.367529 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-pfpbj/trainer-netpol-curl-2254p"] Nov 02 23:10:33.138419 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:33.138387 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:10:33.234622 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:33.234593 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:10:33.400278 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:33.400200 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tlf8s_trainer-netpol-curl-scv5c_3a058b13-811d-42c8-b6b4-8b4e50adced6/curl/0.log" Nov 02 23:10:33.808827 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:33.808798 5963 generic.go:356] "Generic (PLEG): container finished" podID="3a058b13-811d-42c8-b6b4-8b4e50adced6" containerID="b3248d9c587d11cacf020e5d19c988099ad8364dce58710bfc14c9819ae46734" exitCode=28 Nov 02 23:10:33.808982 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:33.808874 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-tlf8s/trainer-netpol-curl-scv5c" event={"ID":"3a058b13-811d-42c8-b6b4-8b4e50adced6","Type":"ContainerDied","Data":"b3248d9c587d11cacf020e5d19c988099ad8364dce58710bfc14c9819ae46734"} Nov 02 23:10:33.863122 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:33.863092 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="33d26a2a-a03b-49e1-a731-4921a2c68e8c" path="/var/lib/kubelet/pods/33d26a2a-a03b-49e1-a731-4921a2c68e8c/volumes" Nov 02 23:10:34.948081 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:34.948059 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-tlf8s/trainer-netpol-curl-scv5c" Nov 02 23:10:35.055148 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:35.055115 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3a058b13-811d-42c8-b6b4-8b4e50adced6-kube-api-access-g9ftm\" (UniqueName: \"kubernetes.io/projected/3a058b13-811d-42c8-b6b4-8b4e50adced6-kube-api-access-g9ftm\") pod \"3a058b13-811d-42c8-b6b4-8b4e50adced6\" (UID: \"3a058b13-811d-42c8-b6b4-8b4e50adced6\") " Nov 02 23:10:35.057420 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:35.057391 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a058b13-811d-42c8-b6b4-8b4e50adced6-kube-api-access-g9ftm" pod "3a058b13-811d-42c8-b6b4-8b4e50adced6" (UID: "3a058b13-811d-42c8-b6b4-8b4e50adced6"). InnerVolumeSpecName "kube-api-access-g9ftm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 23:10:35.156708 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:35.156619 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9ftm\" (UniqueName: \"kubernetes.io/projected/3a058b13-811d-42c8-b6b4-8b4e50adced6-kube-api-access-g9ftm\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 23:10:35.544429 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:35.544341 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tlf8s_trainer-netpol-curl-scv5c_3a058b13-811d-42c8-b6b4-8b4e50adced6/curl/0.log" Nov 02 23:10:35.580919 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:35.580892 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-tlf8s_trainer-netpol-curl-scv5c_3a058b13-811d-42c8-b6b4-8b4e50adced6/curl/0.log" Nov 02 23:10:35.699045 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:35.699012 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:10:35.797286 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:35.797206 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:10:35.801053 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:35.801029 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-8x87w/trainer-netpol-workload-n4bgj-node-0-0-8j77m"] Nov 02 23:10:35.801355 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:35.801342 5963 cpu_manager.go:414] "containerMap: removing container" podUID="3a058b13-811d-42c8-b6b4-8b4e50adced6" containerName="curl" Nov 02 23:10:35.801404 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:35.801357 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3a058b13-811d-42c8-b6b4-8b4e50adced6" containerName="curl" Nov 02 23:10:35.801471 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:35.801428 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="3a058b13-811d-42c8-b6b4-8b4e50adced6" containerName="curl" Nov 02 23:10:35.804296 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:35.804278 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-8x87w/trainer-netpol-workload-n4bgj-node-0-0-8j77m" Nov 02 23:10:35.818068 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:35.818052 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-tlf8s/trainer-netpol-curl-scv5c" Nov 02 23:10:35.818145 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:35.818063 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-tlf8s/trainer-netpol-curl-scv5c" event={"ID":"3a058b13-811d-42c8-b6b4-8b4e50adced6","Type":"ContainerDied","Data":"d70efd14ebb98e40e5d11fc9b91ae6bf819108c2f3081005a8e2291428d4fbc2"} Nov 02 23:10:35.818145 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:35.818088 5963 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d70efd14ebb98e40e5d11fc9b91ae6bf819108c2f3081005a8e2291428d4fbc2" Nov 02 23:10:35.818835 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:35.818810 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-8x87w\"/\"kube-root-ca.crt\"" Nov 02 23:10:35.818835 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:35.818821 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-8x87w\"/\"openshift-service-ca.crt\"" Nov 02 23:10:35.818980 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:35.818885 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-8x87w\"/\"default-dockercfg-bf67h\"" Nov 02 23:10:35.822090 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:35.822070 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-8x87w/trainer-netpol-workload-n4bgj-node-0-0-8j77m"] Nov 02 23:10:35.897988 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:35.897953 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:10:35.963305 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:35.963258 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcvvt\" (UniqueName: \"kubernetes.io/projected/93888b3f-8dcb-453b-815f-71c743f7f4e0-kube-api-access-gcvvt\") pod \"trainer-netpol-workload-n4bgj-node-0-0-8j77m\" (UID: \"93888b3f-8dcb-453b-815f-71c743f7f4e0\") " pod="test-ns-8x87w/trainer-netpol-workload-n4bgj-node-0-0-8j77m" Nov 02 23:10:36.063998 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:36.063969 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcvvt\" (UniqueName: \"kubernetes.io/projected/93888b3f-8dcb-453b-815f-71c743f7f4e0-kube-api-access-gcvvt\") pod \"trainer-netpol-workload-n4bgj-node-0-0-8j77m\" (UID: \"93888b3f-8dcb-453b-815f-71c743f7f4e0\") " pod="test-ns-8x87w/trainer-netpol-workload-n4bgj-node-0-0-8j77m" Nov 02 23:10:36.077736 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:36.077711 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcvvt\" (UniqueName: \"kubernetes.io/projected/93888b3f-8dcb-453b-815f-71c743f7f4e0-kube-api-access-gcvvt\") pod \"trainer-netpol-workload-n4bgj-node-0-0-8j77m\" (UID: \"93888b3f-8dcb-453b-815f-71c743f7f4e0\") " pod="test-ns-8x87w/trainer-netpol-workload-n4bgj-node-0-0-8j77m" Nov 02 23:10:36.115607 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:36.115584 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-8x87w/trainer-netpol-workload-n4bgj-node-0-0-8j77m" Nov 02 23:10:36.389226 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:36.389158 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-8x87w/trainer-netpol-workload-n4bgj-node-0-0-8j77m"] Nov 02 23:10:36.392507 ip-10-0-139-99 kubenswrapper[5963]: W1102 23:10:36.392475 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93888b3f_8dcb_453b_815f_71c743f7f4e0.slice/crio-86ff55d7664fc3ea5bd586ab95bf34e86b4629a445ffaa415d64d2fa25b9b683 WatchSource:0}: Error finding container 86ff55d7664fc3ea5bd586ab95bf34e86b4629a445ffaa415d64d2fa25b9b683: Status 404 returned error can't find the container with id 86ff55d7664fc3ea5bd586ab95bf34e86b4629a445ffaa415d64d2fa25b9b683 Nov 02 23:10:36.824071 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:36.824038 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-8x87w/trainer-netpol-workload-n4bgj-node-0-0-8j77m" event={"ID":"93888b3f-8dcb-453b-815f-71c743f7f4e0","Type":"ContainerStarted","Data":"6d686c49a69db45f20dca43fd8c7456b8224e6b6a489d09a9bae6c729bfe1453"} Nov 02 23:10:36.824267 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:36.824093 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-8x87w/trainer-netpol-workload-n4bgj-node-0-0-8j77m" event={"ID":"93888b3f-8dcb-453b-815f-71c743f7f4e0","Type":"ContainerStarted","Data":"86ff55d7664fc3ea5bd586ab95bf34e86b4629a445ffaa415d64d2fa25b9b683"} Nov 02 23:10:36.844601 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:36.844563 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-8x87w/trainer-netpol-workload-n4bgj-node-0-0-8j77m" podStartSLOduration=1.844549594 podStartE2EDuration="1.844549594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 23:10:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 23:10:36.844069166 +0000 UTC m=+4609.096067633" watchObservedRunningTime="2026-11-02 23:10:36.844549594 +0000 UTC m=+4609.096548055" Nov 02 23:10:38.677943 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:38.677912 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-8x87w_trainer-netpol-workload-n4bgj-node-0-0-8j77m_93888b3f-8dcb-453b-815f-71c743f7f4e0/node/0.log" Nov 02 23:10:38.828951 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:38.828919 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-8x87w_trainer-netpol-workload-n4bgj-node-0-0-8j77m_93888b3f-8dcb-453b-815f-71c743f7f4e0/node/0.log" Nov 02 23:10:38.870158 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:38.870125 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-4g4q9/trainer-netpol-curl-t8xhg"] Nov 02 23:10:38.873357 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:38.873340 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-4g4q9/trainer-netpol-curl-t8xhg" Nov 02 23:10:38.880228 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:38.880163 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-4g4q9\"/\"kube-root-ca.crt\"" Nov 02 23:10:38.881140 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:38.881117 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-4g4q9/trainer-netpol-curl-t8xhg"] Nov 02 23:10:38.881244 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:38.881164 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-4g4q9\"/\"default-dockercfg-slgjl\"" Nov 02 23:10:38.881244 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:38.881170 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-4g4q9\"/\"openshift-service-ca.crt\"" Nov 02 23:10:38.987835 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:38.987734 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4kj4\" (UniqueName: \"kubernetes.io/projected/a16d3e9e-3e36-432c-bbbf-d0ed12af3667-kube-api-access-s4kj4\") pod \"trainer-netpol-curl-t8xhg\" (UID: \"a16d3e9e-3e36-432c-bbbf-d0ed12af3667\") " pod="test-ns-4g4q9/trainer-netpol-curl-t8xhg" Nov 02 23:10:39.088510 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:39.088479 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4kj4\" (UniqueName: \"kubernetes.io/projected/a16d3e9e-3e36-432c-bbbf-d0ed12af3667-kube-api-access-s4kj4\") pod \"trainer-netpol-curl-t8xhg\" (UID: \"a16d3e9e-3e36-432c-bbbf-d0ed12af3667\") " pod="test-ns-4g4q9/trainer-netpol-curl-t8xhg" Nov 02 23:10:39.101382 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:39.101357 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4kj4\" (UniqueName: \"kubernetes.io/projected/a16d3e9e-3e36-432c-bbbf-d0ed12af3667-kube-api-access-s4kj4\") pod \"trainer-netpol-curl-t8xhg\" (UID: \"a16d3e9e-3e36-432c-bbbf-d0ed12af3667\") " pod="test-ns-4g4q9/trainer-netpol-curl-t8xhg" Nov 02 23:10:39.185884 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:39.185847 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-4g4q9/trainer-netpol-curl-t8xhg" Nov 02 23:10:39.457603 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:39.457570 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-4g4q9/trainer-netpol-curl-t8xhg"] Nov 02 23:10:39.461508 ip-10-0-139-99 kubenswrapper[5963]: W1102 23:10:39.461475 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda16d3e9e_3e36_432c_bbbf_d0ed12af3667.slice/crio-1d0ed7732acf78e0c1118703e08ae5e676ad5096a41b25f61715e84bdd4696d6 WatchSource:0}: Error finding container 1d0ed7732acf78e0c1118703e08ae5e676ad5096a41b25f61715e84bdd4696d6: Status 404 returned error can't find the container with id 1d0ed7732acf78e0c1118703e08ae5e676ad5096a41b25f61715e84bdd4696d6 Nov 02 23:10:39.838797 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:39.838760 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-4g4q9/trainer-netpol-curl-t8xhg" event={"ID":"a16d3e9e-3e36-432c-bbbf-d0ed12af3667","Type":"ContainerStarted","Data":"e786575496441a2d4dc37198a1e8dbcde85bf0c6b86424e3f3a84210b8cb3e78"} Nov 02 23:10:39.838797 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:39.838806 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-4g4q9/trainer-netpol-curl-t8xhg" event={"ID":"a16d3e9e-3e36-432c-bbbf-d0ed12af3667","Type":"ContainerStarted","Data":"1d0ed7732acf78e0c1118703e08ae5e676ad5096a41b25f61715e84bdd4696d6"} Nov 02 23:10:39.856861 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:39.856818 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-4g4q9/trainer-netpol-curl-t8xhg" podStartSLOduration=1.85680537 podStartE2EDuration="1.85680537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 23:10:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 23:10:39.856535143 +0000 UTC m=+4612.108533608" watchObservedRunningTime="2026-11-02 23:10:39.85680537 +0000 UTC m=+4612.108803900" Nov 02 23:10:40.640997 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:40.640957 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-tlf8s/trainer-netpol-curl-scv5c"] Nov 02 23:10:40.644780 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:40.644754 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-tlf8s/trainer-netpol-curl-scv5c"] Nov 02 23:10:41.377382 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:41.377348 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:10:41.474435 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:41.474396 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:10:41.675091 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:41.675014 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-8x87w_trainer-netpol-workload-n4bgj-node-0-0-8j77m_93888b3f-8dcb-453b-815f-71c743f7f4e0/node/0.log" Nov 02 23:10:41.692292 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:41.692266 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-4g4q9_trainer-netpol-curl-t8xhg_a16d3e9e-3e36-432c-bbbf-d0ed12af3667/curl/0.log" Nov 02 23:10:41.866838 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:41.864758 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3a058b13-811d-42c8-b6b4-8b4e50adced6" path="/var/lib/kubelet/pods/3a058b13-811d-42c8-b6b4-8b4e50adced6/volumes" Nov 02 23:10:44.676135 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:44.676102 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-8x87w_trainer-netpol-workload-n4bgj-node-0-0-8j77m_93888b3f-8dcb-453b-815f-71c743f7f4e0/node/0.log" Nov 02 23:10:44.692630 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:44.692605 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-4g4q9_trainer-netpol-curl-t8xhg_a16d3e9e-3e36-432c-bbbf-d0ed12af3667/curl/0.log" Nov 02 23:10:44.860757 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:44.860732 5963 generic.go:356] "Generic (PLEG): container finished" podID="a16d3e9e-3e36-432c-bbbf-d0ed12af3667" containerID="e786575496441a2d4dc37198a1e8dbcde85bf0c6b86424e3f3a84210b8cb3e78" exitCode=28 Nov 02 23:10:44.860933 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:44.860810 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-4g4q9/trainer-netpol-curl-t8xhg" event={"ID":"a16d3e9e-3e36-432c-bbbf-d0ed12af3667","Type":"ContainerDied","Data":"e786575496441a2d4dc37198a1e8dbcde85bf0c6b86424e3f3a84210b8cb3e78"} Nov 02 23:10:44.950626 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:44.950599 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-4g4q9_trainer-netpol-curl-t8xhg_a16d3e9e-3e36-432c-bbbf-d0ed12af3667/curl/0.log" Nov 02 23:10:44.987251 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:44.987224 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-4g4q9_trainer-netpol-curl-t8xhg_a16d3e9e-3e36-432c-bbbf-d0ed12af3667/curl/0.log" Nov 02 23:10:45.061680 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:45.061638 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-8x87w_trainer-netpol-workload-n4bgj-node-0-0-8j77m_93888b3f-8dcb-453b-815f-71c743f7f4e0/node/0.log" Nov 02 23:10:45.089928 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:45.089897 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:10:45.195257 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:45.195161 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:10:45.320938 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:45.320905 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-9b7mr/trainer-netpol-workload-6dggc-node-0-0-fqmp9"] Nov 02 23:10:45.324220 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:45.324201 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-9b7mr/trainer-netpol-workload-6dggc-node-0-0-fqmp9" Nov 02 23:10:45.328732 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:45.328706 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-9b7mr\"/\"kube-root-ca.crt\"" Nov 02 23:10:45.328832 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:45.328756 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-9b7mr\"/\"default-dockercfg-bmk5z\"" Nov 02 23:10:45.328832 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:45.328760 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-9b7mr\"/\"openshift-service-ca.crt\"" Nov 02 23:10:45.334517 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:45.334497 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-9b7mr/trainer-netpol-workload-6dggc-node-0-0-fqmp9"] Nov 02 23:10:45.345502 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:45.345466 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:10:45.441248 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:45.441213 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jww4r\" (UniqueName: \"kubernetes.io/projected/216572b0-a4c3-4be2-b2c0-d737c4db50db-kube-api-access-jww4r\") pod \"trainer-netpol-workload-6dggc-node-0-0-fqmp9\" (UID: \"216572b0-a4c3-4be2-b2c0-d737c4db50db\") " pod="test-ns-9b7mr/trainer-netpol-workload-6dggc-node-0-0-fqmp9" Nov 02 23:10:45.542051 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:45.541968 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jww4r\" (UniqueName: \"kubernetes.io/projected/216572b0-a4c3-4be2-b2c0-d737c4db50db-kube-api-access-jww4r\") pod \"trainer-netpol-workload-6dggc-node-0-0-fqmp9\" (UID: \"216572b0-a4c3-4be2-b2c0-d737c4db50db\") " pod="test-ns-9b7mr/trainer-netpol-workload-6dggc-node-0-0-fqmp9" Nov 02 23:10:45.554891 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:45.554868 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jww4r\" (UniqueName: \"kubernetes.io/projected/216572b0-a4c3-4be2-b2c0-d737c4db50db-kube-api-access-jww4r\") pod \"trainer-netpol-workload-6dggc-node-0-0-fqmp9\" (UID: \"216572b0-a4c3-4be2-b2c0-d737c4db50db\") " pod="test-ns-9b7mr/trainer-netpol-workload-6dggc-node-0-0-fqmp9" Nov 02 23:10:45.636523 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:45.636489 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-9b7mr/trainer-netpol-workload-6dggc-node-0-0-fqmp9" Nov 02 23:10:45.913014 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:45.912985 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-9b7mr/trainer-netpol-workload-6dggc-node-0-0-fqmp9"] Nov 02 23:10:45.916832 ip-10-0-139-99 kubenswrapper[5963]: W1102 23:10:45.916801 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod216572b0_a4c3_4be2_b2c0_d737c4db50db.slice/crio-16c49fa5fd55f6c69f2799f17d567ed69b9ce266b6e168ca23502e8bcaed25a5 WatchSource:0}: Error finding container 16c49fa5fd55f6c69f2799f17d567ed69b9ce266b6e168ca23502e8bcaed25a5: Status 404 returned error can't find the container with id 16c49fa5fd55f6c69f2799f17d567ed69b9ce266b6e168ca23502e8bcaed25a5 Nov 02 23:10:46.002618 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:46.002587 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-4g4q9/trainer-netpol-curl-t8xhg" Nov 02 23:10:46.146031 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:46.145950 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a16d3e9e-3e36-432c-bbbf-d0ed12af3667-kube-api-access-s4kj4\" (UniqueName: \"kubernetes.io/projected/a16d3e9e-3e36-432c-bbbf-d0ed12af3667-kube-api-access-s4kj4\") pod \"a16d3e9e-3e36-432c-bbbf-d0ed12af3667\" (UID: \"a16d3e9e-3e36-432c-bbbf-d0ed12af3667\") " Nov 02 23:10:46.148202 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:46.148179 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a16d3e9e-3e36-432c-bbbf-d0ed12af3667-kube-api-access-s4kj4" pod "a16d3e9e-3e36-432c-bbbf-d0ed12af3667" (UID: "a16d3e9e-3e36-432c-bbbf-d0ed12af3667"). InnerVolumeSpecName "kube-api-access-s4kj4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 23:10:46.246811 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:46.246776 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4kj4\" (UniqueName: \"kubernetes.io/projected/a16d3e9e-3e36-432c-bbbf-d0ed12af3667-kube-api-access-s4kj4\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 23:10:46.879940 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:46.879851 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-4g4q9/trainer-netpol-curl-t8xhg" Nov 02 23:10:46.879940 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:46.879874 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-4g4q9/trainer-netpol-curl-t8xhg" event={"ID":"a16d3e9e-3e36-432c-bbbf-d0ed12af3667","Type":"ContainerDied","Data":"1d0ed7732acf78e0c1118703e08ae5e676ad5096a41b25f61715e84bdd4696d6"} Nov 02 23:10:46.879940 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:46.879912 5963 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d0ed7732acf78e0c1118703e08ae5e676ad5096a41b25f61715e84bdd4696d6" Nov 02 23:10:46.881582 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:46.881553 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-9b7mr/trainer-netpol-workload-6dggc-node-0-0-fqmp9" event={"ID":"216572b0-a4c3-4be2-b2c0-d737c4db50db","Type":"ContainerStarted","Data":"bd4a6a4d53e8a9f76db9abfa26e041410af97ca6238bd713e1529e73b3fe9570"} Nov 02 23:10:46.881704 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:46.881594 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-9b7mr/trainer-netpol-workload-6dggc-node-0-0-fqmp9" event={"ID":"216572b0-a4c3-4be2-b2c0-d737c4db50db","Type":"ContainerStarted","Data":"16c49fa5fd55f6c69f2799f17d567ed69b9ce266b6e168ca23502e8bcaed25a5"} Nov 02 23:10:46.900995 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:46.900953 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-9b7mr/trainer-netpol-workload-6dggc-node-0-0-fqmp9" podStartSLOduration=1.900940643 podStartE2EDuration="1.900940643s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 23:10:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 23:10:46.900471011 +0000 UTC m=+4619.152469476" watchObservedRunningTime="2026-11-02 23:10:46.900940643 +0000 UTC m=+4619.152939108" Nov 02 23:10:48.158521 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:48.158484 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-9b7mr_trainer-netpol-workload-6dggc-node-0-0-fqmp9_216572b0-a4c3-4be2-b2c0-d737c4db50db/node/0.log" Nov 02 23:10:48.222948 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:48.222919 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-9b7mr_trainer-netpol-workload-6dggc-node-0-0-fqmp9_216572b0-a4c3-4be2-b2c0-d737c4db50db/node/0.log" Nov 02 23:10:48.264575 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:48.264546 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["test-ns-9b7mr/trainer-netpol-curl-l5zgj"] Nov 02 23:10:48.264905 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:48.264891 5963 cpu_manager.go:414] "containerMap: removing container" podUID="a16d3e9e-3e36-432c-bbbf-d0ed12af3667" containerName="curl" Nov 02 23:10:48.264947 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:48.264905 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a16d3e9e-3e36-432c-bbbf-d0ed12af3667" containerName="curl" Nov 02 23:10:48.265015 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:48.265006 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="a16d3e9e-3e36-432c-bbbf-d0ed12af3667" containerName="curl" Nov 02 23:10:48.267893 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:48.267876 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-9b7mr/trainer-netpol-curl-l5zgj" Nov 02 23:10:48.268204 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:48.268181 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9lpp\" (UniqueName: \"kubernetes.io/projected/47fd281c-f014-45fb-b7ff-8f503dfa353d-kube-api-access-d9lpp\") pod \"trainer-netpol-curl-l5zgj\" (UID: \"47fd281c-f014-45fb-b7ff-8f503dfa353d\") " pod="test-ns-9b7mr/trainer-netpol-curl-l5zgj" Nov 02 23:10:48.275740 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:48.275718 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-9b7mr/trainer-netpol-curl-l5zgj"] Nov 02 23:10:48.368752 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:48.368729 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9lpp\" (UniqueName: \"kubernetes.io/projected/47fd281c-f014-45fb-b7ff-8f503dfa353d-kube-api-access-d9lpp\") pod \"trainer-netpol-curl-l5zgj\" (UID: \"47fd281c-f014-45fb-b7ff-8f503dfa353d\") " pod="test-ns-9b7mr/trainer-netpol-curl-l5zgj" Nov 02 23:10:48.381346 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:48.381308 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9lpp\" (UniqueName: \"kubernetes.io/projected/47fd281c-f014-45fb-b7ff-8f503dfa353d-kube-api-access-d9lpp\") pod \"trainer-netpol-curl-l5zgj\" (UID: \"47fd281c-f014-45fb-b7ff-8f503dfa353d\") " pod="test-ns-9b7mr/trainer-netpol-curl-l5zgj" Nov 02 23:10:48.579956 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:48.579922 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-9b7mr/trainer-netpol-curl-l5zgj" Nov 02 23:10:48.850379 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:48.850310 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["test-ns-9b7mr/trainer-netpol-curl-l5zgj"] Nov 02 23:10:48.853703 ip-10-0-139-99 kubenswrapper[5963]: W1102 23:10:48.853652 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod47fd281c_f014_45fb_b7ff_8f503dfa353d.slice/crio-711a2d85fdee73647617c022086fbd530b412491a7d11ab050939557a8d7dbaa WatchSource:0}: Error finding container 711a2d85fdee73647617c022086fbd530b412491a7d11ab050939557a8d7dbaa: Status 404 returned error can't find the container with id 711a2d85fdee73647617c022086fbd530b412491a7d11ab050939557a8d7dbaa Nov 02 23:10:48.890703 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:48.890646 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-9b7mr/trainer-netpol-curl-l5zgj" event={"ID":"47fd281c-f014-45fb-b7ff-8f503dfa353d","Type":"ContainerStarted","Data":"711a2d85fdee73647617c022086fbd530b412491a7d11ab050939557a8d7dbaa"} Nov 02 23:10:49.895874 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:49.895831 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-9b7mr/trainer-netpol-curl-l5zgj" event={"ID":"47fd281c-f014-45fb-b7ff-8f503dfa353d","Type":"ContainerStarted","Data":"c774c20cd0dc97d82c13d6aac8f653824995dc3667ad30f4b5e2292c4ba5c040"} Nov 02 23:10:49.916710 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:49.916608 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="test-ns-9b7mr/trainer-netpol-curl-l5zgj" podStartSLOduration=1.9165926 podStartE2EDuration="1.9165926s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 23:10:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 23:10:49.916354581 +0000 UTC m=+4622.168353040" watchObservedRunningTime="2026-11-02 23:10:49.9165926 +0000 UTC m=+4622.168591066" Nov 02 23:10:50.050182 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:50.050149 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-4g4q9/trainer-netpol-curl-t8xhg"] Nov 02 23:10:50.057758 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:50.057726 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-4g4q9/trainer-netpol-curl-t8xhg"] Nov 02 23:10:50.151580 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:50.151489 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-8x87w/trainer-netpol-workload-n4bgj-node-0-0-8j77m"] Nov 02 23:10:50.151786 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:50.151704 5963 kuberuntime_container.go:898] "Killing container with a grace period" pod="test-ns-8x87w/trainer-netpol-workload-n4bgj-node-0-0-8j77m" podUID="93888b3f-8dcb-453b-815f-71c743f7f4e0" containerName="node" containerID="cri-o://6d686c49a69db45f20dca43fd8c7456b8224e6b6a489d09a9bae6c729bfe1453" gracePeriod=30 Nov 02 23:10:50.226598 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:50.226561 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:10:50.780401 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:50.780364 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:10:50.881261 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:50.881215 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:10:51.174377 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:51.174351 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-9b7mr_trainer-netpol-curl-l5zgj_47fd281c-f014-45fb-b7ff-8f503dfa353d/curl/0.log" Nov 02 23:10:51.194991 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:51.194957 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-9b7mr_trainer-netpol-workload-6dggc-node-0-0-fqmp9_216572b0-a4c3-4be2-b2c0-d737c4db50db/node/0.log" Nov 02 23:10:51.864801 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:51.864770 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a16d3e9e-3e36-432c-bbbf-d0ed12af3667" path="/var/lib/kubelet/pods/a16d3e9e-3e36-432c-bbbf-d0ed12af3667/volumes" Nov 02 23:10:54.171888 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:54.171847 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-9b7mr_trainer-netpol-curl-l5zgj_47fd281c-f014-45fb-b7ff-8f503dfa353d/curl/0.log" Nov 02 23:10:54.194087 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:54.194010 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-9b7mr_trainer-netpol-workload-6dggc-node-0-0-fqmp9_216572b0-a4c3-4be2-b2c0-d737c4db50db/node/0.log" Nov 02 23:10:54.919769 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:54.919734 5963 generic.go:356] "Generic (PLEG): container finished" podID="47fd281c-f014-45fb-b7ff-8f503dfa353d" containerID="c774c20cd0dc97d82c13d6aac8f653824995dc3667ad30f4b5e2292c4ba5c040" exitCode=28 Nov 02 23:10:54.919978 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:54.919789 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-9b7mr/trainer-netpol-curl-l5zgj" event={"ID":"47fd281c-f014-45fb-b7ff-8f503dfa353d","Type":"ContainerDied","Data":"c774c20cd0dc97d82c13d6aac8f653824995dc3667ad30f4b5e2292c4ba5c040"} Nov 02 23:10:56.049131 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:56.049110 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-9b7mr/trainer-netpol-curl-l5zgj" Nov 02 23:10:56.124261 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:56.124233 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/47fd281c-f014-45fb-b7ff-8f503dfa353d-kube-api-access-d9lpp\" (UniqueName: \"kubernetes.io/projected/47fd281c-f014-45fb-b7ff-8f503dfa353d-kube-api-access-d9lpp\") pod \"47fd281c-f014-45fb-b7ff-8f503dfa353d\" (UID: \"47fd281c-f014-45fb-b7ff-8f503dfa353d\") " Nov 02 23:10:56.126553 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:56.126524 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47fd281c-f014-45fb-b7ff-8f503dfa353d-kube-api-access-d9lpp" pod "47fd281c-f014-45fb-b7ff-8f503dfa353d" (UID: "47fd281c-f014-45fb-b7ff-8f503dfa353d"). InnerVolumeSpecName "kube-api-access-d9lpp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 23:10:56.225805 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:56.225725 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9lpp\" (UniqueName: \"kubernetes.io/projected/47fd281c-f014-45fb-b7ff-8f503dfa353d-kube-api-access-d9lpp\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 23:10:56.365846 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:56.365812 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-9b7mr_trainer-netpol-curl-l5zgj_47fd281c-f014-45fb-b7ff-8f503dfa353d/curl/0.log" Nov 02 23:10:56.405073 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:56.405043 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-9b7mr_trainer-netpol-curl-l5zgj_47fd281c-f014-45fb-b7ff-8f503dfa353d/curl/0.log" Nov 02 23:10:56.425335 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:56.425313 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-9b7mr_trainer-netpol-workload-6dggc-node-0-0-fqmp9_216572b0-a4c3-4be2-b2c0-d737c4db50db/node/0.log" Nov 02 23:10:56.530195 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:56.530093 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:10:56.929232 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:56.929201 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-9b7mr/trainer-netpol-curl-l5zgj" Nov 02 23:10:56.929413 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:56.929237 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-9b7mr/trainer-netpol-curl-l5zgj" event={"ID":"47fd281c-f014-45fb-b7ff-8f503dfa353d","Type":"ContainerDied","Data":"711a2d85fdee73647617c022086fbd530b412491a7d11ab050939557a8d7dbaa"} Nov 02 23:10:56.929413 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:10:56.929272 5963 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="711a2d85fdee73647617c022086fbd530b412491a7d11ab050939557a8d7dbaa" Nov 02 23:10:59.122240 ip-10-0-139-99 kubenswrapper[5963]: E1102 23:10:59.122203 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 23:11:00.177399 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:00.177364 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-v6pxk/must-gather-vj927"] Nov 02 23:11:00.177848 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:00.177742 5963 cpu_manager.go:414] "containerMap: removing container" podUID="47fd281c-f014-45fb-b7ff-8f503dfa353d" containerName="curl" Nov 02 23:11:00.177848 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:00.177755 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="47fd281c-f014-45fb-b7ff-8f503dfa353d" containerName="curl" Nov 02 23:11:00.177848 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:00.177830 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="47fd281c-f014-45fb-b7ff-8f503dfa353d" containerName="curl" Nov 02 23:11:00.180840 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:00.180822 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v6pxk/must-gather-vj927" Nov 02 23:11:00.186537 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:00.186506 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:11:00.189780 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:00.189741 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v6pxk\"/\"openshift-service-ca.crt\"" Nov 02 23:11:00.189908 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:00.189802 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-v6pxk\"/\"default-dockercfg-kw5tb\"" Nov 02 23:11:00.190291 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:00.189723 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v6pxk\"/\"kube-root-ca.crt\"" Nov 02 23:11:00.191824 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:00.191798 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v6pxk/must-gather-vj927"] Nov 02 23:11:00.261234 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:00.261198 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76-must-gather-output\") pod \"must-gather-vj927\" (UID: \"ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76\") " pod="openshift-must-gather-v6pxk/must-gather-vj927" Nov 02 23:11:00.261234 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:00.261231 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdhz5\" (UniqueName: \"kubernetes.io/projected/ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76-kube-api-access-tdhz5\") pod \"must-gather-vj927\" (UID: \"ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76\") " pod="openshift-must-gather-v6pxk/must-gather-vj927" Nov 02 23:11:00.280049 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:00.280020 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:11:00.362562 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:00.362520 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76-must-gather-output\") pod \"must-gather-vj927\" (UID: \"ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76\") " pod="openshift-must-gather-v6pxk/must-gather-vj927" Nov 02 23:11:00.362562 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:00.362559 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdhz5\" (UniqueName: \"kubernetes.io/projected/ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76-kube-api-access-tdhz5\") pod \"must-gather-vj927\" (UID: \"ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76\") " pod="openshift-must-gather-v6pxk/must-gather-vj927" Nov 02 23:11:00.362969 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:00.362948 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76-must-gather-output\") pod \"must-gather-vj927\" (UID: \"ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76\") " pod="openshift-must-gather-v6pxk/must-gather-vj927" Nov 02 23:11:00.374887 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:00.374863 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdhz5\" (UniqueName: \"kubernetes.io/projected/ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76-kube-api-access-tdhz5\") pod \"must-gather-vj927\" (UID: \"ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76\") " pod="openshift-must-gather-v6pxk/must-gather-vj927" Nov 02 23:11:00.498888 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:00.498797 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v6pxk/must-gather-vj927" Nov 02 23:11:00.769992 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:00.769919 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v6pxk/must-gather-vj927"] Nov 02 23:11:00.773149 ip-10-0-139-99 kubenswrapper[5963]: W1102 23:11:00.773113 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee6e09dc_05ff_4cbf_a7c4_6a4bf7ab7d76.slice/crio-664a69016fa46a157f1143fa6793431c5c2bbf99cfd71798c613995faffc2a90 WatchSource:0}: Error finding container 664a69016fa46a157f1143fa6793431c5c2bbf99cfd71798c613995faffc2a90: Status 404 returned error can't find the container with id 664a69016fa46a157f1143fa6793431c5c2bbf99cfd71798c613995faffc2a90 Nov 02 23:11:00.948368 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:00.948330 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v6pxk/must-gather-vj927" event={"ID":"ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76","Type":"ContainerStarted","Data":"664a69016fa46a157f1143fa6793431c5c2bbf99cfd71798c613995faffc2a90"} Nov 02 23:11:01.351763 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:01.351722 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:11:01.485631 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:01.485597 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-9b7mr/trainer-netpol-curl-l5zgj"] Nov 02 23:11:01.490803 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:01.490776 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-9b7mr/trainer-netpol-curl-l5zgj"] Nov 02 23:11:01.497721 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:01.497694 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-9b7mr/trainer-netpol-workload-6dggc-node-0-0-fqmp9"] Nov 02 23:11:01.497907 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:01.497886 5963 kuberuntime_container.go:898] "Killing container with a grace period" pod="test-ns-9b7mr/trainer-netpol-workload-6dggc-node-0-0-fqmp9" podUID="216572b0-a4c3-4be2-b2c0-d737c4db50db" containerName="node" containerID="cri-o://bd4a6a4d53e8a9f76db9abfa26e041410af97ca6238bd713e1529e73b3fe9570" gracePeriod=30 Nov 02 23:11:01.569132 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:01.569083 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:11:01.867758 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:01.867719 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="47fd281c-f014-45fb-b7ff-8f503dfa353d" path="/var/lib/kubelet/pods/47fd281c-f014-45fb-b7ff-8f503dfa353d/volumes" Nov 02 23:11:07.988204 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:07.988161 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v6pxk/must-gather-vj927" event={"ID":"ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76","Type":"ContainerStarted","Data":"cc5b158b7795e11f85a21abf0d7e1cfd3dcb39d086888eb895a0c9501e161aa5"} Nov 02 23:11:07.988683 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:07.988214 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v6pxk/must-gather-vj927" event={"ID":"ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76","Type":"ContainerStarted","Data":"67e0baa44a38ed50f99af8e53faf0143fe69c5e478dbb68b46729d40390a5dc6"} Nov 02 23:11:12.007190 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:12.007153 5963 generic.go:356] "Generic (PLEG): container finished" podID="ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76" containerID="67e0baa44a38ed50f99af8e53faf0143fe69c5e478dbb68b46729d40390a5dc6" exitCode=0 Nov 02 23:11:12.007733 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:12.007209 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v6pxk/must-gather-vj927" event={"ID":"ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76","Type":"ContainerDied","Data":"67e0baa44a38ed50f99af8e53faf0143fe69c5e478dbb68b46729d40390a5dc6"} Nov 02 23:11:12.007733 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:12.007608 5963 scope.go:122] "RemoveContainer" containerID="67e0baa44a38ed50f99af8e53faf0143fe69c5e478dbb68b46729d40390a5dc6" Nov 02 23:11:12.422619 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:12.422577 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-v6pxk_must-gather-vj927_ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76/gather/0.log" Nov 02 23:11:12.989826 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:12.989794 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:11:13.281870 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:13.281789 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:11:13.390600 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:13.390569 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:11:16.481985 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:16.481948 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vcx54_649dd5b0-1649-4f63-a148-40fd3f3e07f4/global-pull-secret-syncer/0.log" Nov 02 23:11:16.668091 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:16.668054 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" Nov 02 23:11:16.871182 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:16.871145 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-99.us-east-2.compute.internal_de883a853e4817557c8c217fade4c52e/haproxy/0.log" Nov 02 23:11:17.935445 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:17.935406 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-v6pxk/must-gather-vj927"] Nov 02 23:11:17.935878 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:17.935571 5963 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-must-gather-v6pxk/must-gather-vj927" podUID="ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76" containerName="copy" containerID="cri-o://cc5b158b7795e11f85a21abf0d7e1cfd3dcb39d086888eb895a0c9501e161aa5" gracePeriod=2 Nov 02 23:11:17.940631 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:17.940605 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-v6pxk/must-gather-vj927"] Nov 02 23:11:18.178974 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:18.178948 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-v6pxk_must-gather-vj927_ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76/copy/0.log" Nov 02 23:11:18.181444 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:18.181426 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v6pxk/must-gather-vj927" Nov 02 23:11:18.183915 ip-10-0-139-99 kubenswrapper[5963]: E1102 23:11:18.183884 5963 status_manager.go:1045] "Failed to get status for pod" err="pods \"must-gather-vj927\" is forbidden: User \"system:node:ip-10-0-139-99.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-v6pxk\": no relationship found between node 'ip-10-0-139-99.us-east-2.compute.internal' and this object" podUID="ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76" pod="openshift-must-gather-v6pxk/must-gather-vj927" Nov 02 23:11:18.328393 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:18.328369 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76-must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76-must-gather-output\") pod \"ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76\" (UID: \"ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76\") " Nov 02 23:11:18.328562 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:18.328443 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76-kube-api-access-tdhz5\" (UniqueName: \"kubernetes.io/projected/ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76-kube-api-access-tdhz5\") pod \"ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76\" (UID: \"ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76\") " Nov 02 23:11:18.328800 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:18.328780 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76-must-gather-output" pod "ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76" (UID: "ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 23:11:18.330752 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:18.330734 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76-kube-api-access-tdhz5" pod "ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76" (UID: "ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76"). InnerVolumeSpecName "kube-api-access-tdhz5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 23:11:18.429411 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:18.429375 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdhz5\" (UniqueName: \"kubernetes.io/projected/ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76-kube-api-access-tdhz5\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 23:11:18.429411 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:18.429407 5963 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76-must-gather-output\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 23:11:18.763655 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:18.763554 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:11:18.857617 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:18.857583 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:11:19.037452 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:19.037365 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-v6pxk_must-gather-vj927_ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76/copy/0.log" Nov 02 23:11:19.037902 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:19.037730 5963 generic.go:356] "Generic (PLEG): container finished" podID="ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76" containerID="cc5b158b7795e11f85a21abf0d7e1cfd3dcb39d086888eb895a0c9501e161aa5" exitCode=143 Nov 02 23:11:19.037902 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:19.037790 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v6pxk/must-gather-vj927" Nov 02 23:11:19.037902 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:19.037819 5963 scope.go:122] "RemoveContainer" containerID="cc5b158b7795e11f85a21abf0d7e1cfd3dcb39d086888eb895a0c9501e161aa5" Nov 02 23:11:19.040419 ip-10-0-139-99 kubenswrapper[5963]: E1102 23:11:19.040386 5963 status_manager.go:1045] "Failed to get status for pod" err="pods \"must-gather-vj927\" is forbidden: User \"system:node:ip-10-0-139-99.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-v6pxk\": no relationship found between node 'ip-10-0-139-99.us-east-2.compute.internal' and this object" podUID="ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76" pod="openshift-must-gather-v6pxk/must-gather-vj927" Nov 02 23:11:19.048462 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:19.048446 5963 scope.go:122] "RemoveContainer" containerID="67e0baa44a38ed50f99af8e53faf0143fe69c5e478dbb68b46729d40390a5dc6" Nov 02 23:11:19.049070 ip-10-0-139-99 kubenswrapper[5963]: E1102 23:11:19.049036 5963 status_manager.go:1045] "Failed to get status for pod" err="pods \"must-gather-vj927\" is forbidden: User \"system:node:ip-10-0-139-99.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-v6pxk\": no relationship found between node 'ip-10-0-139-99.us-east-2.compute.internal' and this object" podUID="ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76" pod="openshift-must-gather-v6pxk/must-gather-vj927" Nov 02 23:11:19.056582 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:19.056562 5963 scope.go:122] "RemoveContainer" containerID="cc5b158b7795e11f85a21abf0d7e1cfd3dcb39d086888eb895a0c9501e161aa5" Nov 02 23:11:19.056855 ip-10-0-139-99 kubenswrapper[5963]: E1102 23:11:19.056837 5963 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc5b158b7795e11f85a21abf0d7e1cfd3dcb39d086888eb895a0c9501e161aa5\": container with ID starting with cc5b158b7795e11f85a21abf0d7e1cfd3dcb39d086888eb895a0c9501e161aa5 not found: ID does not exist" containerID="cc5b158b7795e11f85a21abf0d7e1cfd3dcb39d086888eb895a0c9501e161aa5" Nov 02 23:11:19.056917 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:19.056865 5963 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc5b158b7795e11f85a21abf0d7e1cfd3dcb39d086888eb895a0c9501e161aa5"} err="failed to get container status \"cc5b158b7795e11f85a21abf0d7e1cfd3dcb39d086888eb895a0c9501e161aa5\": rpc error: code = NotFound desc = could not find container \"cc5b158b7795e11f85a21abf0d7e1cfd3dcb39d086888eb895a0c9501e161aa5\": container with ID starting with cc5b158b7795e11f85a21abf0d7e1cfd3dcb39d086888eb895a0c9501e161aa5 not found: ID does not exist" Nov 02 23:11:19.056917 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:19.056882 5963 scope.go:122] "RemoveContainer" containerID="67e0baa44a38ed50f99af8e53faf0143fe69c5e478dbb68b46729d40390a5dc6" Nov 02 23:11:19.057134 ip-10-0-139-99 kubenswrapper[5963]: E1102 23:11:19.057116 5963 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67e0baa44a38ed50f99af8e53faf0143fe69c5e478dbb68b46729d40390a5dc6\": container with ID starting with 67e0baa44a38ed50f99af8e53faf0143fe69c5e478dbb68b46729d40390a5dc6 not found: ID does not exist" containerID="67e0baa44a38ed50f99af8e53faf0143fe69c5e478dbb68b46729d40390a5dc6" Nov 02 23:11:19.057176 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:19.057143 5963 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67e0baa44a38ed50f99af8e53faf0143fe69c5e478dbb68b46729d40390a5dc6"} err="failed to get container status \"67e0baa44a38ed50f99af8e53faf0143fe69c5e478dbb68b46729d40390a5dc6\": rpc error: code = NotFound desc = could not find container \"67e0baa44a38ed50f99af8e53faf0143fe69c5e478dbb68b46729d40390a5dc6\": container with ID starting with 67e0baa44a38ed50f99af8e53faf0143fe69c5e478dbb68b46729d40390a5dc6 not found: ID does not exist" Nov 02 23:11:19.864065 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:19.864032 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76" path="/var/lib/kubelet/pods/ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76/volumes" Nov 02 23:11:20.344120 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:20.344096 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-8x87w/trainer-netpol-workload-n4bgj-node-0-0-8j77m" Nov 02 23:11:20.448147 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:20.448046 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/93888b3f-8dcb-453b-815f-71c743f7f4e0-kube-api-access-gcvvt\" (UniqueName: \"kubernetes.io/projected/93888b3f-8dcb-453b-815f-71c743f7f4e0-kube-api-access-gcvvt\") pod \"93888b3f-8dcb-453b-815f-71c743f7f4e0\" (UID: \"93888b3f-8dcb-453b-815f-71c743f7f4e0\") " Nov 02 23:11:20.450445 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:20.450408 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93888b3f-8dcb-453b-815f-71c743f7f4e0-kube-api-access-gcvvt" pod "93888b3f-8dcb-453b-815f-71c743f7f4e0" (UID: "93888b3f-8dcb-453b-815f-71c743f7f4e0"). InnerVolumeSpecName "kube-api-access-gcvvt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 23:11:20.549582 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:20.549537 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcvvt\" (UniqueName: \"kubernetes.io/projected/93888b3f-8dcb-453b-815f-71c743f7f4e0-kube-api-access-gcvvt\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 23:11:21.048625 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:21.048589 5963 generic.go:356] "Generic (PLEG): container finished" podID="93888b3f-8dcb-453b-815f-71c743f7f4e0" containerID="6d686c49a69db45f20dca43fd8c7456b8224e6b6a489d09a9bae6c729bfe1453" exitCode=137 Nov 02 23:11:21.048850 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:21.048630 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-8x87w/trainer-netpol-workload-n4bgj-node-0-0-8j77m" Nov 02 23:11:21.048850 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:21.048699 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-8x87w/trainer-netpol-workload-n4bgj-node-0-0-8j77m" event={"ID":"93888b3f-8dcb-453b-815f-71c743f7f4e0","Type":"ContainerDied","Data":"6d686c49a69db45f20dca43fd8c7456b8224e6b6a489d09a9bae6c729bfe1453"} Nov 02 23:11:21.048850 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:21.048750 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-8x87w/trainer-netpol-workload-n4bgj-node-0-0-8j77m" event={"ID":"93888b3f-8dcb-453b-815f-71c743f7f4e0","Type":"ContainerDied","Data":"86ff55d7664fc3ea5bd586ab95bf34e86b4629a445ffaa415d64d2fa25b9b683"} Nov 02 23:11:21.048850 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:21.048775 5963 scope.go:122] "RemoveContainer" containerID="6d686c49a69db45f20dca43fd8c7456b8224e6b6a489d09a9bae6c729bfe1453" Nov 02 23:11:21.058537 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:21.058515 5963 scope.go:122] "RemoveContainer" containerID="6d686c49a69db45f20dca43fd8c7456b8224e6b6a489d09a9bae6c729bfe1453" Nov 02 23:11:21.058914 ip-10-0-139-99 kubenswrapper[5963]: E1102 23:11:21.058891 5963 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d686c49a69db45f20dca43fd8c7456b8224e6b6a489d09a9bae6c729bfe1453\": container with ID starting with 6d686c49a69db45f20dca43fd8c7456b8224e6b6a489d09a9bae6c729bfe1453 not found: ID does not exist" containerID="6d686c49a69db45f20dca43fd8c7456b8224e6b6a489d09a9bae6c729bfe1453" Nov 02 23:11:21.059029 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:21.058921 5963 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d686c49a69db45f20dca43fd8c7456b8224e6b6a489d09a9bae6c729bfe1453"} err="failed to get container status \"6d686c49a69db45f20dca43fd8c7456b8224e6b6a489d09a9bae6c729bfe1453\": rpc error: code = NotFound desc = could not find container \"6d686c49a69db45f20dca43fd8c7456b8224e6b6a489d09a9bae6c729bfe1453\": container with ID starting with 6d686c49a69db45f20dca43fd8c7456b8224e6b6a489d09a9bae6c729bfe1453 not found: ID does not exist" Nov 02 23:11:21.070373 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:21.070342 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-8x87w/trainer-netpol-workload-n4bgj-node-0-0-8j77m"] Nov 02 23:11:21.075069 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:21.075040 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-8x87w/trainer-netpol-workload-n4bgj-node-0-0-8j77m"] Nov 02 23:11:21.849611 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:21.849580 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7915633e-afc1-45ce-9192-3f05daef918a/alertmanager/0.log" Nov 02 23:11:21.864490 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:21.864460 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="93888b3f-8dcb-453b-815f-71c743f7f4e0" path="/var/lib/kubelet/pods/93888b3f-8dcb-453b-815f-71c743f7f4e0/volumes" Nov 02 23:11:21.874865 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:21.874837 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7915633e-afc1-45ce-9192-3f05daef918a/config-reloader/0.log" Nov 02 23:11:21.905333 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:21.905301 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7915633e-afc1-45ce-9192-3f05daef918a/kube-rbac-proxy-web/0.log" Nov 02 23:11:21.936378 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:21.936351 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7915633e-afc1-45ce-9192-3f05daef918a/kube-rbac-proxy/0.log" Nov 02 23:11:21.967988 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:21.967957 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7915633e-afc1-45ce-9192-3f05daef918a/kube-rbac-proxy-metric/0.log" Nov 02 23:11:22.004117 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:22.004091 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7915633e-afc1-45ce-9192-3f05daef918a/prom-label-proxy/0.log" Nov 02 23:11:22.030619 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:22.030590 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7915633e-afc1-45ce-9192-3f05daef918a/init-config-reloader/0.log" Nov 02 23:11:22.123273 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:22.123238 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-w8nqg_52ac610d-a729-4e9f-b70b-700d30dbf64a/kube-state-metrics/0.log" Nov 02 23:11:22.142651 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:22.142626 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-w8nqg_52ac610d-a729-4e9f-b70b-700d30dbf64a/kube-rbac-proxy-main/0.log" Nov 02 23:11:22.169588 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:22.169558 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-w8nqg_52ac610d-a729-4e9f-b70b-700d30dbf64a/kube-rbac-proxy-self/0.log" Nov 02 23:11:22.218230 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:22.218196 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-76cf56f7bc-r5j6d_cb3cdef3-ff8c-4e53-8852-81d064f58c21/metrics-server/0.log" Nov 02 23:11:22.373513 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:22.373424 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lzs7z_e71535c3-0a11-43fc-ad7e-4ea18213f0cf/node-exporter/0.log" Nov 02 23:11:22.399113 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:22.399073 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lzs7z_e71535c3-0a11-43fc-ad7e-4ea18213f0cf/kube-rbac-proxy/0.log" Nov 02 23:11:22.435596 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:22.435572 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lzs7z_e71535c3-0a11-43fc-ad7e-4ea18213f0cf/init-textfile/0.log" Nov 02 23:11:22.566221 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:22.566174 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-jffwq_4e73c1ca-fa5d-4485-a439-a6f8eb19a731/kube-rbac-proxy-main/0.log" Nov 02 23:11:22.596045 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:22.596013 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-jffwq_4e73c1ca-fa5d-4485-a439-a6f8eb19a731/kube-rbac-proxy-self/0.log" Nov 02 23:11:22.621528 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:22.621494 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-jffwq_4e73c1ca-fa5d-4485-a439-a6f8eb19a731/openshift-state-metrics/0.log" Nov 02 23:11:22.660001 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:22.659906 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_af89cac1-f11d-4d03-bdb6-6a2d983ea393/prometheus/0.log" Nov 02 23:11:22.687122 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:22.687087 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_af89cac1-f11d-4d03-bdb6-6a2d983ea393/config-reloader/0.log" Nov 02 23:11:22.713644 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:22.713616 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_af89cac1-f11d-4d03-bdb6-6a2d983ea393/thanos-sidecar/0.log" Nov 02 23:11:22.739927 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:22.739894 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_af89cac1-f11d-4d03-bdb6-6a2d983ea393/kube-rbac-proxy-web/0.log" Nov 02 23:11:22.765009 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:22.764980 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_af89cac1-f11d-4d03-bdb6-6a2d983ea393/kube-rbac-proxy/0.log" Nov 02 23:11:22.793016 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:22.792964 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_af89cac1-f11d-4d03-bdb6-6a2d983ea393/kube-rbac-proxy-thanos/0.log" Nov 02 23:11:22.818871 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:22.818841 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_af89cac1-f11d-4d03-bdb6-6a2d983ea393/init-config-reloader/0.log" Nov 02 23:11:22.855362 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:22.855326 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-ltszg_15d3a384-31d9-4152-9e38-491942e6d5c5/prometheus-operator/0.log" Nov 02 23:11:22.875149 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:22.875119 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-ltszg_15d3a384-31d9-4152-9e38-491942e6d5c5/kube-rbac-proxy/0.log" Nov 02 23:11:23.040606 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:23.040534 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74977cc9f9-qzn9x_2e3415b9-cef2-439e-a516-f4adc73822c4/thanos-query/0.log" Nov 02 23:11:23.066111 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:23.066086 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74977cc9f9-qzn9x_2e3415b9-cef2-439e-a516-f4adc73822c4/kube-rbac-proxy-web/0.log" Nov 02 23:11:23.092824 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:23.092795 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74977cc9f9-qzn9x_2e3415b9-cef2-439e-a516-f4adc73822c4/kube-rbac-proxy/0.log" Nov 02 23:11:23.117979 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:23.117944 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74977cc9f9-qzn9x_2e3415b9-cef2-439e-a516-f4adc73822c4/prom-label-proxy/0.log" Nov 02 23:11:23.144265 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:23.144234 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74977cc9f9-qzn9x_2e3415b9-cef2-439e-a516-f4adc73822c4/kube-rbac-proxy-rules/0.log" Nov 02 23:11:23.170586 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:23.170554 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74977cc9f9-qzn9x_2e3415b9-cef2-439e-a516-f4adc73822c4/kube-rbac-proxy-metrics/0.log" Nov 02 23:11:23.781635 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:23.781595 5963 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xs6vt/perf-node-gather-daemonset-m7ffc"] Nov 02 23:11:23.782076 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:23.782057 5963 cpu_manager.go:414] "containerMap: removing container" podUID="ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76" containerName="gather" Nov 02 23:11:23.782165 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:23.782078 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76" containerName="gather" Nov 02 23:11:23.782165 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:23.782102 5963 cpu_manager.go:414] "containerMap: removing container" podUID="ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76" containerName="copy" Nov 02 23:11:23.782165 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:23.782110 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76" containerName="copy" Nov 02 23:11:23.782165 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:23.782138 5963 cpu_manager.go:414] "containerMap: removing container" podUID="93888b3f-8dcb-453b-815f-71c743f7f4e0" containerName="node" Nov 02 23:11:23.782165 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:23.782146 5963 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="93888b3f-8dcb-453b-815f-71c743f7f4e0" containerName="node" Nov 02 23:11:23.786237 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:23.782571 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="93888b3f-8dcb-453b-815f-71c743f7f4e0" containerName="node" Nov 02 23:11:23.786237 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:23.782688 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76" containerName="gather" Nov 02 23:11:23.786237 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:23.782726 5963 memory_manager.go:365] "RemoveStaleState removing state" podUID="ee6e09dc-05ff-4cbf-a7c4-6a4bf7ab7d76" containerName="copy" Nov 02 23:11:23.789274 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:23.789245 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xs6vt/perf-node-gather-daemonset-m7ffc" Nov 02 23:11:23.796423 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:23.796391 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xs6vt/perf-node-gather-daemonset-m7ffc"] Nov 02 23:11:23.796620 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:23.796529 5963 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xs6vt\"/\"default-dockercfg-mf5sd\"" Nov 02 23:11:23.796620 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:23.796569 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xs6vt\"/\"kube-root-ca.crt\"" Nov 02 23:11:23.796620 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:23.796574 5963 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xs6vt\"/\"openshift-service-ca.crt\"" Nov 02 23:11:23.878414 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:23.878373 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/37322ae4-41d2-4923-9dc6-87f2c372e1d3-lib-modules\") pod \"perf-node-gather-daemonset-m7ffc\" (UID: \"37322ae4-41d2-4923-9dc6-87f2c372e1d3\") " pod="openshift-must-gather-xs6vt/perf-node-gather-daemonset-m7ffc" Nov 02 23:11:23.878414 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:23.878421 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/37322ae4-41d2-4923-9dc6-87f2c372e1d3-proc\") pod \"perf-node-gather-daemonset-m7ffc\" (UID: \"37322ae4-41d2-4923-9dc6-87f2c372e1d3\") " pod="openshift-must-gather-xs6vt/perf-node-gather-daemonset-m7ffc" Nov 02 23:11:23.878894 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:23.878443 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn9jh\" (UniqueName: \"kubernetes.io/projected/37322ae4-41d2-4923-9dc6-87f2c372e1d3-kube-api-access-qn9jh\") pod \"perf-node-gather-daemonset-m7ffc\" (UID: \"37322ae4-41d2-4923-9dc6-87f2c372e1d3\") " pod="openshift-must-gather-xs6vt/perf-node-gather-daemonset-m7ffc" Nov 02 23:11:23.878894 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:23.878570 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37322ae4-41d2-4923-9dc6-87f2c372e1d3-sys\") pod \"perf-node-gather-daemonset-m7ffc\" (UID: \"37322ae4-41d2-4923-9dc6-87f2c372e1d3\") " pod="openshift-must-gather-xs6vt/perf-node-gather-daemonset-m7ffc" Nov 02 23:11:23.878894 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:23.878685 5963 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/37322ae4-41d2-4923-9dc6-87f2c372e1d3-podres\") pod \"perf-node-gather-daemonset-m7ffc\" (UID: \"37322ae4-41d2-4923-9dc6-87f2c372e1d3\") " pod="openshift-must-gather-xs6vt/perf-node-gather-daemonset-m7ffc" Nov 02 23:11:23.979693 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:23.979624 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/37322ae4-41d2-4923-9dc6-87f2c372e1d3-podres\") pod \"perf-node-gather-daemonset-m7ffc\" (UID: \"37322ae4-41d2-4923-9dc6-87f2c372e1d3\") " pod="openshift-must-gather-xs6vt/perf-node-gather-daemonset-m7ffc" Nov 02 23:11:23.979843 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:23.979765 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/37322ae4-41d2-4923-9dc6-87f2c372e1d3-podres\") pod \"perf-node-gather-daemonset-m7ffc\" (UID: \"37322ae4-41d2-4923-9dc6-87f2c372e1d3\") " pod="openshift-must-gather-xs6vt/perf-node-gather-daemonset-m7ffc" Nov 02 23:11:23.979843 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:23.979794 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/37322ae4-41d2-4923-9dc6-87f2c372e1d3-lib-modules\") pod \"perf-node-gather-daemonset-m7ffc\" (UID: \"37322ae4-41d2-4923-9dc6-87f2c372e1d3\") " pod="openshift-must-gather-xs6vt/perf-node-gather-daemonset-m7ffc" Nov 02 23:11:23.979912 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:23.979856 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/37322ae4-41d2-4923-9dc6-87f2c372e1d3-lib-modules\") pod \"perf-node-gather-daemonset-m7ffc\" (UID: \"37322ae4-41d2-4923-9dc6-87f2c372e1d3\") " pod="openshift-must-gather-xs6vt/perf-node-gather-daemonset-m7ffc" Nov 02 23:11:23.979912 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:23.979879 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/37322ae4-41d2-4923-9dc6-87f2c372e1d3-proc\") pod \"perf-node-gather-daemonset-m7ffc\" (UID: \"37322ae4-41d2-4923-9dc6-87f2c372e1d3\") " pod="openshift-must-gather-xs6vt/perf-node-gather-daemonset-m7ffc" Nov 02 23:11:23.979995 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:23.979981 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn9jh\" (UniqueName: \"kubernetes.io/projected/37322ae4-41d2-4923-9dc6-87f2c372e1d3-kube-api-access-qn9jh\") pod \"perf-node-gather-daemonset-m7ffc\" (UID: \"37322ae4-41d2-4923-9dc6-87f2c372e1d3\") " pod="openshift-must-gather-xs6vt/perf-node-gather-daemonset-m7ffc" Nov 02 23:11:23.980030 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:23.980015 5963 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37322ae4-41d2-4923-9dc6-87f2c372e1d3-sys\") pod \"perf-node-gather-daemonset-m7ffc\" (UID: \"37322ae4-41d2-4923-9dc6-87f2c372e1d3\") " pod="openshift-must-gather-xs6vt/perf-node-gather-daemonset-m7ffc" Nov 02 23:11:23.980063 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:23.980047 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/37322ae4-41d2-4923-9dc6-87f2c372e1d3-proc\") pod \"perf-node-gather-daemonset-m7ffc\" (UID: \"37322ae4-41d2-4923-9dc6-87f2c372e1d3\") " pod="openshift-must-gather-xs6vt/perf-node-gather-daemonset-m7ffc" Nov 02 23:11:23.980107 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:23.980080 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37322ae4-41d2-4923-9dc6-87f2c372e1d3-sys\") pod \"perf-node-gather-daemonset-m7ffc\" (UID: \"37322ae4-41d2-4923-9dc6-87f2c372e1d3\") " pod="openshift-must-gather-xs6vt/perf-node-gather-daemonset-m7ffc" Nov 02 23:11:23.993001 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:23.992969 5963 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn9jh\" (UniqueName: \"kubernetes.io/projected/37322ae4-41d2-4923-9dc6-87f2c372e1d3-kube-api-access-qn9jh\") pod \"perf-node-gather-daemonset-m7ffc\" (UID: \"37322ae4-41d2-4923-9dc6-87f2c372e1d3\") " pod="openshift-must-gather-xs6vt/perf-node-gather-daemonset-m7ffc" Nov 02 23:11:24.103823 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:24.103788 5963 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xs6vt/perf-node-gather-daemonset-m7ffc" Nov 02 23:11:24.377086 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:24.377011 5963 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xs6vt/perf-node-gather-daemonset-m7ffc"] Nov 02 23:11:24.380848 ip-10-0-139-99 kubenswrapper[5963]: W1102 23:11:24.380812 5963 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod37322ae4_41d2_4923_9dc6_87f2c372e1d3.slice/crio-da6e60b200e98bd2ad525adcb88d13123fe0e11a7da1bde9c3788258c83b638d WatchSource:0}: Error finding container da6e60b200e98bd2ad525adcb88d13123fe0e11a7da1bde9c3788258c83b638d: Status 404 returned error can't find the container with id da6e60b200e98bd2ad525adcb88d13123fe0e11a7da1bde9c3788258c83b638d Nov 02 23:11:25.068655 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:25.068616 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xs6vt/perf-node-gather-daemonset-m7ffc" event={"ID":"37322ae4-41d2-4923-9dc6-87f2c372e1d3","Type":"ContainerStarted","Data":"ae02c500f71cb67ea43ae7e19007d61373f8de5a6973bbf044051deb0be6d68d"} Nov 02 23:11:25.068655 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:25.068697 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xs6vt/perf-node-gather-daemonset-m7ffc" event={"ID":"37322ae4-41d2-4923-9dc6-87f2c372e1d3","Type":"ContainerStarted","Data":"da6e60b200e98bd2ad525adcb88d13123fe0e11a7da1bde9c3788258c83b638d"} Nov 02 23:11:25.069157 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:25.068737 5963 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xs6vt/perf-node-gather-daemonset-m7ffc" Nov 02 23:11:25.087111 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:25.087054 5963 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-xs6vt/perf-node-gather-daemonset-m7ffc" podStartSLOduration=2.087039994 podStartE2EDuration="2.087039994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 23:11:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 23:11:25.086307783 +0000 UTC m=+4657.338306288" watchObservedRunningTime="2026-11-02 23:11:25.087039994 +0000 UTC m=+4657.339038459" Nov 02 23:11:26.595782 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:26.595751 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ntgwx_e761db17-b05a-4f51-8fb9-c2126ee35fe1/dns/0.log" Nov 02 23:11:26.621022 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:26.620993 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ntgwx_e761db17-b05a-4f51-8fb9-c2126ee35fe1/kube-rbac-proxy/0.log" Nov 02 23:11:26.703819 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:26.703788 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ck8br_983b05f9-8574-4a23-b3de-951a68c553a1/dns-node-resolver/0.log" Nov 02 23:11:27.246841 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:27.246806 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bjwd8_c0fdd204-e1ad-4de8-ab18-52ab672cc3a4/node-ca/0.log" Nov 02 23:11:27.399618 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:27.399582 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:11:27.985861 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:27.985823 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:11:28.608992 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:28.608960 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m95sf_76322934-bb51-4c0e-a7df-37f506b6cfc4/serve-healthcheck-canary/0.log" Nov 02 23:11:29.122767 ip-10-0-139-99 kubenswrapper[5963]: E1102 23:11:29.122729 5963 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nltff" containerName="extractor" Nov 02 23:11:29.184169 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:29.184127 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nltff_e2026273-f131-45c2-a443-c66a07d518ae/kube-rbac-proxy/0.log" Nov 02 23:11:29.208470 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:29.208436 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nltff_e2026273-f131-45c2-a443-c66a07d518ae/exporter/0.log" Nov 02 23:11:29.233947 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:29.233914 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nltff_e2026273-f131-45c2-a443-c66a07d518ae/extractor/0.log" Nov 02 23:11:30.824949 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:30.824915 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kueue-operator_openshift-kueue-operator-86d856df97-dm5tq_513a8fcd-52cd-49d3-85cc-54235323d939/openshift-kueue-operator/0.log" Nov 02 23:11:31.083792 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:31.083723 5963 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xs6vt/perf-node-gather-daemonset-m7ffc" Nov 02 23:11:31.695392 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:31.695363 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-9b7mr/trainer-netpol-workload-6dggc-node-0-0-fqmp9" Nov 02 23:11:31.849145 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:31.849115 5963 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/216572b0-a4c3-4be2-b2c0-d737c4db50db-kube-api-access-jww4r\" (UniqueName: \"kubernetes.io/projected/216572b0-a4c3-4be2-b2c0-d737c4db50db-kube-api-access-jww4r\") pod \"216572b0-a4c3-4be2-b2c0-d737c4db50db\" (UID: \"216572b0-a4c3-4be2-b2c0-d737c4db50db\") " Nov 02 23:11:31.851384 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:31.851352 5963 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/216572b0-a4c3-4be2-b2c0-d737c4db50db-kube-api-access-jww4r" pod "216572b0-a4c3-4be2-b2c0-d737c4db50db" (UID: "216572b0-a4c3-4be2-b2c0-d737c4db50db"). InnerVolumeSpecName "kube-api-access-jww4r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 23:11:31.949745 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:31.949709 5963 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jww4r\" (UniqueName: \"kubernetes.io/projected/216572b0-a4c3-4be2-b2c0-d737c4db50db-kube-api-access-jww4r\") on node \"ip-10-0-139-99.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 23:11:32.101162 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:32.101063 5963 generic.go:356] "Generic (PLEG): container finished" podID="216572b0-a4c3-4be2-b2c0-d737c4db50db" containerID="bd4a6a4d53e8a9f76db9abfa26e041410af97ca6238bd713e1529e73b3fe9570" exitCode=137 Nov 02 23:11:32.101162 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:32.101107 5963 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-9b7mr/trainer-netpol-workload-6dggc-node-0-0-fqmp9" Nov 02 23:11:32.101377 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:32.101156 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-9b7mr/trainer-netpol-workload-6dggc-node-0-0-fqmp9" event={"ID":"216572b0-a4c3-4be2-b2c0-d737c4db50db","Type":"ContainerDied","Data":"bd4a6a4d53e8a9f76db9abfa26e041410af97ca6238bd713e1529e73b3fe9570"} Nov 02 23:11:32.101377 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:32.101203 5963 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="test-ns-9b7mr/trainer-netpol-workload-6dggc-node-0-0-fqmp9" event={"ID":"216572b0-a4c3-4be2-b2c0-d737c4db50db","Type":"ContainerDied","Data":"16c49fa5fd55f6c69f2799f17d567ed69b9ce266b6e168ca23502e8bcaed25a5"} Nov 02 23:11:32.101377 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:32.101222 5963 scope.go:122] "RemoveContainer" containerID="bd4a6a4d53e8a9f76db9abfa26e041410af97ca6238bd713e1529e73b3fe9570" Nov 02 23:11:32.110087 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:32.110065 5963 scope.go:122] "RemoveContainer" containerID="bd4a6a4d53e8a9f76db9abfa26e041410af97ca6238bd713e1529e73b3fe9570" Nov 02 23:11:32.110404 ip-10-0-139-99 kubenswrapper[5963]: E1102 23:11:32.110384 5963 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd4a6a4d53e8a9f76db9abfa26e041410af97ca6238bd713e1529e73b3fe9570\": container with ID starting with bd4a6a4d53e8a9f76db9abfa26e041410af97ca6238bd713e1529e73b3fe9570 not found: ID does not exist" containerID="bd4a6a4d53e8a9f76db9abfa26e041410af97ca6238bd713e1529e73b3fe9570" Nov 02 23:11:32.110452 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:32.110414 5963 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd4a6a4d53e8a9f76db9abfa26e041410af97ca6238bd713e1529e73b3fe9570"} err="failed to get container status \"bd4a6a4d53e8a9f76db9abfa26e041410af97ca6238bd713e1529e73b3fe9570\": rpc error: code = NotFound desc = could not find container \"bd4a6a4d53e8a9f76db9abfa26e041410af97ca6238bd713e1529e73b3fe9570\": container with ID starting with bd4a6a4d53e8a9f76db9abfa26e041410af97ca6238bd713e1529e73b3fe9570 not found: ID does not exist" Nov 02 23:11:32.119929 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:32.119900 5963 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["test-ns-9b7mr/trainer-netpol-workload-6dggc-node-0-0-fqmp9"] Nov 02 23:11:32.124523 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:32.124497 5963 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["test-ns-9b7mr/trainer-netpol-workload-6dggc-node-0-0-fqmp9"] Nov 02 23:11:33.863289 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:33.863255 5963 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="216572b0-a4c3-4be2-b2c0-d737c4db50db" path="/var/lib/kubelet/pods/216572b0-a4c3-4be2-b2c0-d737c4db50db/volumes" Nov 02 23:11:37.041776 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:37.041751 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5mtfp_15a806bb-6e90-479d-8f94-d9915b47cbde/kube-multus-additional-cni-plugins/0.log" Nov 02 23:11:37.068512 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:37.068478 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5mtfp_15a806bb-6e90-479d-8f94-d9915b47cbde/egress-router-binary-copy/0.log" Nov 02 23:11:37.094465 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:37.094436 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5mtfp_15a806bb-6e90-479d-8f94-d9915b47cbde/cni-plugins/0.log" Nov 02 23:11:37.120787 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:37.120741 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5mtfp_15a806bb-6e90-479d-8f94-d9915b47cbde/bond-cni-plugin/0.log" Nov 02 23:11:37.147014 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:37.146970 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5mtfp_15a806bb-6e90-479d-8f94-d9915b47cbde/routeoverride-cni/0.log" Nov 02 23:11:37.172881 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:37.172854 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5mtfp_15a806bb-6e90-479d-8f94-d9915b47cbde/whereabouts-cni-bincopy/0.log" Nov 02 23:11:37.203047 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:37.203011 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5mtfp_15a806bb-6e90-479d-8f94-d9915b47cbde/whereabouts-cni/0.log" Nov 02 23:11:37.676531 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:37.676487 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-kbrwm_9bdd0bfc-5731-4aaa-8aea-d805a8ff0d34/kube-multus/0.log" Nov 02 23:11:37.813637 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:37.813602 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gzkfr_84467c9f-0161-4e44-9420-dcc224215f05/network-metrics-daemon/0.log" Nov 02 23:11:37.834015 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:37.833984 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gzkfr_84467c9f-0161-4e44-9420-dcc224215f05/kube-rbac-proxy/0.log" Nov 02 23:11:38.893738 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:38.893695 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024 Nov 02 23:11:38.926067 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:38.926030 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g996m_e011b0d4-3387-4b79-9a3f-b3fac185c126/ovn-controller/0.log" Nov 02 23:11:38.945445 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:38.945410 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g996m_e011b0d4-3387-4b79-9a3f-b3fac185c126/ovn-acl-logging/0.log" Nov 02 23:11:38.975069 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:38.975023 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g996m_e011b0d4-3387-4b79-9a3f-b3fac185c126/kube-rbac-proxy-node/0.log" Nov 02 23:11:39.001564 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:39.001532 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g996m_e011b0d4-3387-4b79-9a3f-b3fac185c126/kube-rbac-proxy-ovn-metrics/0.log" Nov 02 23:11:39.025909 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:39.025877 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g996m_e011b0d4-3387-4b79-9a3f-b3fac185c126/northd/0.log" Nov 02 23:11:39.050774 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:39.050738 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g996m_e011b0d4-3387-4b79-9a3f-b3fac185c126/nbdb/0.log" Nov 02 23:11:39.075352 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:39.075326 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g996m_e011b0d4-3387-4b79-9a3f-b3fac185c126/sbdb/0.log" Nov 02 23:11:39.161547 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:39.161465 5963 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g996m_e011b0d4-3387-4b79-9a3f-b3fac185c126/ovnkube-controller/0.log" Nov 02 23:11:39.456988 ip-10-0-139-99 kubenswrapper[5963]: I1102 23:11:39.456901 5963 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-km4nc_fd77571d-49e8-4127-951a-f8a4412d8e43/konnectivity-agent/0.log" limit=1024